first LoRA that actually helped: early impressions

[northgrid33]

Curious what people here are seeing.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling prefill/decode split.

Not looking for the perfect answer, mostly what worked in real use.