Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
best small quant that still feels smart
#1
Did a bit of testing and thought I'd post the result here.

After a few runs on 5090, I ended up with decent performance, but the setup only really made sense once I adjusted around structured output.

Happy to post more details if anyone wants them.

I expected the biggest difference to come from the model, but the stack around it mattered at least as much.
curious and caffeinated
Reply


Messages In This Thread
best small quant that still feels smart - by fusedtinker - 09-27-2026, 09:18 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)