10-11-2026, 06:20 AM
Posting this in case it saves someone else a little time.
I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about tail latency.
Would rather learn from your scars than collect my own all at once.
This is mostly for local work rather than public serving.
I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about tail latency.
Would rather learn from your scars than collect my own all at once.
This is mostly for local work rather than public serving.
2x3090 • llama.cpp • too much VRAM is still not enough