+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: Routers (https://www.datasculpting.ai/inference/forumdisplay.php?fid=45)
+--- Thread: cleaning small domain dataset with llama.cpp (/showthread.php?tid=1026)
cleaning small domain dataset with llama.cpp - routeline23 - 10-11-2026
I'm trying to sanity-check my setup.
I'm mostly working with Mistral in Ollama on 5090. The part I'm trying to understand is HBM constraints.
If you've tested something similar, what did you keep and what did you stop bothering with?
I expected the biggest difference to come from the model, but the stack around it mattered at least as much.
Re: cleaning small domain dataset with llama.cpp - routecraft - 10-11-2026
Did a small comparison this afternoon. On 7900 XTX with LM Studio, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.