09-12-2026, 04:28 AM
Quote:A couple things I'd check first. If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious. Not gl
Did a small comparison this afternoon. On mini PC with Ollama, I saw basically the same behavior. The main thing that moved was latency, not quality.
