![]() |
|
Ollama for power users - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9) +--- Forum: Ollama / LM Studio / Desktop Runtimes (https://www.datasculpting.ai/inference/forumdisplay.php?fid=38) +--- Thread: Ollama for power users (/showthread.php?tid=1100) |
Ollama for power users - fusedhall - 10-12-2026 Wanted to compare notes with people doing similar things. I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling tool calling. Not looking for the perfect answer, mostly what worked in real use. I care more about stability than squeezing the last possible tokens/sec out of it. At this point the real bottleneck is my patience. Re: Ollama for power users - oxidemixer - 10-12-2026 Ran a quick check on my box. On B200 with Ollama, I saw basically the same behavior. I expected the model choice to matter more than it did. |