Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
CLI helpers for local models for Gemma
#9
Quote:I think the bottleneck is somewhere else. I've seen people blame token cost when the real issue was much more mundane.

Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.
7900 XTX / ROCm / somehow still optimistic
Reply


Messages In This Thread
Re: CLI helpers for local models for Gemma - by rocmriley - 10-11-2026, 06:34 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)