Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
do small edge boxes make sense with llama.cpp
#6
I think the bottleneck is somewhere else. I've seen people blame VRAM headroom when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.
image models by night, local pipelines by day
Reply


Messages In This Thread
Re: do small edge boxes make sense with llama.cpp - by visionforge - 10-11-2026, 04:43 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)