Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
do small edge boxes make sense with llama.cpp
#2
Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed. At this point the real bottleneck is my patience.
Reply


Messages In This Thread
Re: do small edge boxes make sense with llama.cpp - by sanepeak48 - 10-08-2026, 02:43 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)