Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
context size vs speed in GGUF: anyone testing this?
#12
That matches what I was seeing. The pattern around HBM constraints has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.

I'm happy to test one more variant if you want a second data point.
Reply


Messages In This Thread
Re: context size vs speed in GGUF: anyone testing this? - by modbench - 09-25-2026, 05:35 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)