Inference › Inference Engines › llama.cpp / GGUF v
context size vs speed in GGUF: what are you seeing?

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
context size vs speed in GGUF: what are you seeing?
papermixer4 Offline
Junior Member
**
Posts: 44
Threads: 4
Joined: Aug 2026
Reputation: 0
#2
10-16-2026, 12:15 AM
Quote:Spent some time on this today and wanted to compare notes.

Thanks, that helps. The pattern around continuous batching has been pretty similar for me.
Find
Reply


Messages In This Thread
Re: context size vs speed in GGUF: what are you seeing? - by papermixer4 - 10-16-2026, 12:15 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)