context size vs speed in GGUF: what are you seeing?
|
context size vs speed in GGUF: what are you seeing?
|
10-17-2026, 12:35 PM
Quote:Quote:Spent some time on this today and wanted to compare notes. I think the bottleneck is somewhere else. I've seen people blame router policy when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
2x3090 • llama.cpp • too much VRAM is still not enough
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
context size vs speed in GGUF: what are you seeing? - by torchsupply99 - 10-15-2026, 11:29 PM
Re: context size vs speed in GGUF: what are you seeing? - by papermixer4 - 10-16-2026, 12:15 AM
Re: context size vs speed in GGUF: what are you seeing? - by vrambandit - 10-17-2026, 12:35 PM
|
