context size vs speed in GGUF: setup advice

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

context size vs speed in GGUF: setup advice

vrambandit Offline

Offline

Member

Posts: 168
Threads: 14
Joined: Sep 2026
Reputation: 0

#13

10-17-2026, 11:31 AM

I'd start with the simpler stack.

2x3090 • llama.cpp • too much VRAM is still not enough

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

context size vs speed in GGUF: setup advice - by latentpeak22 - 10-10-2026, 10:48 AM

Re: context size vs speed in GGUF: setup advice - by vrambandit - 10-10-2026, 10:51 PM

Re: context size vs speed in GGUF: setup advice - by vrambandit - 10-16-2026, 11:59 PM

Re: context size vs speed in GGUF: setup advice - by thetagrid15 - 10-11-2026, 03:13 AM

Re: context size vs speed in GGUF: setup advice - by macroforge - 10-12-2026, 03:30 PM

Re: context size vs speed in GGUF: setup advice - by thetagrid15 - 10-15-2026, 03:39 PM

Re: context size vs speed in GGUF: setup advice - by bytegarden73 - 10-15-2026, 08:26 PM

Re: context size vs speed in GGUF: setup advice - by batchpeak - 10-17-2026, 10:56 AM

Re: context size vs speed in GGUF: setup advice - by phasescope - 10-15-2026, 08:53 PM

Re: context size vs speed in GGUF: setup advice - by macroforge - 10-15-2026, 11:03 PM

Re: context size vs speed in GGUF: setup advice - by latentcraft - 10-16-2026, 11:37 AM

Re: context size vs speed in GGUF: setup advice - by northcraft90 - 10-17-2026, 02:41 AM

Re: context size vs speed in GGUF: setup advice - by vrambandit - 10-17-2026, 11:31 AM

Re: context size vs speed in GGUF: setup advice - by pixelcrate82 - 10-18-2026, 10:32 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)