10-16-2026, 07:30 AM
Quote:Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly.
I tested this tonight. On Threadripper box with PyTorch, I saw basically the same behavior.
|
context size vs speed in GGUF for Mixtral
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
context size vs speed in GGUF for Mixtral - by griffinloom66 - 10-08-2026, 04:53 PM
Re: context size vs speed in GGUF for Mixtral - by latentcraft - 10-09-2026, 05:40 AM
Re: context size vs speed in GGUF for Mixtral - by visionyard23 - 10-18-2026, 09:12 PM
Re: context size vs speed in GGUF for Mixtral - by vectorport - 10-12-2026, 06:22 AM
Re: context size vs speed in GGUF for Mixtral - by phasescope - 10-15-2026, 06:42 AM
Re: context size vs speed in GGUF for Mixtral - by sparrowhall - 10-16-2026, 07:30 AM
Re: context size vs speed in GGUF for Mixtral - by vrambandit - 10-16-2026, 08:08 AM
Re: context size vs speed in GGUF for Mixtral - by dockridge - 10-16-2026, 08:19 PM
Re: context size vs speed in GGUF for Mixtral - by pixelcrate82 - 10-17-2026, 08:37 AM
|
Users browsing this thread: 1 Guest(s)