09-02-2026, 01:06 PM
Ran a quick check on my box. On Threadripper box with llama.cpp, I saw basically the same behavior. The main thing that moved was latency, not quality.
|
why this quant got weird repetition
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
why this quant got weird repetition - by vramport - 08-30-2026, 03:18 AM
Re: why this quant got weird repetition - by stackpilot - 08-30-2026, 04:02 AM
Re: why this quant got weird repetition - by northquill - 08-30-2026, 06:38 AM
Re: why this quant got weird repetition - by benchplease - 08-30-2026, 05:09 AM
Re: why this quant got weird repetition - by benchplease - 08-30-2026, 08:08 AM
Re: why this quant got weird repetition - by southtinker - 08-30-2026, 06:06 AM
Re: why this quant got weird repetition - by cacheworks - 09-02-2026, 08:57 AM
Re: why this quant got weird repetition - by batchfield55 - 09-02-2026, 01:06 PM
|
Users browsing this thread: 1 Guest(s)