Inference › Optimization & Performance › Quantization v
why this quant got weird repetition

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
why this quant got weird repetition
fusedtinker Offline
Junior Member
**
Posts: 25
Threads: 4
Joined: Sep 2026
Reputation: 0
#11
10-11-2026, 10:59 PM
Quote:following this because I'm in the same boat.

That matches what I was seeing. I ended up in about the same place using SGLang. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
curious and caffeinated
Find
Reply


Messages In This Thread
Re: why this quant got weird repetition - by fusedtinker - 10-11-2026, 10:59 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)