Inference › Optimization & Performance
Quantization

Users browsing this forum: 6 Guest(s)
Mark this forum read
Quantization
Thread / Author Replies Views Rating Last Post [asc]
    0 63
  • 0 Vote(s) - 0 out of 5 in Average
 10-03-2026, 08:16 PM
Last Post: vrambandit
    1 62
  • 0 Vote(s) - 0 out of 5 in Average
 10-02-2026, 04:49 PM
Last Post: bytehall
    0 60
  • 0 Vote(s) - 0 out of 5 in Average
 09-27-2026, 05:20 PM
Last Post: northquill
   
Go to first unread post quant choices for 70B local (Pages: 1 2 )
vrambandit, 09-16-2026, 11:51 PM
 15 282
  • 0 Vote(s) - 0 out of 5 in Average
 09-27-2026, 10:53 AM
Last Post: fastscope
    0 74
  • 0 Vote(s) - 0 out of 5 in Average
 09-23-2026, 10:47 AM
Last Post: paperrunner
    9 191
  • 0 Vote(s) - 0 out of 5 in Average
 09-18-2026, 12:01 AM
Last Post: fusedtinker
   
Go to first unread post best small quant that still feels smart (Pages: 1 2 )
deltagrid, 09-10-2026, 10:48 PM
 15 307
  • 0 Vote(s) - 0 out of 5 in Average
 09-15-2026, 08:41 PM
Last Post: nanobrook
   
Go to first unread post AWQ vs GPTQ vs GGUF right now (Pages: 1 2 )
phasestream53, 09-06-2026, 01:24 AM
 11 248
  • 0 Vote(s) - 0 out of 5 in Average
 09-14-2026, 05:43 PM
Last Post: phasestream53
    2 129
  • 0 Vote(s) - 0 out of 5 in Average
 09-06-2026, 06:39 AM
Last Post: turboscope
    7 172
  • 0 Vote(s) - 0 out of 5 in Average
 09-02-2026, 01:06 PM
Last Post: batchfield55
   
Go to first unread post AWQ vs GPTQ vs GGUF right now
cachelab, 08-27-2026, 05:56 AM
 9 202
  • 0 Vote(s) - 0 out of 5 in Average
 08-29-2026, 03:47 AM
Last Post: turboscope
    0 38
  • 0 Vote(s) - 0 out of 5 in Average
 08-21-2026, 01:31 PM
Last Post: flintriver50


  New Posts
  Hot Thread (New)
  Hot Thread (No New)
  No New Posts
  Contains Posts by You
  Closed Thread

Search this Forum:

Forum Jump: