Inference › Optimization & Performance
Quantization

Users browsing this forum: 3 Guest(s)
Mark this forum read
Quantization
Thread / Author Replies Views Rating Last Post [asc]
   
Go to first unread post quant choices for 70B local with PyTorch (Pages: 1 2 )
benchplease, 10-17-2026, 08:12 AM
 10 226
  • 0 Vote(s) - 0 out of 5 in Average
 10-19-2026, 05:26 AM
Last Post: relaynest82
   
Go to first unread post quant choices for 70B local (Pages: 1 2 )
southden, 10-11-2026, 01:50 AM
 15 332
  • 0 Vote(s) - 0 out of 5 in Average
 10-19-2026, 05:23 AM
Last Post: vrambandit
   
Go to first unread post quant choices for 70B local (Pages: 1 2 )
paperrunner, 10-18-2026, 08:44 PM
 14 321
  • 0 Vote(s) - 0 out of 5 in Average
 10-19-2026, 05:16 AM
Last Post: vrambandit
    15 308
  • 0 Vote(s) - 0 out of 5 in Average
 10-19-2026, 03:37 AM
Last Post: benchplease
    7 201
  • 0 Vote(s) - 0 out of 5 in Average
 10-19-2026, 02:29 AM
Last Post: cudaline
    6 120
  • 0 Vote(s) - 0 out of 5 in Average
 10-19-2026, 02:13 AM
Last Post: northquill
   
Go to first unread post AWQ vs GPTQ vs GGUF right now on mini PC (Pages: 1 2 )
cacheworks, 10-11-2026, 11:15 PM
 14 298
  • 0 Vote(s) - 0 out of 5 in Average
 10-18-2026, 10:46 PM
Last Post: marbletrack
    5 197
  • 0 Vote(s) - 0 out of 5 in Average
 10-16-2026, 11:03 PM
Last Post: quiettoken
    2 94
  • 0 Vote(s) - 0 out of 5 in Average
 10-15-2026, 08:54 AM
Last Post: fusedtinker
    5 146
  • 0 Vote(s) - 0 out of 5 in Average
 10-15-2026, 08:27 AM
Last Post: benchplease
   
Go to first unread post AWQ vs GPTQ vs GGUF right now on A6000 (Pages: 1 2 )
paperrunner, 10-04-2026, 04:12 PM
 15 277
  • 0 Vote(s) - 0 out of 5 in Average
 10-14-2026, 06:52 PM
Last Post: benchplease
   
Go to first unread post AWQ vs GPTQ vs GGUF right now (Pages: 1 2 )
plainline, 10-10-2026, 11:05 PM
 14 268
  • 0 Vote(s) - 0 out of 5 in Average
 10-13-2026, 04:22 AM
Last Post: cudaline
    8 191
  • 0 Vote(s) - 0 out of 5 in Average
 10-12-2026, 04:58 PM
Last Post: phasestream53
    2 79
  • 0 Vote(s) - 0 out of 5 in Average
 10-12-2026, 03:03 PM
Last Post: benchplease
   
Go to first unread post why this quant got weird repetition (Pages: 1 2 )
rocmriley, 10-06-2026, 03:46 PM
 11 251
  • 0 Vote(s) - 0 out of 5 in Average
 10-12-2026, 07:06 AM
Last Post: vramscope
    8 190
  • 0 Vote(s) - 0 out of 5 in Average
 10-10-2026, 10:20 PM
Last Post: benchplease
   
Go to first unread post best small quant that still feels smart (Pages: 1 2 )
fusedtinker, 09-27-2026, 09:18 AM
 12 254
  • 0 Vote(s) - 0 out of 5 in Average
 10-07-2026, 05:24 AM
Last Post: mangofield33
    5 171
  • 0 Vote(s) - 0 out of 5 in Average
 10-07-2026, 02:41 AM
Last Post: cacheworks
    8 180
  • 0 Vote(s) - 0 out of 5 in Average
 10-05-2026, 05:10 PM
Last Post: vramscope
    2 69
  • 0 Vote(s) - 0 out of 5 in Average
 10-04-2026, 08:28 AM
Last Post: benchplease


  New Posts
  Hot Thread (New)
  Hot Thread (No New)
  No New Posts
  Contains Posts by You
  Closed Thread

Search this Forum:

Forum Jump: