quant choices for 70B local: what are you seeing?

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

quant choices for 70B local: what are you seeing?

fusedtinker Offline

Offline

Junior Member

Posts: 25
Threads: 4
Joined: Sep 2026
Reputation: 0

#10

09-18-2026, 12:01 AM

Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?

I'm happy to test one more variant if you want a second data point.

curious and caffeinated

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

quant choices for 70B local: what are you seeing? - by vectorport - 09-13-2026, 06:44 PM

Re: quant choices for 70B local: what are you seeing? - by relaynest82 - 09-13-2026, 11:24 PM

Re: quant choices for 70B local: what are you seeing? - by llmarch83 - 09-14-2026, 03:43 AM

Re: quant choices for 70B local: what are you seeing? - by southtinker - 09-15-2026, 04:28 AM

Re: quant choices for 70B local: what are you seeing? - by northquill - 09-15-2026, 05:15 PM

Re: quant choices for 70B local: what are you seeing? - by benchplease - 09-15-2026, 05:57 PM

Re: quant choices for 70B local: what are you seeing? - by bytehall - 09-17-2026, 06:36 AM

Re: quant choices for 70B local: what are you seeing? - by llmarch51 - 09-17-2026, 07:13 PM

Re: quant choices for 70B local: what are you seeing? - by vrambandit - 09-17-2026, 07:52 PM

Re: quant choices for 70B local: what are you seeing? - by fusedtinker - 09-18-2026, 12:01 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)