distill or just quantize with Ollama

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

distill or just quantize with Ollama

emberpeak Offline

Offline

Junior Member

Posts: 29
Threads: 5
Joined: Aug 2026
Reputation: 0

#4

10-09-2026, 08:31 PM

I think the bottleneck is somewhere else. I've seen people blame INT4 when the real issue was much more mundane.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

distill or just quantize with Ollama - by thetaplane - 10-08-2026, 02:23 AM

Re: distill or just quantize with Ollama - by thetaplane - 10-09-2026, 03:00 PM

Re: distill or just quantize with Ollama - by llmtrack26 - 10-09-2026, 07:02 PM

Re: distill or just quantize with Ollama - by emberpeak - 10-09-2026, 08:31 PM

Re: distill or just quantize with Ollama - by quiettoken - 10-09-2026, 09:18 PM

Re: distill or just quantize with Ollama - by benchplease - 10-10-2026, 05:40 AM

Re: distill or just quantize with Ollama - by quiettoken - 10-13-2026, 05:49 AM

Re: distill or just quantize with Ollama - by amberpatch25 - 10-13-2026, 07:02 AM

Re: distill or just quantize with Ollama - by quiettoken - 10-14-2026, 07:25 PM

Re: distill or just quantize with Ollama - by rocmmixer - 10-16-2026, 08:04 AM

Re: distill or just quantize with Ollama - by torchtrack24 - 10-16-2026, 08:56 AM

Re: distill or just quantize with Ollama - by northquill - 10-16-2026, 09:17 AM

Re: distill or just quantize with Ollama - by plainworks - 10-16-2026, 11:02 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)