distill or just quantize for DeepSeek

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

distill or just quantize for DeepSeek

cobaltlab Offline

Offline

Junior Member

Posts: 27
Threads: 1
Joined: Aug 2026
Reputation: 0

#12

08-30-2026, 12:35 PM

Tried to reproduce it just now. On M3 Max with vLLM, I saw basically the same behavior.

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

distill or just quantize for DeepSeek - by turboyard94 - 08-27-2026, 03:17 AM

Re: distill or just quantize for DeepSeek - by cobaltlab - 08-28-2026, 03:19 AM

Re: distill or just quantize for DeepSeek - by batchscope72 - 08-28-2026, 04:03 AM

Re: distill or just quantize for DeepSeek - by northquill - 08-28-2026, 04:57 AM

Re: distill or just quantize for DeepSeek - by llmtrack26 - 08-28-2026, 09:25 AM

Re: distill or just quantize for DeepSeek - by vrampilot - 08-30-2026, 12:30 AM

Re: distill or just quantize for DeepSeek - by turboyard94 - 08-28-2026, 11:51 AM

Re: distill or just quantize for DeepSeek - by dockember - 08-29-2026, 12:04 PM

Re: distill or just quantize for DeepSeek - by quietstack - 08-30-2026, 09:54 AM

Re: distill or just quantize for DeepSeek - by emberpeak - 08-30-2026, 12:56 AM

Re: distill or just quantize for DeepSeek - by thetagrid15 - 08-30-2026, 09:16 AM

Re: distill or just quantize for DeepSeek - by cobaltlab - 08-30-2026, 12:35 PM

Re: distill or just quantize for DeepSeek - by torchtrack24 - 08-30-2026, 03:15 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)