|
SBC inference experiments for DeepSeek
|
09-15-2026, 10:41 PM
Quote:What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at prefix caching. Once Good point. That matches what I saw on M3 Max. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
mostly local
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
SBC inference experiments for DeepSeek - by promptfield - 09-15-2026, 01:07 AM
Re: SBC inference experiments for DeepSeek - by vectorport - 09-15-2026, 02:04 AM
Re: SBC inference experiments for DeepSeek - by cobalttinker - 09-15-2026, 03:24 AM
Re: SBC inference experiments for DeepSeek - by mangopeak72 - 09-15-2026, 06:12 AM
Re: SBC inference experiments for DeepSeek - by cobalttinker - 09-15-2026, 07:42 AM
Re: SBC inference experiments for DeepSeek - by routecrate - 09-15-2026, 10:28 AM
Re: SBC inference experiments for DeepSeek - by homelabhenry - 09-15-2026, 07:11 PM
Re: SBC inference experiments for DeepSeek - by vramghost - 09-15-2026, 08:56 PM
Re: SBC inference experiments for DeepSeek - by phasespark - 09-15-2026, 10:12 PM
Re: SBC inference experiments for DeepSeek - by prompttinker44 - 09-15-2026, 10:41 PM
Re: SBC inference experiments for DeepSeek - by thetatinker77 - 09-16-2026, 11:23 PM
|
