|
SBC inference experiments for DeepSeek
|
09-15-2026, 08:56 PM
My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at quant drift. Once you know the plain path works, then add the faster path back in piece by piece.
There are a few different conversations hiding inside this thread, so being explicit about the goal helps. |
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
SBC inference experiments for DeepSeek - by promptfield - 09-15-2026, 01:07 AM
Re: SBC inference experiments for DeepSeek - by vectorport - 09-15-2026, 02:04 AM
Re: SBC inference experiments for DeepSeek - by cobalttinker - 09-15-2026, 03:24 AM
Re: SBC inference experiments for DeepSeek - by mangopeak72 - 09-15-2026, 06:12 AM
Re: SBC inference experiments for DeepSeek - by cobalttinker - 09-15-2026, 07:42 AM
Re: SBC inference experiments for DeepSeek - by routecrate - 09-15-2026, 10:28 AM
Re: SBC inference experiments for DeepSeek - by homelabhenry - 09-15-2026, 07:11 PM
Re: SBC inference experiments for DeepSeek - by vramghost - 09-15-2026, 08:56 PM
Re: SBC inference experiments for DeepSeek - by phasespark - 09-15-2026, 10:12 PM
Re: SBC inference experiments for DeepSeek - by prompttinker44 - 09-15-2026, 10:41 PM
Re: SBC inference experiments for DeepSeek - by thetatinker77 - 09-16-2026, 11:23 PM
|
