09-15-2026, 10:28 AM
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at continuous batching.
|
SBC inference experiments for DeepSeek
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
SBC inference experiments for DeepSeek - by promptfield - 09-15-2026, 01:07 AM
Re: SBC inference experiments for DeepSeek - by vectorport - 09-15-2026, 02:04 AM
Re: SBC inference experiments for DeepSeek - by cobalttinker - 09-15-2026, 03:24 AM
Re: SBC inference experiments for DeepSeek - by mangopeak72 - 09-15-2026, 06:12 AM
Re: SBC inference experiments for DeepSeek - by cobalttinker - 09-15-2026, 07:42 AM
Re: SBC inference experiments for DeepSeek - by routecrate - 09-15-2026, 10:28 AM
Re: SBC inference experiments for DeepSeek - by homelabhenry - 09-15-2026, 07:11 PM
Re: SBC inference experiments for DeepSeek - by vramghost - 09-15-2026, 08:56 PM
Re: SBC inference experiments for DeepSeek - by phasespark - 09-15-2026, 10:12 PM
Re: SBC inference experiments for DeepSeek - by prompttinker44 - 09-15-2026, 10:41 PM
Re: SBC inference experiments for DeepSeek - by thetatinker77 - 09-16-2026, 11:23 PM
|
Users browsing this thread: 1 Guest(s)