09-06-2026, 01:20 AM
Ran a quick check on my box. On 4090 with vLLM, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
measure twice, benchmark three times
|
draft model choices on mini PC
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
draft model choices on mini PC - by cacheline - 09-05-2026, 10:52 PM
Re: draft model choices on mini PC - by cacheline - 09-06-2026, 01:20 AM
Re: draft model choices on mini PC - by audiopath66 - 09-06-2026, 10:50 AM
Re: draft model choices on mini PC - by benchplease - 09-06-2026, 02:11 AM
Re: draft model choices on mini PC - by cacheline - 09-06-2026, 10:12 AM
Re: draft model choices on mini PC - by cacheline - 09-09-2026, 11:13 AM
Re: draft model choices on mini PC - by cacheline - 09-09-2026, 01:20 PM
Re: draft model choices on mini PC - by cudaline - 09-09-2026, 01:41 PM
Re: draft model choices on mini PC - by cacheline - 09-10-2026, 02:11 PM
Re: draft model choices on mini PC - by phaseshed - 09-10-2026, 03:05 PM
Re: draft model choices on mini PC - by cacheline - 09-10-2026, 03:43 PM
|
Users browsing this thread: 1 Guest(s)