10-18-2026, 04:47 AM
I don't think that's the whole story. I get why that seems right, but on Threadripper box the bottleneck felt elsewhere. Worth testing the simpler explanation before adopting the more interesting one.
|
power delivery for 24/7 serving with vLLM
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)