Inference
benchmark result I don't trust: early impressions - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Evaluation & Testing (https://www.datasculpting.ai/inference/forumdisplay.php?fid=16)
+--- Forum: Benchmarks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=65)
+--- Thread: benchmark result I don't trust: early impressions (/showthread.php?tid=1264)

Pages: 1 2


Re: benchmark result I don't trust: early impressions - deltastation - 10-18-2026

My first guess would be this: On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives.


Re: benchmark result I don't trust: early impressions - deltastation - 10-19-2026

I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at long context.


Re: benchmark result I don't trust: early impressions - northgrid33 - 10-19-2026

I don't think that's the whole story. I get why that seems right, but on mini PC the bottleneck felt elsewhere.