Inference
first LoRA that actually helped on B200 - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Optimization & Performance (https://www.datasculpting.ai/inference/forumdisplay.php?fid=10)
+--- Forum: Benchmarks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=43)
+--- Thread: first LoRA that actually helped on B200 (/showthread.php?tid=918)

Pages: 1 2


Re: first LoRA that actually helped on B200 - quiethouse - 10-15-2026

Tried to reproduce it just now. On dual 3090 with SGLang, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.