+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: News & Industry (https://www.datasculpting.ai/inference/forumdisplay.php?fid=26)
+--- Thread: latest release actually worth attention with PyTorch (/showthread.php?tid=391)
Pages:
1
2
Re: latest release actually worth attention with PyTorch - amberrunner - 09-25-2026
Quote:I'd start with the simpler stack.
Tried to reproduce it just now. On B200 with Ollama, I saw basically the same behavior. I expected the model choice to matter more than it did.
Re: latest release actually worth attention with PyTorch - modbench - 09-28-2026
Not sure I agree there. I've seen people blame tokens/sec when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
I'm happy to test one more variant if you want a second data point.