+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: NVIDIA / CUDA (https://www.datasculpting.ai/inference/forumdisplay.php?fid=31)
+--- Thread: Blackwell deployment chatter (/showthread.php?tid=687)
Blackwell deployment chatter - dockember - 10-02-2026
Did a bit of testing and thought I'd post the result here.
I tried this with Gemma using Ollama on A6000. The headline result was better than I expected, but long context still ended up being the limiting factor.
Curious if anyone else landed in the same place.