Inference
Used A6000 worth it now - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: GPUs (https://www.datasculpting.ai/inference/forumdisplay.php?fid=28)
+--- Thread: Used A6000 worth it now (/showthread.php?tid=1303)



Used A6000 worth it now - sanevault - 10-15-2026

Spent some time on this today and wanted to compare notes.

I'm comparing two approaches here: keep it simple on Threadripper box, or squeeze more out of the stack and deal with the complexity.

Interested in tradeoffs more than fan loyalty.


Re: Used A6000 worth it now - vrambandit - 10-16-2026

My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tool calling. Not glamorous advice, but repeatable baselines save a lot of time.