+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Edge AI & Gadgets (https://www.datasculpting.ai/inference/forumdisplay.php?fid=21)
+--- Forum: AI Devices (https://www.datasculpting.ai/inference/forumdisplay.php?fid=75)
+--- Thread: AI pin style devices but useful? on 4090 (/showthread.php?tid=903)
Pages:
1
2
Re: AI pin style devices but useful? on 4090 - flintriver50 - 10-14-2026
I'd approach it in a boring order. If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious.
Re: AI pin style devices but useful? on 4090 - rocmpath - 10-14-2026
Can you fill in a bit more context? What model, what runtime, and roughly what context size?