Inference
new here, what's your stack: early impressions - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: new here, what's your stack: early impressions (/showthread.php?tid=1044)



new here, what's your stack: early impressions - quiettoken - 10-11-2026

I'm trying to sanity-check my setup.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling prefill/decode split.

Not looking for the perfect answer, mostly what worked in real use.