+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Long Context / Memory (https://www.datasculpting.ai/inference/forumdisplay.php?fid=64)
+--- Thread: context stuffing mistakes for Phi (/showthread.php?tid=737)
context stuffing mistakes for Phi - vrampilot - 10-05-2026
Spent some time on this today and wanted to compare notes.
I've gone back and forth between LM Studio and PyTorch for Kimi. The interesting difference for me has been small local stacks.
Interested in tradeoffs more than fan loyalty.
This is mostly for local work rather than public serving.
Re: context stuffing mistakes for Phi - fusedhall56 - 10-05-2026
Interesting, I hadn't tried that. That matches what I saw on B200. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: context stuffing mistakes for Phi - bytesupply76 - 10-05-2026
Good point. I ended up in about the same place using SGLang. The biggest change for me was simplifying the stack instead of adding one more optimization layer.