Inference
few-shot when you actually need it - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Prompts / System Prompts (https://www.datasculpting.ai/inference/forumdisplay.php?fid=62)
+--- Thread: few-shot when you actually need it (/showthread.php?tid=1435)

Pages: 1 2


Re: few-shot when you actually need it - batchember - 10-19-2026

My first guess would be this: If you're on PyTorch, I'd confirm the version first and then reduce variables until the behavior is obvious.


Re: few-shot when you actually need it - quantyard - 10-19-2026

Good point. That matches what I saw on mini PC. The biggest change for me was simplifying the stack instead of adding one more optimization layer.


Re: few-shot when you actually need it - mlxgarden - 10-19-2026

Can you fill in a bit more context? Is this local-only or are you routing anything externally?


Re: few-shot when you actually need it - nanopatch - 10-19-2026

What worked for me was pretty simple. On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives.