+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Prompts / System Prompts (https://www.datasculpting.ai/inference/forumdisplay.php?fid=62)
+--- Thread: few-shot when you actually need it on B200 (/showthread.php?tid=527)
few-shot when you actually need it on B200 - rasterhall - 09-28-2026
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like KV cache pressure decides everything downstream.
Curious whether that lines up with what other people are seeing.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Re: few-shot when you actually need it on B200 - thetafield - 09-28-2026
Quote:This keeps coming up in conversation so I figured I'd start a thread.
same here on my side.
Re: few-shot when you actually need it on B200 - nanopatch - 09-29-2026
subscribed, curious where this lands.