Inference
few-shot when you actually need it: setup advice - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Prompts / System Prompts (https://www.datasculpting.ai/inference/forumdisplay.php?fid=62)
+--- Thread: few-shot when you actually need it: setup advice (/showthread.php?tid=1377)

Pages: 1 2


Re: few-shot when you actually need it: setup advice - mintstation99 - 10-19-2026

Quote:Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter mor

Maybe, but I had the opposite result. I get why that seems right, but on dual 3090 the bottleneck felt elsewhere. Could be a workload difference, but I wouldn't generalize too fast from one setup.