![]() |
|
few-shot when you actually need it: setup advice - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15) +--- Forum: Prompts / System Prompts (https://www.datasculpting.ai/inference/forumdisplay.php?fid=62) +--- Thread: few-shot when you actually need it: setup advice (/showthread.php?tid=1377) Pages:
1
2
|
Re: few-shot when you actually need it: setup advice - mintstation99 - 10-19-2026 Quote:Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter mor Maybe, but I had the opposite result. I get why that seems right, but on dual 3090 the bottleneck felt elsewhere. Could be a workload difference, but I wouldn't generalize too fast from one setup. |