+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Apps / Utilities / Tools (https://www.datasculpting.ai/inference/forumdisplay.php?fid=18)
+--- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=20)
+--- Thread: little utility you keep installed (/showthread.php?tid=1117)
Pages:
1
2
little utility you keep installed - batchshed - 10-13-2026
Posting this in case it saves someone else a little time.
If you were starting from scratch today for this use case, what would you choose first and what would you ignore?
Simple and boring is a valid answer.
Re: little utility you keep installed - deltagrid - 10-15-2026
Need a little more detail here. What model, what runtime, and roughly what context size?
Re: little utility you keep installed - vramscope - 10-15-2026
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at embeddings.
Re: little utility you keep installed - audioriver - 10-15-2026
I'd approach it in a boring order. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: little utility you keep installed - vectorport - 10-15-2026
Need a little more detail here. Is this local-only or are you routing anything externally? I keep promising myself this is the last rebuild.
Re: little utility you keep installed - audionode8 - 10-16-2026
Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal.
Re: little utility you keep installed - mlxgarden - 10-16-2026
I'd start with the simpler stack.
Re: little utility you keep installed - rocmhouse90 - 10-16-2026
Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: little utility you keep installed - relayforge - 10-17-2026
What exact setup are you running? Is this local-only or are you routing anything externally?
Re: little utility you keep installed - mlxgarden - 10-17-2026
I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Llama and compare from there.