![]() |
|
industry move that matters for local users - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24) +--- Forum: News & Industry (https://www.datasculpting.ai/inference/forumdisplay.php?fid=26) +--- Thread: industry move that matters for local users (/showthread.php?tid=1274) |
industry move that matters for local users - mangovault67 - 10-15-2026 Thought I'd post a small recipe because a lot of threads ask similar things. Maybe useful as a starting point: TensorRT-LLM on 7900 XTX, keeping consumer GPUs in mind from the start. If someone wants the exact settings I can clean them up and post them. Re: industry move that matters for local users - fusedtinker - 10-17-2026 same here on my side. Re: industry move that matters for local users - fastlab - 10-19-2026 Need a little more detail here. Is this local-only or are you routing anything externally? |