10-18-2026, 04:22 PM
Interesting, I hadn't tried that. I ended up in about the same place using TensorRT-LLM. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
|
CLI helpers for local models: setup advice
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
CLI helpers for local models: setup advice - by cachebench - 10-14-2026, 11:34 AM
Re: CLI helpers for local models: setup advice - by phasetrack - 10-15-2026, 12:00 AM
Re: CLI helpers for local models: setup advice - by kernelgrid - 10-15-2026, 02:24 AM
Re: CLI helpers for local models: setup advice - by mlxgarden - 10-18-2026, 02:48 AM
Re: CLI helpers for local models: setup advice - by latentscope35 - 10-18-2026, 11:34 AM
Re: CLI helpers for local models: setup advice - by edgequill - 10-18-2026, 04:22 PM
|
Users browsing this thread: 1 Guest(s)