where open models feel surprisingly good with TensorRT-LLM
|
where open models feel surprisingly good with TensorRT-LLM
|
10-10-2026, 07:28 AM
Quote:This keeps coming up in conversation so I figured I'd start a thread. My first guess would be this: On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. |
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
where open models feel surprisingly good with TensorRT-LLM - by localtinker - 10-10-2026, 04:38 AM
Re: where open models feel surprisingly good with TensorRT-LLM - by vrampilot - 10-10-2026, 07:28 AM
Re: where open models feel surprisingly good with TensorRT-LLM - by rocmriley - 10-13-2026, 07:36 AM
|
