best local open-weight model this week with TensorRT-LLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

best local open-weight model this week with TensorRT-LLM

routecraft Offline

Member

Posts: 193
Threads: 27
Joined: Aug 2026
Reputation: 0

10-01-2026, 04:27 AM

Tried to reproduce it just now. On Threadripper box with vLLM, I saw basically the same behavior. I expected the model choice to matter more than it did.

routing beats arguing over one perfect model

Find

« Next Oldest | Next Newest »

Messages In This Thread

best local open-weight model this week with TensorRT-LLM - by vramforge - 09-26-2026, 12:44 PM

Re: best local open-weight model this week with TensorRT-LLM - by cudapoint - 09-26-2026, 05:06 PM

Re: best local open-weight model this week with TensorRT-LLM - by kernelgrid - 09-27-2026, 05:50 PM

Re: best local open-weight model this week with TensorRT-LLM - by turboarch95 - 09-28-2026, 02:19 AM

Re: best local open-weight model this week with TensorRT-LLM - by kernelhouse70 - 10-01-2026, 02:23 AM

Re: best local open-weight model this week with TensorRT-LLM - by thetaplane - 10-01-2026, 02:35 AM

Re: best local open-weight model this week with TensorRT-LLM - by northgarden37 - 10-01-2026, 03:06 AM

Re: best local open-weight model this week with TensorRT-LLM - by routecraft - 10-01-2026, 04:27 AM

Re: best local open-weight model this week with TensorRT-LLM - by torchtrack24 - 10-01-2026, 05:24 AM

Re: best local open-weight model this week with TensorRT-LLM - by torchsupply99 - 10-01-2026, 06:06 AM

Re: best local open-weight model this week with TensorRT-LLM - by cudascope - 10-01-2026, 06:37 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com