Inference › Apps / Utilities / Tools › Local v
CLI helpers for local models

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
CLI helpers for local models
vrambandit Offline
Member
***
Posts: 168
Threads: 14
Joined: Sep 2026
Reputation: 0
#12
10-19-2026, 12:55 AM
Interesting, I hadn't tried that. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
2x3090 • llama.cpp • too much VRAM is still not enough
Find
Reply


Messages In This Thread
CLI helpers for local models - by northhall88 - 10-14-2026, 04:17 AM
Re: CLI helpers for local models - by rocmriley - 10-14-2026, 09:03 PM
Re: CLI helpers for local models - by cachebench - 10-15-2026, 05:34 AM
Re: CLI helpers for local models - by audioriver - 10-15-2026, 10:17 AM
Re: CLI helpers for local models - by rasterbench - 10-16-2026, 11:02 PM
Re: CLI helpers for local models - by audioriver - 10-17-2026, 07:45 AM
Re: CLI helpers for local models - by mangoquill - 10-17-2026, 12:05 PM
Re: CLI helpers for local models - by vectorport - 10-18-2026, 07:40 PM
Re: CLI helpers for local models - by vectorport - 10-18-2026, 09:34 PM
Re: CLI helpers for local models - by vrambandit - 10-19-2026, 12:55 AM
Re: CLI helpers for local models - by llmpeak - 10-19-2026, 01:36 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)