Inference › Apps / Utilities / Tools › Local v
desktop apps around local AI

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
desktop apps around local AI
rocmriley Offline
Member
***
Posts: 211
Threads: 21
Joined: Sep 2026
Reputation: 0
#1
09-18-2026, 09:19 PM
Thought I'd post a small recipe because a lot of threads ask similar things.

Just sharing a setup that ended up working reasonably well: Qwen, vLLM, dual 3090, with a lot of attention on structured output.

Maybe useful as a starting point for newer folks. I keep promising myself this is the last rebuild.
7900 XTX / ROCm / somehow still optimistic
Find
Reply


Messages In This Thread
desktop apps around local AI - by rocmriley - 09-18-2026, 09:19 PM
Re: desktop apps around local AI - by cachebench - 09-18-2026, 10:16 PM
Re: desktop apps around local AI - by vectorport - 09-21-2026, 10:16 PM
Re: desktop apps around local AI - by rasterbench - 09-21-2026, 11:55 PM
Re: desktop apps around local AI - by vramstream - 09-29-2026, 07:38 PM
Re: desktop apps around local AI - by batchshed - 09-28-2026, 04:13 AM
Re: desktop apps around local AI - by rocmhouse90 - 09-29-2026, 07:32 PM
Re: desktop apps around local AI - by relayforge - 09-26-2026, 01:13 AM
Re: desktop apps around local AI - by rocmcrate26 - 09-26-2026, 01:46 AM
Re: desktop apps around local AI - by mlxgarden - 09-26-2026, 06:31 AM
Re: desktop apps around local AI - by rocmriley - 09-27-2026, 06:48 PM
Re: desktop apps around local AI - by vectorport - 09-29-2026, 04:57 PM
Re: desktop apps around local AI - by deltagrid - 09-30-2026, 04:01 AM

Forum Jump:


Users browsing this thread: 2 Guest(s)