Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
RTX 5090 local inference for Llama
#1
Spent some time on this today and wanted to compare notes.

Two paths both seem viable, but they break down differently once token cost becomes important.

Interested in tradeoffs more than fan loyalty.

My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Reply


Messages In This Thread
RTX 5090 local inference for Llama - by torchshed - 10-13-2026, 07:44 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)