Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
non-AI thing you built recently
#11
Quote:My first guess would be this: On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of th

That matches what I was seeing. That matches what I saw on Threadripper box. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
small models can still be good
Reply


Messages In This Thread
Re: non-AI thing you built recently - by llm_wren - 09-04-2026, 05:00 AM
Re: non-AI thing you built recently - by localtinker - 09-04-2026, 09:04 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)