Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
domain tune without wrecking base behavior
#8
Quote:Not sure I agree there. I get why that seems right, but on dual 3090 the bottleneck felt elsewhere. Not saying you're wrong, just that I wouldn't lock

Thanks, that helps. I ended up in about the same place using SGLang. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
small models can still be good
Reply


Messages In This Thread
Re: domain tune without wrecking base behavior - by localtinker - 09-02-2026, 05:07 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)