Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
batching changes after update
#1
Spent some time on this today and wanted to compare notes.

I'm comparing two approaches here: keep it simple on mini PC, or squeeze more out of the stack and deal with the complexity.

What would you pick if you had to live with it for a few months?
still benchmarking everything
Reply
#2
Quote:Spent some time on this today and wanted to compare notes.

A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Mistral and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Reply
#3
Quote:
Quote:Spent some time on this today and wanted to compare notes.

Appreciate the detail. That matches what I saw on Threadripper box. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
small models can still be good
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)