Inference › Evaluation & Testing › Evals v
quality tests for local assistants: anyone testing this?

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Threaded Mode
quality tests for local assistants: anyone testing this?
audionode8 Offline
Member
***
Posts: 65
Threads: 5
Joined: Sep 2026
Reputation: 0
#1
10-04-2026, 12:07 PM
Spent some time on this today and wanted to compare notes.

I've gone back and forth between SGLang and PyTorch for FLUX. The interesting difference for me has been NVFP4.

Trying to avoid rebuilding the whole thing twice.
Find
Reply
cudacrate Offline
Junior Member
**
Posts: 47
Threads: 4
Joined: Aug 2026
Reputation: 0
#2
10-05-2026, 12:20 PM
Need a little more detail here. Are you testing this on Threadripper box or something else?
learning in public
Find
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)