Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
quant choices for 70B local on GB200
#1
Curious what people here are seeing.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling reranking.

If you've tested something similar, what did you keep and what did you stop bothering with?
trying not to rebuild again
Reply


Messages In This Thread
quant choices for 70B local on GB200 - by cudaline - 10-13-2026, 04:23 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)