Inference › Evaluation & Testing › Benchmarks v
eval setup for local models

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
eval setup for local models
benchplease Offline
Member
***
Posts: 123
Threads: 18
Joined: Sep 2026
Reputation: 0
#1
09-21-2026, 01:03 AM
Curious what people here are seeing.

I'm mostly working with Phi in PyTorch on A6000. The part I'm trying to understand is VRAM headroom.

Would appreciate practical advice rather than theory.
post logs or it didn't happen
Find
Reply


Messages In This Thread
eval setup for local models - by benchplease - 09-21-2026, 01:03 AM
Re: eval setup for local models - by kernelarch - 09-22-2026, 01:48 PM
Re: eval setup for local models - by cacheline - 09-22-2026, 02:11 PM
Re: eval setup for local models - by routearch - 09-23-2026, 03:39 AM
Re: eval setup for local models - by cacheline - 09-23-2026, 04:01 AM
Re: eval setup for local models - by nanobrook - 09-23-2026, 02:34 PM
Re: eval setup for local models - by benchplease - 09-23-2026, 04:40 AM
Re: eval setup for local models - by cacheline - 09-23-2026, 06:05 AM
Re: eval setup for local models - by benchplease - 09-25-2026, 03:11 AM
Re: eval setup for local models - by relayforge - 09-25-2026, 11:22 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)