10-19-2026, 05:26 AM
Quote:Quote:following this because I'm in the same boat.
What exact setup are you running? Are you testing this on 7900 XTX or something else?
|
quant choices for 70B local with PyTorch
|
|
« Next Oldest | Next Newest »
|