10-09-2026, 03:00 PM
Did a small comparison this afternoon. On A6000 with PyTorch, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
|
distill or just quantize with Ollama
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)