10-18-2026, 09:47 PM
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.
Mostly CUDA, sometimes wrong, usually measured
|
consumer GPU serving economics
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
consumer GPU serving economics - by kernelrunner - 10-16-2026, 02:35 PM
Re: consumer GPU serving economics - by tensorfield88 - 10-16-2026, 03:28 PM
Re: consumer GPU serving economics - by localpatch78 - 10-16-2026, 06:51 PM
Re: consumer GPU serving economics - by kernelrunner - 10-16-2026, 05:55 PM
Re: consumer GPU serving economics - by papermixer4 - 10-16-2026, 10:58 PM
Re: consumer GPU serving economics - by sparrowshed - 10-17-2026, 07:17 AM
Re: consumer GPU serving economics - by kernelmike - 10-18-2026, 07:50 AM
Re: consumer GPU serving economics - by marbletrack - 10-18-2026, 12:02 PM
Re: consumer GPU serving economics - by signalcraft14 - 10-18-2026, 05:31 PM
Re: consumer GPU serving economics - by tensorfield88 - 10-18-2026, 10:49 PM
Re: consumer GPU serving economics - by kernelmike - 10-18-2026, 09:47 PM
Re: consumer GPU serving economics - by stackarch - 10-18-2026, 09:58 PM
Re: consumer GPU serving economics - by localpatch - 10-18-2026, 11:05 PM
|
Users browsing this thread: 1 Guest(s)