|
consumer GPU serving economics
|
10-18-2026, 11:05 PM
I'd approach it in a boring order. If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. Turns out 'just one more test' was a lie.
still benchmarking everything
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
consumer GPU serving economics - by kernelrunner - 10-16-2026, 02:35 PM
Re: consumer GPU serving economics - by tensorfield88 - 10-16-2026, 03:28 PM
Re: consumer GPU serving economics - by localpatch78 - 10-16-2026, 06:51 PM
Re: consumer GPU serving economics - by kernelrunner - 10-16-2026, 05:55 PM
Re: consumer GPU serving economics - by papermixer4 - 10-16-2026, 10:58 PM
Re: consumer GPU serving economics - by sparrowshed - 10-17-2026, 07:17 AM
Re: consumer GPU serving economics - by kernelmike - 10-18-2026, 07:50 AM
Re: consumer GPU serving economics - by marbletrack - 10-18-2026, 12:02 PM
Re: consumer GPU serving economics - by signalcraft14 - 10-18-2026, 05:31 PM
Re: consumer GPU serving economics - by tensorfield88 - 10-18-2026, 10:49 PM
Re: consumer GPU serving economics - by kernelmike - 10-18-2026, 09:47 PM
Re: consumer GPU serving economics - by stackarch - 10-18-2026, 09:58 PM
Re: consumer GPU serving economics - by localpatch - 10-18-2026, 11:05 PM
|
