|
desktop apps around local AI
|
10-12-2026, 09:14 PM
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tail latency. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
If you post your exact settings, people here can probably narrow it down pretty fast.
still benchmarking everything
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
desktop apps around local AI - by audiorunner74 - 10-11-2026, 07:16 PM
Re: desktop apps around local AI - by llmpeak - 10-12-2026, 03:50 AM
Re: desktop apps around local AI - by mlxgarden - 10-12-2026, 12:27 PM
Re: desktop apps around local AI - by cachebench - 10-13-2026, 09:17 PM
Re: desktop apps around local AI - by rocmhouse90 - 10-12-2026, 09:14 PM
Re: desktop apps around local AI - by rocmriley - 10-12-2026, 09:53 PM
Re: desktop apps around local AI - by mlxgarden - 10-13-2026, 06:18 AM
Re: desktop apps around local AI - by vectorport - 10-13-2026, 06:29 AM
Re: desktop apps around local AI - by audioriver - 10-13-2026, 07:47 AM
Re: desktop apps around local AI - by southden - 10-13-2026, 08:39 AM
Re: desktop apps around local AI - by rocmrunner40 - 10-13-2026, 09:38 PM
Re: desktop apps around local AI - by batchshed - 10-14-2026, 10:00 PM
|
