|
desktop apps around local AI with llama.cpp
|
10-18-2026, 02:23 AM
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at quant drift. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
I'm happy to test one more variant if you want a second data point.
learning in public
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
desktop apps around local AI with llama.cpp - by vramstream - 10-17-2026, 04:22 AM
Re: desktop apps around local AI with llama.cpp - by torchshed66 - 10-17-2026, 05:36 AM
Re: desktop apps around local AI with llama.cpp - by mlxgarden - 10-17-2026, 02:26 PM
Re: desktop apps around local AI with llama.cpp - by vectorport - 10-17-2026, 03:33 PM
Re: desktop apps around local AI with llama.cpp - by batchshed - 10-17-2026, 03:48 PM
Re: desktop apps around local AI with llama.cpp - by rocmhouse90 - 10-18-2026, 10:25 PM
Re: desktop apps around local AI with llama.cpp - by mlxgarden - 10-19-2026, 04:09 AM
Re: desktop apps around local AI with llama.cpp - by mlxgarden - 10-18-2026, 12:08 AM
Re: desktop apps around local AI with llama.cpp - by mintstation99 - 10-18-2026, 02:23 AM
Re: desktop apps around local AI with llama.cpp - by modgarden - 10-18-2026, 03:56 AM
Re: desktop apps around local AI with llama.cpp - by audionode8 - 10-18-2026, 06:22 PM
|
