10-18-2026, 11:04 PM
Quote:Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly.
Need a little more detail here. What model, what runtime, and roughly what context size?
|
on-device inference worth the effort with llama.cpp
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
on-device inference worth the effort with llama.cpp - by marbleyard32 - 10-17-2026, 05:22 PM
Re: on-device inference worth the effort with llama.cpp - by marbleyard32 - 10-17-2026, 06:55 PM
Re: on-device inference worth the effort with llama.cpp - by cozysmith - 10-17-2026, 08:15 PM
Re: on-device inference worth the effort with llama.cpp - by sparrowghost - 10-18-2026, 04:34 AM
Re: on-device inference worth the effort with llama.cpp - by batchpeak - 10-19-2026, 03:16 AM
Re: on-device inference worth the effort with llama.cpp - by llmpeak - 10-18-2026, 06:55 AM
Re: on-device inference worth the effort with llama.cpp - by turbosupply83 - 10-18-2026, 10:09 PM
Re: on-device inference worth the effort with llama.cpp - by sparrowshed - 10-18-2026, 10:50 PM
Re: on-device inference worth the effort with llama.cpp - by cozywire - 10-18-2026, 11:04 PM
Re: on-device inference worth the effort with llama.cpp - by mangopath4 - 10-18-2026, 11:12 PM
|
Users browsing this thread: 1 Guest(s)