09-23-2026, 03:05 AM
Ran a quick check on my box. On mini PC with llama.cpp, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
|
SBC inference experiments: early impressions
|
|
« Next Oldest | Next Newest »
|