09-06-2026, 02:45 AM
Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.
|
on-device inference worth the effort: what are you seeing?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
on-device inference worth the effort: what are you seeing? - by torchdesk - 09-06-2026, 12:42 AM
Re: on-device inference worth the effort: what are you seeing? - by routeline23 - 09-06-2026, 01:45 AM
Re: on-device inference worth the effort: what are you seeing? - by plainscope50 - 09-06-2026, 11:06 AM
Re: on-device inference worth the effort: what are you seeing? - by sparrowghost - 09-06-2026, 02:45 AM
Re: on-device inference worth the effort: what are you seeing? - by fusedriver - 09-06-2026, 12:00 PM
Re: on-device inference worth the effort: what are you seeing? - by mellowwire98 - 09-06-2026, 08:50 PM
Re: on-device inference worth the effort: what are you seeing? - by batchpeak - 09-06-2026, 09:08 PM
|
Users browsing this thread: 1 Guest(s)