clean API wrappers for local agents for Llama

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

clean API wrappers for local agents for Llama

mlxgarden Offline

Offline

Member

Posts: 199
Threads: 27
Joined: Sep 2026
Reputation: 0

#2

10-10-2026, 04:28 AM

Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher.

M3 Max • MLX • local-first

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

clean API wrappers for local agents for Llama - by cobalttinker - 10-10-2026, 04:03 AM

Re: clean API wrappers for local agents for Llama - by mlxgarden - 10-10-2026, 04:28 AM

Re: clean API wrappers for local agents for Llama - by kernelhouse70 - 10-11-2026, 04:34 AM

Re: clean API wrappers for local agents for Llama - by torchkite - 10-11-2026, 05:38 AM

Re: clean API wrappers for local agents for Llama - by rocmrunner40 - 10-12-2026, 08:18 AM

Re: clean API wrappers for local agents for Llama - by oxiderunner - 10-12-2026, 03:20 PM

Re: clean API wrappers for local agents for Llama - by mlxgarden - 10-11-2026, 07:52 AM

Re: clean API wrappers for local agents for Llama - by southpatch - 10-12-2026, 12:49 PM

Re: clean API wrappers for local agents for Llama - by rocmstack25 - 10-12-2026, 01:41 PM

Re: clean API wrappers for local agents for Llama - by phaseport36 - 10-12-2026, 02:53 PM

Re: clean API wrappers for local agents for Llama - by sparrowgrid - 10-12-2026, 11:39 PM

Re: clean API wrappers for local agents for Llama - by oxiderunner - 10-14-2026, 12:14 PM

Re: clean API wrappers for local agents for Llama - by cobaltspark - 10-14-2026, 01:05 PM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)