search and retrieval tuning tips for Mixtral

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

search and retrieval tuning tips for Mixtral

cacheworks Offline

Junior Member

Posts: 40
Threads: 9
Joined: Sep 2026
Reputation: 0

#10

09-02-2026, 01:59 PM

Tried to reproduce it just now. On M3 Max with MLX, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.

Find

« Next Oldest | Next Newest »

Messages In This Thread

search and retrieval tuning tips for Mixtral - by modbench - 08-30-2026, 09:03 PM

Re: search and retrieval tuning tips for Mixtral - by deltastation - 08-31-2026, 01:20 AM

Re: search and retrieval tuning tips for Mixtral - by sparrowbrook - 09-01-2026, 01:27 PM

Re: search and retrieval tuning tips for Mixtral - by quietarch - 09-02-2026, 02:27 PM

Re: search and retrieval tuning tips for Mixtral - by sanepeak48 - 09-01-2026, 01:38 PM

Re: search and retrieval tuning tips for Mixtral - by turboyard94 - 09-01-2026, 02:08 PM

Re: search and retrieval tuning tips for Mixtral - by homelabhenry - 09-01-2026, 10:43 PM

Re: search and retrieval tuning tips for Mixtral - by tensorfield88 - 09-01-2026, 11:03 PM

Re: search and retrieval tuning tips for Mixtral - by cacheworks - 09-02-2026, 01:59 PM

Re: search and retrieval tuning tips for Mixtral - by macropilot - 09-02-2026, 12:47 AM

Re: search and retrieval tuning tips for Mixtral - by sanepeak48 - 09-02-2026, 05:37 AM

Re: search and retrieval tuning tips for Mixtral - by kernelghost - 09-02-2026, 05:17 PM

Re: search and retrieval tuning tips for Mixtral - by routeforge64 - 09-03-2026, 05:17 AM

Re: search and retrieval tuning tips for Mixtral - by orbitgarden - 09-04-2026, 05:54 AM

Re: search and retrieval tuning tips for Mixtral - by cacheline - 09-04-2026, 10:20 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com