Inference › Harnesses, Agents & Orchestration › Routers
dataset format recommendations

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
dataset format recommendations
forgemixer Offline
Junior Member
**
Posts: 28
Threads: 5
Joined: Sep 2026
Reputation: 0
#14
10-05-2026, 07:13 PM
Quote:Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality.

I tested this tonight. On Threadripper box with MLX, I saw basically the same behavior. I expected the model choice to matter more than it did.
Find
Reply


Messages In This Thread
dataset format recommendations - by audioforge - 09-25-2026, 06:28 PM
Re: dataset format recommendations - by modbench - 09-27-2026, 09:41 PM
Re: dataset format recommendations - by phasenode - 10-01-2026, 12:57 AM
Re: dataset format recommendations - by cudapoint - 09-27-2026, 07:50 AM
Re: dataset format recommendations - by phasenode - 10-05-2026, 02:18 PM
Re: dataset format recommendations - by forgemixer - 10-05-2026, 07:13 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)