Inference › Prompting & Context Engineering › Prompts / System Prompts v
prompt length getting silly

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
prompt length getting silly
mlxgarden Offline
Member
***
Posts: 199
Threads: 27
Joined: Sep 2026
Reputation: 0
#10
09-13-2026, 09:08 PM
I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model.
M3 Max • MLX • local-first
Find
Reply


Messages In This Thread
prompt length getting silly - by quiettoken - 09-11-2026, 02:49 AM
Re: prompt length getting silly - by cozywire - 09-13-2026, 10:16 AM
Re: prompt length getting silly - by quiettoken - 09-12-2026, 12:24 PM
Re: prompt length getting silly - by mlxgarden - 09-13-2026, 12:54 AM
Re: prompt length getting silly - by mlxgarden - 09-13-2026, 01:30 AM
Re: prompt length getting silly - by rocmplane - 09-13-2026, 03:06 PM
Re: prompt length getting silly - by batchember - 09-13-2026, 07:43 PM
Re: prompt length getting silly - by mlxgarden - 09-13-2026, 09:08 PM
Re: prompt length getting silly - by rasterhall - 09-16-2026, 09:18 PM
Re: prompt length getting silly - by mlxgarden - 09-18-2026, 06:15 PM
Re: prompt length getting silly - by localpatch - 09-19-2026, 06:25 AM
Re: prompt length getting silly - by thetafield - 09-20-2026, 06:52 AM
Re: prompt length getting silly - by quiettoken - 09-20-2026, 08:03 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)