+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Prompts / System Prompts (https://www.datasculpting.ai/inference/forumdisplay.php?fid=62)
+--- Thread: system prompt habits that helped on M3 Max (/showthread.php?tid=424)
Pages:
1
2
Re: system prompt habits that helped on M3 Max - quantyard - 09-28-2026
Can you fill in a bit more context? Is this local-only or are you routing anything externally?
Re: system prompt habits that helped on M3 Max - cozywire - 09-28-2026
Appreciate the detail. The pattern around prefix caching has been pretty similar for me.
Re: system prompt habits that helped on M3 Max - promptspark58 - 09-29-2026
following this because I'm in the same boat.
Re: system prompt habits that helped on M3 Max - quiettoken - 09-29-2026
My first guess would be this: If you're on TensorRT-LLM, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: system prompt habits that helped on M3 Max - thetafield - 09-29-2026
My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tokens/sec. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: system prompt habits that helped on M3 Max - thetarunner - 10-01-2026
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at continuous batching. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.