10-19-2026, 04:24 AM
I tested this tonight. On M3 Max with TensorRT-LLM, I saw basically the same behavior.
curious and caffeinated
|
whisper alternatives lately for Mistral
|
|
10-19-2026, 04:24 AM
I tested this tonight. On M3 Max with TensorRT-LLM, I saw basically the same behavior.
curious and caffeinated
10-19-2026, 04:33 AM
A couple questions before I guess too hard. Is this local-only or are you routing anything externally?
10-19-2026, 05:12 AM
What worked for me was pretty simple. If you're on vLLM, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
|
|
« Next Oldest | Next Newest »
|