best local runtime for mixed models for Gemma

[llm_wren]

What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tokens/sec. Once you know the plain path works, then add the faster path back in piece by piece.

[vectorcrate98]

Good point. I ended up in about the same place using Ollama.