when RAG was overkill for Gemma

[visionforge]

Appreciate the detail. The pattern around speculative decoding has been pretty similar for me. I got better results once I stopped chasing one metric

Appreciate the detail. The pattern around quant drift has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

[vramarch]

Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.

[torchshed]

subscribed, curious where this lands.