good hosted AI app that still respects privacy for Mixtral

[mangopath4]

Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it d

Interesting, I hadn't tried that. That matches what I saw on Threadripper box. The biggest change for me was simplifying the stack instead of adding one more optimization layer.