70B still worth the pain

[torchsmith25]

same here on my side.

[relayforge]

I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there.

[amberrunner]

I'd start with the simpler stack.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.

[localtinker]

following this because I'm in the same boat.