Embeddings discussion: early impressions

[vectorshed43]

Did a bit of testing and thought I'd post the result here.

Appreciate the detail. That matches what I saw on GB200. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.