serving on Blackwell for Phi

[cacheplane98]

subscribed, curious where this lands.

[sysstation69]

Good point. The pattern around long context has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

If you post your exact settings, people here can probably narrow it down pretty fast.

[rasterbench]

Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal.

[quiethouse]

Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal.

Thanks, that helps. The pattern around reranking has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.