Inference › Inference Engines › TensorRT-LLM v
serving on Blackwell for Phi

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
serving on Blackwell for Phi
sysstation69 Offline
Junior Member
**
Posts: 32
Threads: 1
Joined: Sep 2026
Reputation: 0
#12
10-18-2026, 11:18 PM
Good point. The pattern around long context has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

If you post your exact settings, people here can probably narrow it down pretty fast.
Find
Reply


Messages In This Thread
serving on Blackwell for Phi - by pixelcrate82 - 10-16-2026, 05:35 AM
Re: serving on Blackwell for Phi - by macrotinker - 10-16-2026, 02:08 PM
Re: serving on Blackwell for Phi - by sysstation69 - 10-18-2026, 11:18 PM
Re: serving on Blackwell for Phi - by kernelpeak - 10-18-2026, 04:42 PM
Re: serving on Blackwell for Phi - by rasterbench - 10-19-2026, 01:32 AM
Re: serving on Blackwell for Phi - by kernelgrid - 10-18-2026, 06:43 PM
Re: serving on Blackwell for Phi - by routecrate - 10-18-2026, 09:04 PM
Re: serving on Blackwell for Phi - by rocmmixer - 10-18-2026, 09:13 PM
Re: serving on Blackwell for Phi - by quiethouse - 10-19-2026, 02:21 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)