Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
NVIDIA driver regression with vLLM
#1
Spent some time on this today and wanted to compare notes.

Two paths both seem viable, but they break down differently once prefix caching becomes important.

Trying to avoid rebuilding the whole thing twice.
Reply


Messages In This Thread
NVIDIA driver regression with vLLM - by audiopath66 - 10-05-2026, 04:17 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)