08-21-2026, 01:31 PM
Thought I'd post a small recipe because a lot of threads ask similar things.
Maybe useful as a starting point: vLLM on 4090, keeping token cost in mind from the start.
Maybe useful as a starting point for newer folks.
Maybe useful as a starting point: vLLM on 4090, keeping token cost in mind from the start.
Maybe useful as a starting point for newer folks.
learning in public