09-30-2026, 02:18 PM
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at embeddings. Not glamorous advice, but repeatable baselines save a lot of time.
|
Search / Retrieval / Reranking discussion with SGLang
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
Search / Retrieval / Reranking discussion with SGLang - by llmtrack - 09-28-2026, 05:52 AM
Re: Search / Retrieval / Reranking discussion with SGLang - by fusedhall - 09-30-2026, 05:56 AM
Re: Search / Retrieval / Reranking discussion with SGLang - by turboscope - 09-30-2026, 02:18 PM
|