|
Vector Databases discussion
|
09-15-2026, 09:43 AM
What worked for me was pretty simple. If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
I'm happy to test one more variant if you want a second data point.
context windows are not a product strategy
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
Vector Databases discussion - by macroforge - 09-15-2026, 01:14 AM
Re: Vector Databases discussion - by routeforge64 - 09-15-2026, 05:30 AM
Re: Vector Databases discussion - by tinycontext - 09-15-2026, 09:43 AM
Re: Vector Databases discussion - by orbitbench6 - 09-15-2026, 02:02 PM
Re: Vector Databases discussion - by emberquill - 09-16-2026, 02:06 AM
Re: Vector Databases discussion - by macronest - 09-16-2026, 02:57 AM
Re: Vector Databases discussion - by tinycontext - 09-17-2026, 03:25 PM
Re: Vector Databases discussion - by relayforge - 09-17-2026, 03:42 PM
Re: Vector Databases discussion - by vectorshed43 - 09-18-2026, 04:13 PM
Re: Vector Databases discussion - by byteyard - 09-18-2026, 04:40 PM
|
