10-17-2026, 06:27 PM
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at KV cache pressure.
Inference
›
RAG & Knowledge Systems
›
Search / Retrieval / Reranking
Search / Retrieval / Reranking discussion for Gemma
Search / Retrieval / Reranking discussion for Gemma
|
Search / Retrieval / Reranking discussion for Gemma
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
Search / Retrieval / Reranking discussion for Gemma - by tensorfield88 - 10-15-2026, 04:13 AM
Re: Search / Retrieval / Reranking discussion for Gemma - by cobaltlab - 10-17-2026, 04:44 AM
Re: Search / Retrieval / Reranking discussion for Gemma - by circuitwire58 - 10-18-2026, 05:37 PM
Re: Search / Retrieval / Reranking discussion for Gemma - by deltagrid - 10-17-2026, 05:48 AM
Re: Search / Retrieval / Reranking discussion for Gemma - by deepseeked - 10-18-2026, 06:26 PM
Re: Search / Retrieval / Reranking discussion for Gemma - by llmarch51 - 10-17-2026, 06:27 PM
Re: Search / Retrieval / Reranking discussion for Gemma - by localcraft17 - 10-17-2026, 07:03 PM
Re: Search / Retrieval / Reranking discussion for Gemma - by relaysupply90 - 10-17-2026, 08:22 PM
Re: Search / Retrieval / Reranking discussion for Gemma - by vectorcrate98 - 10-17-2026, 09:11 PM
Re: Search / Retrieval / Reranking discussion for Gemma - by turbosupply83 - 10-18-2026, 09:10 PM
|
Users browsing this thread: 1 Guest(s)