|
Embeddings discussion
|
09-30-2026, 02:45 PM
Quote:I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at small local stacks. Not Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed. |
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
Embeddings discussion - by torchdesk - 09-30-2026, 02:50 AM
Re: Embeddings discussion - by routearch - 09-30-2026, 03:53 AM
Re: Embeddings discussion - by ggufwire22 - 09-30-2026, 06:22 AM
Re: Embeddings discussion - by edgecoast - 09-30-2026, 02:45 PM
Re: Embeddings discussion - by torchdesk - 10-03-2026, 03:03 PM
Re: Embeddings discussion - by vectorshed43 - 10-03-2026, 03:57 PM
Re: Embeddings discussion - by quantnest - 10-03-2026, 04:46 PM
Re: Embeddings discussion - by rasterhall - 10-06-2026, 10:36 PM
Re: Embeddings discussion - by vectorshed43 - 10-06-2026, 05:24 PM
Re: Embeddings discussion - by vramscope - 10-06-2026, 06:00 PM
Re: Embeddings discussion - by quantnest - 10-06-2026, 06:33 PM
Re: Embeddings discussion - by ggufwire22 - 10-06-2026, 11:11 PM
Re: Embeddings discussion - by paperport64 - 10-09-2026, 11:12 PM
|
