09-18-2026, 12:38 AM
Ran a quick check on my box. On B200 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did. At this point the real bottleneck is my patience.
|
batching changes after update
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
batching changes after update - by audioriver - 09-17-2026, 12:15 AM
Re: batching changes after update - by amberkite - 09-18-2026, 12:38 AM
Re: batching changes after update - by latentgarden - 09-18-2026, 08:44 AM
Re: batching changes after update - by kernelmike - 09-21-2026, 08:58 AM
Re: batching changes after update - by amberpatch25 - 09-24-2026, 09:46 AM
Re: batching changes after update - by cobaltspark - 09-24-2026, 11:55 AM
Re: batching changes after update - by mangohouse - 09-24-2026, 02:15 PM
Re: batching changes after update - by dockember - 09-24-2026, 03:10 PM
Re: batching changes after update - by orbitbench6 - 09-25-2026, 03:28 PM
Re: batching changes after update - by latentgarden - 09-25-2026, 11:32 PM
Re: batching changes after update - by thetapath - 09-26-2026, 07:38 AM
Re: batching changes after update - by latentgarden - 09-27-2026, 07:42 AM
|
Users browsing this thread: 1 Guest(s)