Inference › LLM Models › Open Weight › Recipes & Configurations v
simple router policy ideas

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
simple router policy ideas
paperport64 Offline
Junior Member
**
Posts: 39
Threads: 1
Joined: Sep 2026
Reputation: 0
#14
10-03-2026, 10:47 PM
Quote:I don't think that's the whole story. I get why that seems right, but on 4090 the bottleneck felt elsewhere.

A couple questions before I guess too hard. Do you see the same thing with a smaller batch or shorter prompt?
learning in public
Find
Reply


Messages In This Thread
simple router policy ideas - by kernelgrid - 09-18-2026, 12:52 AM
Re: simple router policy ideas - by sparrowcraft - 09-18-2026, 05:33 AM
Re: simple router policy ideas - by quantghost - 09-18-2026, 06:14 AM
Re: simple router policy ideas - by cacheline - 09-21-2026, 06:15 AM
Re: simple router policy ideas - by modgarden - 09-21-2026, 08:49 AM
Re: simple router policy ideas - by torchkite - 09-24-2026, 08:59 AM
Re: simple router policy ideas - by oxidestream - 09-27-2026, 09:25 AM
Re: simple router policy ideas - by fusedhall56 - 09-27-2026, 11:10 AM
Re: simple router policy ideas - by kernelrunner - 09-27-2026, 01:55 PM
Re: simple router policy ideas - by embershed99 - 09-30-2026, 02:21 PM
Re: simple router policy ideas - by phasetrack - 09-30-2026, 07:01 PM
Re: simple router policy ideas - by griffinloom66 - 09-30-2026, 09:42 PM
Re: simple router policy ideas - by quantsupply - 09-30-2026, 10:01 PM
Re: simple router policy ideas - by paperport64 - 10-03-2026, 10:47 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)