disaggregated inference thoughts on dual 3090

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

disaggregated inference thoughts on dual 3090

stackarch Offline

Offline

Junior Member

Posts: 34
Threads: 3
Joined: Aug 2026
Reputation: 0

#2

10-08-2026, 04:54 AM

What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

disaggregated inference thoughts on dual 3090 - by prompttinker44 - 10-07-2026, 04:40 AM

Re: disaggregated inference thoughts on dual 3090 - by stackarch - 10-08-2026, 04:54 AM

Re: disaggregated inference thoughts on dual 3090 - by rocmpath - 10-09-2026, 05:28 PM

Re: disaggregated inference thoughts on dual 3090 - by kernelmike - 10-09-2026, 07:02 PM

Re: disaggregated inference thoughts on dual 3090 - by tensorfield88 - 10-09-2026, 07:49 PM

Re: disaggregated inference thoughts on dual 3090 - by sparrowghost - 10-11-2026, 08:25 AM

Re: disaggregated inference thoughts on dual 3090 - by vramport - 10-11-2026, 10:16 AM

Re: disaggregated inference thoughts on dual 3090 - by plainline - 10-11-2026, 10:56 AM

Re: disaggregated inference thoughts on dual 3090 - by kernelmike - 10-11-2026, 07:16 PM

Re: disaggregated inference thoughts on dual 3090 - by signalcraft14 - 10-13-2026, 07:46 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)