Inference › Hardware › GPUs v
dual GPU split inference

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
dual GPU split inference
batchember Offline
Junior Member
**
Posts: 44
Threads: 3
Joined: Oct 2026
Reputation: 0
#4
09-11-2026, 05:28 PM
Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?
small models can still be good
Find
Reply


Messages In This Thread
dual GPU split inference - by rocmriley - 09-10-2026, 03:00 AM
Re: dual GPU split inference - by batchwire - 09-10-2026, 04:26 AM
Re: dual GPU split inference - by minthall - 09-11-2026, 04:44 PM
Re: dual GPU split inference - by turboyard94 - 09-19-2026, 01:30 AM
Re: dual GPU split inference - by batchember - 09-11-2026, 05:28 PM
Re: dual GPU split inference - by cacheline - 09-13-2026, 05:45 AM
Re: dual GPU split inference - by cudapoint - 09-16-2026, 05:50 AM
Re: dual GPU split inference - by signaltrack44 - 09-17-2026, 06:41 AM
Re: dual GPU split inference - by thetarunner - 09-17-2026, 10:46 AM
Re: dual GPU split inference - by sanepeak48 - 09-17-2026, 11:05 AM
Re: dual GPU split inference - by sanevault - 09-17-2026, 12:12 PM
Re: dual GPU split inference - by phaseport36 - 09-17-2026, 12:57 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)