|
dual GPU split inference
|
09-19-2026, 01:30 AM
Quote:Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pr My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Llama and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. |
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
dual GPU split inference - by rocmriley - 09-10-2026, 03:00 AM
Re: dual GPU split inference - by batchwire - 09-10-2026, 04:26 AM
Re: dual GPU split inference - by minthall - 09-11-2026, 04:44 PM
Re: dual GPU split inference - by turboyard94 - 09-19-2026, 01:30 AM
Re: dual GPU split inference - by batchember - 09-11-2026, 05:28 PM
Re: dual GPU split inference - by cacheline - 09-13-2026, 05:45 AM
Re: dual GPU split inference - by cudapoint - 09-16-2026, 05:50 AM
Re: dual GPU split inference - by signaltrack44 - 09-17-2026, 06:41 AM
Re: dual GPU split inference - by thetarunner - 09-17-2026, 10:46 AM
Re: dual GPU split inference - by sanepeak48 - 09-17-2026, 11:05 AM
Re: dual GPU split inference - by sanevault - 09-17-2026, 12:12 PM
Re: dual GPU split inference - by phaseport36 - 09-17-2026, 12:57 PM
|
