Inference › Inference Engines › llama.cpp / GGUF v
multi-GPU offload advice

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
multi-GPU offload advice
northcraft90 Offline
Member
***
Posts: 63
Threads: 7
Joined: Sep 2026
Reputation: 0
#11
09-01-2026, 12:37 PM
Interesting, I hadn't tried that. The pattern around HBM constraints has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Find
Reply


Messages In This Thread
multi-GPU offload advice - by bytesupply76 - 08-31-2026, 04:59 AM
Re: multi-GPU offload advice - by dockridge - 08-31-2026, 05:52 AM
Re: multi-GPU offload advice - by phasescope - 08-31-2026, 06:01 AM
Re: multi-GPU offload advice - by thetagrid15 - 08-31-2026, 07:18 AM
Re: multi-GPU offload advice - by macroforge - 08-31-2026, 08:04 AM
Re: multi-GPU offload advice - by bytesupply76 - 08-31-2026, 10:50 AM
Re: multi-GPU offload advice - by embershed99 - 09-01-2026, 12:27 PM
Re: multi-GPU offload advice - by llm_wren - 08-31-2026, 11:13 AM
Re: multi-GPU offload advice - by ggufwire22 - 08-31-2026, 12:04 PM
Re: multi-GPU offload advice - by sparrowkite53 - 08-31-2026, 12:20 PM
Re: multi-GPU offload advice - by northcraft90 - 09-01-2026, 12:37 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)