Inference › Inference Engines › llama.cpp / GGUF v
multi-GPU offload advice

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Threaded Mode
multi-GPU offload advice
northcraft90 Offline
Member
***
Posts: 63
Threads: 7
Joined: Sep 2026
Reputation: 0
#11
09-01-2026, 12:37 PM
Interesting, I hadn't tried that. The pattern around HBM constraints has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Find
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)