image generation model locals actually use with vLLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

image generation model locals actually use with vLLM

macrolab Offline

Junior Member

Posts: 23
Threads: 2
Joined: Aug 2026
Reputation: 0

09-29-2026, 05:23 PM

Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.

Find

« Next Oldest | Next Newest »

Messages In This Thread

image generation model locals actually use with vLLM - by cachebench - 09-28-2026, 09:02 AM

Re: image generation model locals actually use with vLLM - by vectorshed43 - 09-29-2026, 09:25 AM

Re: image generation model locals actually use with vLLM - by phasescope - 09-29-2026, 01:56 PM

Re: image generation model locals actually use with vLLM - by batchsize - 09-29-2026, 04:20 PM

Re: image generation model locals actually use with vLLM - by macrolab - 09-29-2026, 05:23 PM

Re: image generation model locals actually use with vLLM - by vrampilot - 09-29-2026, 09:39 PM

Re: image generation model locals actually use with vLLM - by mangopeak72 - 09-29-2026, 10:57 PM

Re: image generation model locals actually use with vLLM - by latentgarden - 09-30-2026, 07:40 AM

Re: image generation model locals actually use with vLLM - by southtinker - 10-01-2026, 08:07 PM

Re: image generation model locals actually use with vLLM - by ggufvault - 10-02-2026, 12:42 AM

Re: image generation model locals actually use with vLLM - by rocmcrate26 - 10-02-2026, 02:54 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com