structured output failures with vLLM

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

structured output failures with vLLM

quantsupply Offline

Offline

Junior Member

Posts: 34
Threads: 4
Joined: Aug 2026
Reputation: 0

#12

10-19-2026, 05:25 AM

What exact setup are you running? Are you testing this on dual 3090 or something else?

small models can still be good

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

structured output failures with vLLM - by southtinker - 10-17-2026, 06:42 PM

Re: structured output failures with vLLM - by batchpeak - 10-17-2026, 10:53 PM

Re: structured output failures with vLLM - by sparrowhall - 10-18-2026, 04:51 PM

Re: structured output failures with vLLM - by cudapoint - 10-18-2026, 05:08 PM

Re: structured output failures with vLLM - by embershed99 - 10-18-2026, 09:09 PM

Re: structured output failures with vLLM - by mangovault67 - 10-19-2026, 01:29 AM

Re: structured output failures with vLLM - by macrotinker - 10-19-2026, 01:59 AM

Re: structured output failures with vLLM - by turboarch95 - 10-19-2026, 02:29 AM

Re: structured output failures with vLLM - by batchsize - 10-19-2026, 02:30 AM

Re: structured output failures with vLLM - by vramghost - 10-19-2026, 04:02 AM

Re: structured output failures with vLLM - by vramport - 10-19-2026, 04:23 AM

Re: structured output failures with vLLM - by quantsupply - 10-19-2026, 05:25 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)