Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Used A6000 worth it now
#1
Did a bit of testing and thought I'd post the result here.

Short version: vLLM behaved well for me, but only after I stopped ignoring structured output.

Curious if anyone else landed in the same place.

My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
VRAM first, aesthetics later
Reply


Messages In This Thread
Used A6000 worth it now - by embersmith - 10-09-2026, 02:32 PM
Re: Used A6000 worth it now - by rocmriley - 10-10-2026, 03:12 AM
Re: Used A6000 worth it now - by batchember - 10-10-2026, 04:44 AM
Re: Used A6000 worth it now - by vrambandit - 10-13-2026, 05:35 AM
Re: Used A6000 worth it now - by turboyard94 - 10-13-2026, 06:49 AM
Re: Used A6000 worth it now - by dockkite69 - 10-13-2026, 08:03 AM
Re: Used A6000 worth it now - by vrambandit - 10-17-2026, 09:10 PM
Re: Used A6000 worth it now - by rocmriley - 10-13-2026, 08:19 AM
Re: Used A6000 worth it now - by amberrunner - 10-14-2026, 08:46 PM
Re: Used A6000 worth it now - by rocmriley - 10-18-2026, 01:44 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)