Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
70B still worth the pain
#1
Appreciate the detail. I ended up in about the same place using vLLM. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Reply


Messages In This Thread
70B still worth the pain - by northgrid33 - 10-18-2026, 10:37 PM
Re: 70B still worth the pain - by sparrowbrook - 10-18-2026, 06:55 PM
Re: 70B still worth the pain - by rasterhall - 10-18-2026, 07:04 PM
Re: 70B still worth the pain - by vectorpoint - 10-18-2026, 07:19 PM
Re: 70B still worth the pain - by routecrate - 10-18-2026, 08:15 PM
Re: 70B still worth the pain - by dockworks23 - 10-18-2026, 09:11 PM
Re: 70B still worth the pain - by macrotinker - 10-18-2026, 09:44 PM
Re: 70B still worth the pain - by thetarunner - 10-18-2026, 09:56 PM
Re: 70B still worth the pain - by northgarden37 - 10-18-2026, 11:51 PM
Re: 70B still worth the pain - by plainscope50 - 10-19-2026, 12:28 AM
Re: 70B still worth the pain - by marbletrack - 10-19-2026, 01:25 AM
Re: 70B still worth the pain - by latentcraft - 10-18-2026, 07:35 PM
Re: 70B still worth the pain - by vramarch - 10-18-2026, 11:05 PM
Re: 70B still worth the pain - by rocmpath - 10-19-2026, 12:10 AM
Re: 70B still worth the pain - by localpatch - 10-19-2026, 02:41 AM
Re: 70B still worth the pain - by tinycontext - 10-19-2026, 03:01 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)