SBC inference experiments: early impressions

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

SBC inference experiments: early impressions

quantsupply Offline

Offline

Junior Member

Posts: 34
Threads: 4
Joined: Aug 2026
Reputation: 0

#6

09-29-2026, 05:01 PM

Appreciate the detail. The pattern around continuous batching has been pretty similar for me.

small models can still be good

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

SBC inference experiments: early impressions - by homelabhenry - 09-22-2026, 02:44 AM

Re: SBC inference experiments: early impressions - by batchfield55 - 09-23-2026, 03:05 AM

Re: SBC inference experiments: early impressions - by byteyard - 09-26-2026, 03:29 AM

Re: SBC inference experiments: early impressions - by vramghost - 09-29-2026, 03:38 AM

Re: SBC inference experiments: early impressions - by homelabhenry - 09-29-2026, 04:03 PM

Re: SBC inference experiments: early impressions - by promptfield - 10-05-2026, 08:00 AM

Re: SBC inference experiments: early impressions - by quantsupply - 09-29-2026, 05:01 PM

Re: SBC inference experiments: early impressions - by phasespark - 09-29-2026, 06:02 PM

Re: SBC inference experiments: early impressions - by sparrowworks88 - 10-01-2026, 06:12 AM

Re: SBC inference experiments: early impressions - by promptfield - 10-04-2026, 06:42 AM

Re: SBC inference experiments: early impressions - by lablab - 10-04-2026, 07:30 PM

Re: SBC inference experiments: early impressions - by homelabhenry - 10-04-2026, 07:57 PM

Re: SBC inference experiments: early impressions - by cobalttinker - 10-04-2026, 08:36 PM

Re: SBC inference experiments: early impressions - by homelabhenry - 10-04-2026, 09:44 PM

Re: SBC inference experiments: early impressions - by quantsupply - 10-05-2026, 06:12 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)