simple local serving recipe: setup advice

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

simple local serving recipe: setup advice

cacheline Offline

Offline

Senior Member

Posts: 341
Threads: 51
Joined: Sep 2026
Reputation: 0

#2

09-12-2026, 05:16 AM

Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?

measure twice, benchmark three times

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

simple local serving recipe: setup advice - by mlxgarden - 09-10-2026, 05:12 AM

Re: simple local serving recipe: setup advice - by cacheline - 09-12-2026, 05:16 AM

Re: simple local serving recipe: setup advice - by cachebench - 09-12-2026, 11:41 AM

Re: simple local serving recipe: setup advice - by audioriver - 09-18-2026, 10:28 PM

Re: simple local serving recipe: setup advice - by llmpeak - 09-12-2026, 07:56 AM

Re: simple local serving recipe: setup advice - by vramstream - 09-12-2026, 08:55 AM

Re: simple local serving recipe: setup advice - by rasterbench - 09-14-2026, 08:57 AM

Re: simple local serving recipe: setup advice - by rocmriley - 09-14-2026, 12:20 AM

Re: simple local serving recipe: setup advice - by mintstation99 - 09-14-2026, 09:35 AM

Re: simple local serving recipe: setup advice - by rocmriley - 09-17-2026, 09:42 AM

Re: simple local serving recipe: setup advice - by batchshed - 09-18-2026, 10:55 PM

Re: simple local serving recipe: setup advice - by modgarden - 09-19-2026, 01:40 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)