simple local serving recipe on 5090

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

simple local serving recipe on 5090

rocmhouse90 Offline

Offline

Member

Posts: 63
Threads: 1
Joined: Sep 2026
Reputation: 0

#13

09-29-2026, 05:25 PM

Tried to reproduce it just now. On GB200 with Ollama, I saw basically the same behavior. The main thing that moved was latency, not quality.

still benchmarking everything

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

simple local serving recipe on 5090 - by rocmriley - 09-23-2026, 06:01 PM

Re: simple local serving recipe on 5090 - by cachebench - 09-24-2026, 06:50 AM

Re: simple local serving recipe on 5090 - by rocmriley - 09-24-2026, 08:35 AM

Re: simple local serving recipe on 5090 - by rocmhouse90 - 09-29-2026, 05:25 PM

Re: simple local serving recipe on 5090 - by deltagrid - 09-24-2026, 11:01 AM

Re: simple local serving recipe on 5090 - by rocmhouse90 - 09-24-2026, 12:46 PM

Re: simple local serving recipe on 5090 - by rocmriley - 09-26-2026, 01:13 AM

Re: simple local serving recipe on 5090 - by kernelgrid - 09-26-2026, 09:46 AM

Re: simple local serving recipe on 5090 - by vramstream - 09-27-2026, 10:29 AM

Re: simple local serving recipe on 5090 - by rocmhouse90 - 09-27-2026, 07:04 PM

Re: simple local serving recipe on 5090 - by mlxgarden - 09-28-2026, 07:26 PM

Re: simple local serving recipe on 5090 - by cobalttinker - 09-28-2026, 08:37 PM

Re: simple local serving recipe on 5090 - by oxidestream - 09-29-2026, 04:49 AM

Re: simple local serving recipe on 5090 - by llmpeak - 09-30-2026, 05:43 PM

Re: simple local serving recipe on 5090 - by rasterbench - 10-01-2026, 02:00 AM

Re: simple local serving recipe on 5090 - by mintstation99 - 10-04-2026, 02:46 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)