09-14-2026, 04:06 PM
What exact setup are you running? What model, what runtime, and roughly what context size?
throughput matters, but tail latency matters too
|
what made local AI click for you
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
what made local AI click for you - by rocmrunner40 - 09-12-2026, 01:27 AM
Re: what made local AI click for you - by rocmplane - 09-14-2026, 02:12 AM
Re: what made local AI click for you - by audiorunner74 - 09-14-2026, 02:14 PM
Re: what made local AI click for you - by ggufwire22 - 09-14-2026, 03:08 PM
Re: what made local AI click for you - by batchsize - 09-14-2026, 04:06 PM
Re: what made local AI click for you - by tensorkite - 09-14-2026, 08:39 PM
Re: what made local AI click for you - by rocmplane - 09-14-2026, 09:04 PM
Re: what made local AI click for you - by quiettoken - 09-14-2026, 09:35 PM
Re: what made local AI click for you - by vectorshed43 - 09-17-2026, 10:13 PM
Re: what made local AI click for you - by tensorkite - 09-18-2026, 07:03 AM
|
Users browsing this thread: 1 Guest(s)