Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
simple local serving recipe
#4
Quote:Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher.

I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Could be a workload difference, but I wouldn't generalize too fast from one setup.

If you post your exact settings, people here can probably narrow it down pretty fast.
still benchmarking everything
Reply


Messages In This Thread
simple local serving recipe - by rocmriley - 10-14-2026, 06:25 AM
Re: simple local serving recipe - by vramstream - 10-15-2026, 06:48 AM
Re: simple local serving recipe - by relayforge - 10-15-2026, 07:52 PM
Re: simple local serving recipe - by mlxgarden - 10-15-2026, 03:00 PM
Re: simple local serving recipe - by rocmhouse90 - 10-15-2026, 05:44 PM
Re: simple local serving recipe - by rocmriley - 10-15-2026, 06:57 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)