how much orchestration is too much: early impressions
|
how much orchestration is too much: early impressions
|
10-06-2026, 01:06 AM
Quote:[quote]What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at token cost. A Tried to reproduce it just now. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality. |
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
how much orchestration is too much: early impressions - by llm_wren - 10-04-2026, 08:30 PM
Re: how much orchestration is too much: early impressions - by llm_wren - 10-04-2026, 09:49 PM
Re: how much orchestration is too much: early impressions - by southden - 10-05-2026, 12:33 AM
Re: how much orchestration is too much: early impressions - by quiethouse - 10-06-2026, 01:06 AM
Re: how much orchestration is too much: early impressions - by labline - 10-07-2026, 01:46 AM
Re: how much orchestration is too much: early impressions - by northgrid33 - 10-07-2026, 03:50 AM
Re: how much orchestration is too much: early impressions - by macronest - 10-07-2026, 06:27 AM
|
