What is agent orchestration, and why does it beat a menu of bots?
There is a design flaw sitting in the middle of most "AI teammate" products, and it took us building one to see it clearly: a roster of specialists is only useful if you already know which specialist you need.
The problem with a menu
If your product offers a sales agent, a support agent and a scheduling agent, you have quietly made the customer do triage. Before they can ask for anything, they have to classify their own request. Is "can you chase the invoice for the job we booked last week" a sales question, an accounts question, or a scheduling one?
It is all three, and none of them, and the honest answer is that the customer should not have to care. In a real company you would ask one person and they would sort it out. That is the standard the software should meet.
What orchestration actually means
Orchestration means there is one entry point that owns the outcome. You make a request; it decides who should do the work, hands them a scoped brief, keeps hold of the thread, and comes back to you with the result. The specialists still exist and still do the work — they just stop being a decision you have to make.
In our case the orchestrator is called Sage, and the design has four properties that matter:
- She owns the outcome. You are never transferred and never asked to go and talk to someone else.
- She delegates with a scoped brief — the specific ask plus only the context that specialist needs, not a dump of the whole conversation.
- Specialists work for her and never for each other. Everything goes through the centre, because a mesh of agents talking to agents is impossible to debug when it goes wrong.
- Named agents are narration, not destinations. "Mark's picking up the creative" tells you what is happening; it is not an instruction to go and message Mark.
Why the star shape, specifically
The temptation when building multi-agent systems is to let agents call each other directly. It looks elegant on a whiteboard and it is miserable in production: when the output is wrong, you cannot tell which hop introduced the error, and failures cascade in ways nobody predicted.
A star topology — everything through one orchestrator — costs you a little theoretical efficiency and buys you the ability to answer "why did it do that?" That trade is worth making every time, especially in a system that spends money and messages real customers.
Where it still needs a human
Orchestration decides who does the work. It does not decide whether the work should happen at all when the work is consequential. Anything that spends money or contacts a customer still passes through a policy check and, depending on your settings, waits for you. The orchestrator makes the system usable; the approval layer makes it safe. They are different problems and they need different solutions.