Choosing an architecture
- One well-scoped answerSingle callAdd retrieval or examples first
- Known, fixed stepsWorkflowPredictable, cheap, testable
- Steps vary by inputAgentModel picks the next tool
- Wide parallel searchManager + subagentsHighest cost, most capability
Workflow or agent: the line Anthropic draws
“Building effective agents” splits agentic systems into two kinds. In a workflow, LLM calls and tools are orchestrated through predefined code paths — your code decides what happens next. In an agent, the model dynamically directs its own process and tool use, keeping control of how the task gets done. Both use a model; the difference is who holds the steering wheel.
That single distinction answers most architecture questions. Workflows give predictability and consistency for well-defined tasks. Agents are the better option when flexibility and model-driven decision-making are needed at scale. The cost side is just as blunt: agentic systems trade latency and cost for better task performance, and agents add the risk of compounding errors — one bad step feeding the next.
Who decides the next step
Workflow — your code decides
- Steps are written down in advance
- Same input takes the same path
- Easy to unit-test and to price
- A new kind of input needs new code
Agent — the model decides
- The model chooses the next tool from context
- Handles inputs nobody anticipated
- Needs guardrails, budgets and a stopping rule
- Higher latency and token cost per task
The five workflow patterns worth naming
Before you build an agent, check whether one of the composable workflow patterns already covers the case. The exam uses their names, and each has a signature situation:
| Pattern | What it does | Reach for it when |
|---|---|---|
| Prompt chaining | Each call processes the previous call's output | The task splits into fixed subtasks and you can trade latency for accuracy |
| Routing | Classify the input, then send it to a specialised follow-up | Inputs fall into distinct categories handled better separately |
| Parallelization | Sectioning splits independent subtasks; voting runs the same task several times | You need speed, or several attempts for confidence |
| Orchestrator-workers | A central model breaks down the task, delegates, and synthesises | You cannot predict the subtasks in advance |
| Evaluator-optimizer | One call generates, another critiques, repeat | Clear criteria exist and feedback measurably improves the output |
Two of these are frequently confused. Parallelization runs subtasks you decided on when you wrote the code. Orchestrator-workers runs subtasks the orchestrator invents after seeing the input — that is the whole difference, and it is also the line between a workflow and a manager-style agent.
Manager and supervisor hierarchies
A manager (or supervisor, or lead, or orchestrator — the words are interchangeable) is an agent whose main tool is the ability to start other agents. Anthropic's research system works exactly this way: a lead agent analyses the query, forms a strategy, and spawns subagents that search different aspects in parallel; each returns findings, and the lead synthesises them. A separate citation agent then attaches sources before the answer goes out.
Lead agent with parallel subagents
- Subagent Asupplier filings
- Subagent Bnews coverage
- Subagent Cpricing data
- Citation passattach sources
The published numbers are worth carrying into the exam. Agents use roughly four times the tokens of a chat interaction, and multi-agent systems about fifteen times. Token usage alone explained about 80% of the variance in performance on the research evaluation, and a multi-agent system with Opus as lead and Sonnet as subagents outperformed a single Opus agent by 90.2% on that internal benchmark. Read those two facts together: the architecture wins because it spends more, in parallel, on tasks where spending more helps.
What subagents are actually for
A subagent is not just a second copy of the model. In the Agent SDK it is a separate agent instance with its own conversation, and it buys four specific things: context isolation (its tool calls and intermediate results stay inside it; only its final message returns to the parent), parallelization (independent subtasks finish in the time of the slowest, not the sum), specialised instructions (a system prompt full of expertise that would be noise in the main agent), and tool restriction (a reviewer given only Read, Grep and Glob cannot modify anything).
Context isolation is the one that changes designs. A subagent that reads forty files adds one summary to the parent's context, not forty files. That is why subagents appear in the documentation as a context-management technique as much as an orchestration one — the point is taken further in 1.3 and in the context-engineering objective in Domain 6.
Escalating complexity, one rung at a time
cheapest and most predictable at the top
- Single callprompt, retrieval, examples
- Workflowchaining, routing, parallelization
- Single agentmodel-driven tool loop
- Manager + subagentsparallel, isolated context
Traps the wrong answers are built from
| Tempting but wrong | Do this instead |
|---|---|
| Starting with a multi-agent design because the task sounds hard | Start at the cheapest rung and move down only when you can name what the rung above cannot do. |
| Using an agent where the inputs fall into a few known categories | Route to specialised workflows and keep the agent for the uncategorisable remainder. |
| Splitting work across subagents that need to see each other's findings | Keep dependent work in one context; parallelise only genuinely independent subtasks. |
| Delegating with a one-line brief such as “look into the supplier issue” | State the objective, the output format, the tools to use and the boundary of the subtask. |
| Treating higher token spend as a defect of multi-agent systems | Price it deliberately: the extra spend is what buys the parallel breadth, so use it where breadth pays. |
You should now be able to
- State the difference between a workflow and an agent in terms of who controls the next step.
- Name the five workflow patterns and match each to the situation it suits.
- Decide when an orchestrator or manager hierarchy is justified, and when shared context rules it out.
- Explain the four benefits subagents provide, starting with context isolation.
- Argue the latency, cost and predictability tradeoffs of each architecture to a non-specialist stakeholder.