How a trade-off conversation runs
- Restate the goalthe agreed success criteria
- Show 2–3 optionseach with cost, speed, risk
- Recommend oneand what it gives up
- Owner decidesrecorded as a decision record
The trade-offs Claude architectures actually involve
Most decisions on a Claude engagement pull on the same few levers: quality of output, latency, cost per task, operational complexity, and risk (what happens when the system is wrong). Anthropic’s Building effective agents article states the core one plainly — agentic systems often trade higher latency and cost for better task performance, so you should add that complexity only when it pays for itself. Workflows (predefined code paths) are predictable and cheaper; agents (the model directing its own steps) handle open-ended problems but are harder to predict and test. That single sentence is the backbone of many stakeholder conversations.
| Decision | Option A | Option B | What the listener gives up |
|---|---|---|---|
| Workflow or agent | Fixed steps, predictable | Model chooses steps, flexible | A: handles fewer unusual cases. B: more cost, latency and testing effort |
| Model size | Largest model | Smaller, faster model | A: higher cost and latency. B: may miss the accuracy target on hard cases |
| Live or batch | Answer in seconds | Overnight batch | A: pay for real-time capacity. B: users wait for results |
| Human review | Review every output | Review only flagged ones | A: slower and staff-heavy. B: some errors reach customers |
| Build or buy | Custom integration | Off-the-shelf connector | A: time and maintenance. B: less control over behaviour |
Same decision, different audiences
The CCAR-P guide page on this site advises rehearsing the explanation, not just the decision: how you would justify a choice to a sceptical engineering lead, and separately to the person paying. The facts do not change between audiences; the vocabulary and the level of detail do. An executive needs the business consequence and the decision you need from them. An engineering lead needs the mechanism, the failure modes and what they will have to operate. A compliance officer needs where data goes and where a human decides.
One decision, two framings
To the engineering leadtext
Proposal: fixed 3-step workflow
(classify -> retrieve -> draft)
instead of an autonomous agent.
- Deterministic path, easy to
unit-test each step.
- Unusual tickets (~8% in the
sample) route to a human queue.
- Revisit if the human queue
exceeds 15% for 4 weeks.To the COOtext
Recommendation: start with a
guided workflow, not a free-
roaming agent.
- Lower running cost, faster
answers, easier to audit.
- About 1 in 12 tickets still
goes to your team.
- Decision needed: approve the
4-week pilot by 3 October.Recording the decision
A decision explained only in a meeting is forgotten in a quarter. Michael Nygard’s Architecture Decision Record (ADR) format is the widely used remedy: a short document per significant decision with a title, the context (the forces at play, written neutrally), the decision itself (“We will…”), its status, and the consequences — positive, negative and neutral. Nygard’s argument is that people joining later otherwise either accept a decision blindly or reverse it blindly, because they cannot see why it was made. Writing down the negative consequences is the part teams skip, and it is exactly the trade-off stakeholders agreed to.
ADR-007: Route product questions by complexity
Status: Accepted (2026-09-18)
Context: Answers must be >=90% correct on the 400-question
set, first token < 2 s, within the monthly budget. The
largest model alone meets accuracy but exceeds the budget.
Decision: We will answer with a smaller model by default
and route questions classified as complex to a larger model.
Consequences:
+ Meets accuracy and budget on the test set.
- Adds a classifier to build, test and monitor.
- A misrouted complex question gets a weaker answer.
= Revisit if routed-question accuracy falls below target.How to write and maintain ADRs as part of the wider documentation set is covered in 6.4; here the point is that the record captures the trade-off in the words the stakeholders approved.
Being honest about uncertainty and risk
Language models are probabilistic, and a professional architect says so without alarming anyone. Replace “it will be accurate” with “on the 300-case test set it was right 96% of the time; the errors were mostly on handwritten forms, which is why a person checks those”. State what you measured, what you have not yet measured, and what you will do if production differs. Where a platform commitment matters, quote the provider’s own terms rather than your impression — for example, the Claude API docs describe a Priority Tier with a 99.5% uptime target for organisations with existing capacity commitments, while the standard tier is best-effort. SLAs themselves are covered in 6.3.
Checking a decision summary before you send it
- Passes: States the goal in agreed success criteria
- Passes: Shows at least two real alternatives
- Missing: Names what the chosen option gives uponly benefits listed
- Check: Evidence is measured, not assertedcost figure is an estimate
- Fails: Says who decides, and by whenno owner named
- Passes: Written for this audience’s vocabulary
Traps the wrong answers are built from
| Tempting but wrong | Do this instead |
|---|---|
| Presenting a single design as the only possible answer. | Show two or three real options with their costs and risks, then recommend one. |
| Listing only the benefits of the recommended option. | State what it gives up — cost, latency, residual error, operational load — in plain words. |
| Giving executives the same technical deep-dive as engineers. | Keep the facts identical but lead with business consequence and the decision needed. |
| Backing a choice with impressions (“the big model is better”). | Measure the options against the agreed test set and report the numbers. |
| Leaving the decision in meeting notes or someone’s memory. | Record it as an ADR with context, decision, status and consequences. |
You should now be able to
- Identify the main trade-off levers in a Claude architecture: quality, latency, cost, complexity and risk.
- Present two or three options with consequences and a recommendation tied to agreed success criteria.
- Reframe the same decision for executive, engineering and compliance audiences without changing the facts.
- Capture a decision and its negative consequences in an architecture decision record.
- Communicate model uncertainty with measured results rather than guarantees.