Rubric
Contents — domains, guide and mocks

Structured discovery and requirements

CCAR-P 6.110 min read · checked 21 September 2026

Task statementConduct structured discovery and requirement gathering

Structured discovery, end to end

  1. Frame the problembusiness outcome, not “use AI”
  2. Map stakeholderssponsor, users, IT, risk, legal
  3. Gather requirementsworkflow, data, constraints
  4. Agree success criteriaspecific, measurable, signed

Open questions or conflicts → go back and ask before designing

Each step produces something written down. Discovery ends with success criteria the client has signed — not with a demo.

Start from the problem, not the product

Clients usually arrive with a solution already in mind: “we want a chatbot”, “we want an agent that reads every contract”. Structured discovery politely sets that aside and asks what outcome the business needs. Is the claims team too slow? Are errors costing money? Is a regulator asking for consistency? The answer changes the architecture. A slow team might need a simple summarisation step inside an existing tool; an error problem might need extraction with human review; a consistency problem might need a fixed workflow rather than an open-ended agent.

Anthropic’s own guidance on agents makes the same point from the engineering side: start with the simplest thing that could work, and only add agentic complexity when simpler approaches demonstrably fall short, because agents trade extra latency and cost for better performance on open-ended tasks. You cannot make that call without knowing the task — which is what discovery is for.

The client saysDiscovery questionWhat it tells you
“We want a chatbot for customers.”Which questions arrive today, how many, and which ones cost the most to answer?Scope, volume and where the value really is
“It must be accurate.”Accurate at what? What happens when it is wrong, and who notices?The error that matters and the review step it needs
“It should be fast.”Fast for whom — an agent on a live call, or an overnight report?Latency target, and whether batch processing is acceptable
“Use all our documents.”Which systems hold them, who owns them, and what may leave the building?Data sources, access rights and residency limits

Who to talk to

A single enthusiastic sponsor is not a requirements source. Each group sees a different slice of the problem, and the one you skip is the one that blocks go-live. The sponsor owns the outcome and the budget. Frontline users know the real workflow, including the workarounds nobody wrote down. IT owns the systems you must integrate with and the identity provider. Risk, compliance and legal own the rules — data handling, retention, what must have a human decision. Security will review how data flows to the model. Operations will run it after you leave.

Stakeholders around one engagement

Discoveryone shared requirements log
  • Sponsoroutcome, budget, deadline
  • Frontline usersreal workflow, edge cases
  • IT / platformsystems, identity, hosting
  • Risk & legaldata rules, human sign-off
  • Securitydata flows, access review
  • Operationswho runs it after launch
Each spoke owns requirements the others cannot give you. Missing one usually surfaces late, as a blocker.

Turning wishes into testable requirements

Anthropic’s documentation on evaluation says good success criteria are specific, measurable, achievable and relevant. “Safe outputs” is a wish; “fewer than 0.1% of 10,000 test outputs flagged by the content filter” is a criterion. The same docs list the dimensions most use cases care about — task fidelity, consistency, relevance and coherence, tone and style, privacy preservation, context utilisation, latency and price — and stress that most projects need several at once. Walk the client through that list; it is a fast way to surface requirements they had not thought to state.

From wish to requirement

What the sponsor wrotetext

Goal: AI assistant for claims.
Must be accurate and fast.
Should use our data.
Needs to be secure.
Launch next quarter.

After discoverytext

Task: extract 14 fields from
  FNOL emails + PDFs to a draft.
Accuracy: >=95% per field on
  300 labelled claims (owner:
  claims QA lead).
Latency: draft ready < 60 s.
Human: handler confirms every
  draft; no fraud/payout calls.
Data: approved region only;
  no training on client data.
Pilot: 4 weeks, 12 handlers.
The right-hand version can be tested, priced and signed. Every line names a number, a data set or an owner.

Separate functional requirements (what the system does) from non-functional ones (how well, how fast, under what rules). Non-functional requirements are the ones clients forget and architects get blamed for: peak volume, latency, availability, cost ceiling, data residency, audit logging, accessibility. Also record what is explicitly out of scope — it protects both sides when the pilot succeeds and the wish list grows.

A discovery question bank (reuse per engagement)text
OUTCOME   What decision or task gets better? How is it measured today?
USERS     Who uses it, how often, on what device, in what language?
WORKFLOW  Walk me through the last real case, step by step.
DATA      Where does input live? Who owns it? What may not leave?
ERRORS    What does a bad answer cost? Who catches it today?
HUMAN     Which decisions must stay with a person?
VOLUME    Requests per day, peak hour, growth next year?
LATENCY   Live (seconds) or offline (hours)?
BUDGET    Cost ceiling per task or per month?
SUCCESS   What number, on what test set, means "go"?
OUT       What are we deliberately not doing in phase one?

Handling conflict and ambiguity

Stakeholders disagree, and discovery is where you find out. The sponsor wants full automation; compliance wants a human on every decision. Do not resolve it by quietly picking a side in the design. Write the conflict down, show the options with their consequences, and get the person who owns the decision to make it. Communicating those trade-offs is covered in 6.2; here the skill is noticing and recording the conflict before it is buried in the architecture.

Traps the wrong answers are built from

Tempting but wrongDo this instead
Choosing a model or building an agent in the first meeting because the sponsor asked for one.Frame the business problem and constraints first; pick the simplest architecture that meets them.
Taking requirements only from the executive sponsor.Include frontline users, IT, security, risk/legal and operations; each owns requirements others cannot give.
Accepting “accurate”, “fast” and “secure” as requirements.Convert each into a measurable criterion with a test set, a threshold and an owner.
Resolving stakeholder conflicts silently inside the design.Log the conflict, present options with consequences, and have the decision owner choose.
Leaving scope open-ended to seem flexible.Write down what is out of scope for phase one so success can be declared.

You should now be able to

  • Reframe a solution-shaped request (“we want a chatbot”) as a business problem with a measurable outcome.
  • Identify the stakeholder groups for an engagement and the requirements each one owns.
  • Separate functional and non-functional requirements, including latency, cost, volume and data constraints.
  • Write success criteria that are specific, measurable, achievable and relevant, with a test set and owner.
  • Record conflicts, open decisions and out-of-scope items instead of resolving them silently.

Practice questions

Original questions written for this lesson, in the exam’s style. Answer first, then open the reasoning — every option is explained, including why the wrong ones are tempting.

  1. Question 1

    A retail bank’s COO asks your team for “a Claude agent that answers all customer emails”. She wants a working demo at next month’s board meeting. Nobody from the contact centre or compliance has been involved.

    What should the architect do first?

    1. ABuild a demo agent on public FAQ content so the board sees early progress.
    2. BPick the most capable model so quality is not a risk in the demo.
    3. CRun discovery with contact-centre and compliance staff; agree success criteria.
    4. DSend the COO a questionnaire and design from her answers.
    Show answer and reasoning
    1. AIncorrect. Tempting because it pleases the sponsor, but it skips the users and rules that decide whether the real system is viable, and anchors expectations on the wrong scope.
    2. BIncorrect. Model choice is a design decision that depends on requirements such as latency, cost and volume, none of which are known yet.
    3. CCorrect. Discovery with the people who do the work and own the rules surfaces the real problem, constraints and a way to prove success before design begins.
    4. DIncorrect. Structured questions help, but a single sponsor cannot supply the workflow, edge cases and compliance constraints that other groups own.
  2. Question 2

    During discovery for a logistics company, the sponsor says the new document-processing system “must be highly accurate and fast”.

    Which two follow-ups turn this into usable requirements? (Select 2.)

    1. AAgree a per-field accuracy target measured on a labelled set of real documents.
    2. BAsk whether results are needed live or can be produced in an overnight batch.
    3. CRecord “high accuracy” as a non-functional requirement for the design team.
    4. DPromise 99.9% accuracy so the sponsor is confident in the project.
    5. EDefer accuracy targets until the pilot shows what the model can do.
    Show answer and reasoning
    1. ACorrect. This makes accuracy specific and measurable against data that reflects the real task, as the success-criteria guidance recommends.
    2. BCorrect. “Fast” means different things; knowing whether it is interactive or offline sets the latency target and may open cheaper options.
    3. CIncorrect. Writing the wish down unchanged still leaves nothing anyone can test or sign off against.
    4. DIncorrect. A number chosen to reassure, without a test set or baseline, is not achievable by design and sets up a missed expectation.
    5. EIncorrect. Measuring first can inform the target, but leaving success undefined means the pilot has no agreed pass mark.
  3. Question 3

    In discovery for a hospital scheduling assistant, the operations director wants the assistant to rebook appointments automatically. The clinical safety lead insists a person approves any change to urgent appointments.

    How should the architect handle this?

    1. ADesign full automation, since the operations director is the project sponsor.
    2. BLog it as an open decision and have its owner choose between options.
    3. CAdd human approval everywhere to be safe and move on.
    4. DAsk the model to judge which appointments are urgent and route accordingly.
    Show answer and reasoning
    1. AIncorrect. Sponsorship does not override a safety owner’s constraint; hiding the conflict in the design causes a late blocker or a real harm.
    2. BCorrect. Surfacing the conflict with options and consequences, and getting the accountable person to decide, is how discovery handles disagreement.
    3. CIncorrect. Over-correcting silently is still deciding for the stakeholders, and it may destroy the value the sponsor needs on routine bookings.
    4. DIncorrect. This jumps to a design before the stakeholders have agreed the rule, and assumes the model may make the very call in dispute.

Sources

Drafted with AI assistance and checked against the sources above; expert review is in progress. Spotted an error? Tell us and it gets fixed, dated and listed on how this is written.