PLAYBOOK · METHOD

A complex use case is not one build — it's a sequence.

Most enterprise AI programmes fail at sequencing, not at technology. This playbook gives the order that works on VDF AI: name one decision, cut a vertical slice through it, build the evaluation set before the agent, let intent decomposition draft the network, then improve it through versioned runs instead of rewrites.

The hardest question in an agentic programme is rarely which model to use. It is which twenty minutes of somebody's working day to automate first. Teams that answer that precisely ship something inspectable in weeks; teams that start from a process map spend a quarter producing diagrams nobody executes. Everything below is written for the second kind of team, on the day they decide to stop drawing.

Vertical Slice Evaluation First Intent Decomposition Versioned Networks Human Hints
Use-case framework
Network Labs canvas showing a decomposed use case
The problem

Ambition arrives before a definition of done

"Automate claims handling" is a budget line, not a specification. Without a decision to point at and a way to score the answer, the build has no stopping condition — so it accumulates scope until the sponsor loses patience.

The VDF AI approach

Make the first run inspectable, then argue with it

Generate a first network from a plain-language description, execute it, and read the per-node record. A concrete run beats six weeks of design review because it tells you which step is actually weak.

WHY THIS MATTERS NOW

Scope discipline is the whole competitive advantage

Two organisations with identical infrastructure produce wildly different outcomes, and the difference is almost never the stack. It is that one of them defined a decidable unit of work — a question with a right answer somebody already knows — and the other defined a department.

A decidable unit gives you three things at once: an evaluation set (the historical answers), an owner (whoever gives them today), and a stopping condition (matching them). Everything the platform offers afterwards — intent decomposition, versioned specs in the Vault, run ledgers, human hints — is machinery for improving against that target. Without the target, the machinery has nothing to optimise.

If you cannot say what a correct answer looks like, you are not ready to build — you are ready to interview.
1
decision, named precisely, is the whole scope of a first slice.
20–40
historical cases with known answers are enough to score progress honestly.
v0.1
is generated, not designed — the argument starts after the first run.
TRIAGE BEFORE YOU BUILD

Three shapes of complexity, three different starting points

Shape A · Deep, narrow

One judgement, hard to make

Clause risk, claim validity, alarm severity. Start with a single agent in a well-configured domain and invest in retrieval quality. A network adds coordination cost you do not need yet.

Shape B · Wide, sequential

Many steps, each mundane

Intake, enrich, check, draft, route. Start with a network: the value is in the handoffs and the audit trail, and per-node outputs tell you which link in the chain is dropping quality.

Shape C · Federated

Several teams, one outcome

Start with one team's sub-outcome as a standalone network, and only compose subnetworks once two of them run in production. Cross-team designs built up front encode an org chart that will change.

WHAT YOU NEED TO START

Prerequisites for a first slice

Subject matter
  • One person who makes this decision today
  • 20–40 past cases with known outcomes
  • The rule or policy the decision follows
  • A named business owner for sign-off
Data and access
  • The systems holding the inputs
  • Read credentials for a pilot scope
  • Documents worth vectorising for retrieval
  • Clarity on what must never leave the perimeter
Platform
  • A domain created for this work
  • Agent Hub reachable from the orchestration API
  • An evaluation project for the scoring loop
  • Somewhere to review runs with the owner
THE LOOP

Description → spec → run → evidence → next version

Task description
plain language + domain
/intent/decompose
NetworkSpec + nodes/edges
Saved network
Vault version X.Y
Execute
run_id + node outputs
Evaluation set
scores per case
Hints applied
derived network v0.2
PLAYBOOK · STEP BY STEP

Eight moves from ambition to a production slice

1

Write the use case as one decidable sentence

Force the ambition into this shape: "Given [these inputs], decide [this], so that [this person] can [do this next]." If the sentence needs an "and", you have two use cases. Pick the one whose answer someone is waiting on, and park the other.

Good: "Given a supplier's contract and open incidents, decide whether renewal needs legal review, so the buyer can route it before the deadline." Bad: "Modernise supplier management."

2

Cut a vertical slice, not a horizontal layer

Take one document type, one queue, one country, one product line — and go all the way through to the person who acts on the output. A slice that stops at "the model produced text" proves nothing; a slice that changes what one team does on Monday proves everything. Horizontal work (ingest all data, connect all systems) looks like progress and delivers no verdict.

3

Build the evaluation set before the agent

Collect real historical cases and their known-good outputs, and register them as use cases in the evaluation service. Runs are then scored on reference metrics (BLEU, ROUGE, METEOR, BERTScore) alongside judged dimensions — actionability, clarity and structure, domain specificity, depth of analysis — and an overall score with written expert analysis.

# 1. register the cases
POST /use-cases          { "name": "...", "input": "...", "expected": "..." }

# 2. run the current configuration against them
POST /run-tests

# 3. score the results
POST /run-evaluation
GET  /results            # per-case scores + expert_analysis

This is the step teams skip, and it is the step that makes every later argument short: quality stops being an opinion and becomes a number attached to a version.

4

Configure the domain instead of over-writing prompts

Create a domain for the slice and put the durable behaviour there rather than in a prompt somebody will copy-paste into three agents. A domain carries its own context instructions, preferred output formats, tool preferences, model hints, and a regulated flag that forces routing to approved models only. Prompts should hold the task; the domain holds the rules of the house.

5

Make the inputs reachable before you orchestrate

List every input the decidable sentence names, then find the cheapest legitimate path to each: an existing connector, a vector index over the document set, or one of your own endpoints registered as an HTTP tool. Orchestration cannot compensate for an input the platform cannot see, and this inventory is usually where the real timeline lives.

6

Let intent decomposition draft version 0.1

Send the description and let the platform propose the graph. You get a validated NetworkSpec, canvas-ready nodes and connections, any validation notes, and metadata on how each node was assigned an agent.

curl -X POST "$V3/intent/decompose" \
  -H "Content-Type: application/json" \
  -d '{
    "task_description": "Given a supplier contract and open incidents, decide whether renewal needs legal review.",
    "domain_id": "procurement",
    "agent_selection_mode": "hybrid",
    "max_subtasks": 6
  }'

hybrid reuses matching agents from the hub and creates on-the-fly agents only where nothing fits. Save the result with POST /networks?bump=minor so the version history starts at the first draft.

7

Execute once, then read the record — not the answer

Start a run, watch events live, and open the per-node outputs. The final text tells you whether it worked; the node record tells you why, and mediocre results almost always localise to one step — a retrieval that came back empty, a plan that split the task on the wrong seam.

POST /networks/<network_id>/execute   -> { "run_id": "..." }
GET  /runs/<run_id>                    # run record
GET  /runs/<run_id>/nodes/<node_id>    # what that step actually produced
WS   /runs/<run_id>/events             # live execution events
8

Improve by version, then widen scope deliberately

Fetch the hints a run produced and apply them as a derived network rather than editing the live one, so v0.1 and v0.2 can be scored against the same evaluation set. Only after the owner signs off on the score should you widen — and before you do, write the policy contract down: approved models for regulated domains, tool allow-lists, whether external APIs are permitted at all.

GET  /runs/<run_id>/hints
POST /runs/<run_id>/apply_hints   -d '{ "mode": "new_network" }'

With runs accumulating, the learning layer starts contributing too — model routing, tool selection, and agent selection all improve from observed outcomes rather than from a rules file you maintain.

OUTCOMES

What you have at the end of a first slice

A score

on real historical cases, so the next review is about evidence rather than impressions.

A version

history in the Vault — every change to the network is comparable against the one before it.

A pattern

the second use case reuses: the same domain, tools, and review loop, at a fraction of the effort.

SEEMR REFERENCE

Early decisions you do not have to get right on day one

Model choice per step is the classic place to lose two weeks. SEEMR selects within whatever your policy permits and learns from run outcomes, so an imperfect starting choice corrects itself as the evaluation loop runs. Spend the two weeks on the evaluation set instead.

FREQUENTLY ASKED QUESTIONS

What teams ask in the first scoping session

Our use case touches six departments. Where is the right entry point?

Take the single decision that is repeated most often and blocks the most downstream work, and implement only that. Breadth is what makes these programmes stall; a use case that spans six departments is six use cases sharing a name, and the first one carries almost all of the learning.

Should we design the network graph by hand or generate it?

Generate the first draft. POST /intent/decompose turns a task description into a validated NetworkSpec plus canvas nodes and edges, which gives you something concrete to argue with. Hand-authoring is worth it later, once you know which steps actually matter.

Why build an evaluation set before building the agent?

Because without it every review meeting becomes a debate about vibes. Twenty to forty real cases with known-good outputs turn quality into a number that moves, and the platform scores runs on both reference metrics and judged dimensions such as actionability, clarity, domain specificity, and depth of analysis.

How long should a first slice take before we judge it?

Plan in weeks, not quarters. If the first slice cannot reach a run you can inspect within a few weeks, the slice is still too wide — narrow the document type, the queue, or the geography until it fits.

What do we do when the first run produces a mediocre answer?

Read the run record and per-node outputs rather than only the final text. Most weak results trace to one node: a retrieval step that returned nothing useful, or a planning step that split the task badly. Fix that node before touching anything else.

How do human corrections get back into the system?

Through hints. Fetch the hints for a run, then apply them to create a derived network rather than mutating the one already in production. Every version is stored, so you can compare v0.2 against v0.1 on the same evaluation set.

When should we widen scope?

When the current slice passes its evaluation set at a level the business owner signs off on, and the policy contract — approved models, allowed tools, external API access — is written down rather than assumed. Widening before both of those is how a promising pilot becomes an unsupportable one.

VDF AI contact animation element - floating communication symbol VDF AI contact animation element - support symbol
VDF AI get in touch illustration - team ready to assist customers
GET IN TOUCH

You Have Questions

Tell us what you’re trying to achieve—governed AI Networks, enterprise RAG, deep integrations, or on‑premise deployment. We’ll help you map the right architecture, security posture, and rollout path. If you’re moving beyond AI pilots and need scalable, auditable execution, reach out—our team is ready to help.