New: Boardroom MCP Engine!

Agent evaluation, memory, and tool contracts โ€” Worksheets

Usable worksheets and fictional practice material for agent evaluation, memory, and tool contracts.

Updated

On this page

Download the complete part-13 practice pack (ZIP). Extract it and preserve its folders. All organizations, records, and results in this teaching pack are fictional.

These forms are blank working tools, not test outcomes or approved policies.

Evaluation release record

Task and accepted-output contract: ____. System, model, prompt, source and tool versions: ____. Development cases: ____; held-out cases: ____; stress cases: ____. Attempted: ____; accepted: ____; rejected: ____; unknown: ____; not run: ____. Exclusion reasons: ____. Material factual errors and source-support findings: ____. Unauthorized attempts and completed incidents, separately: ____. All-attempt run cost: ____; review and maintenance effort: ____. Critical stop conditions and observed breaches: ____. Reviewer calibration and unresolved disagreements: ____. Decision and responsible owner: ____; actual decision date: ____.

Do not remove unknown outcomes from the attempted denominator without explicitly changing and labeling the measure. Do not count unexecuted cases as passed.

Memory correction exercise

CaseExpected behaviorObserved behaviorEvidence
Tuesday request superseded by authorized Thursday requestPreserve history; use current authority
Similar customer namesRetrieve the exact permitted record
Old policy matches search betterUse applicable authoritative version
Source access revokedPrevent unauthorized retrieval
Summary omits a qualificationCorrect derived summary and preserve provenance
User withdraws a preferenceApply correction across the relevant stores
Process restartsRecover persistent state without assuming action success

Tool and orchestration contract

Tool: ____; purpose: ____; permitted user and record scope: ____. Input schema, units, and required fields: ____. Read/write/send effects: ____; permitted destinations: ____. Approval payload and expiration: ____. Version or concurrency check: ____. Stable action identity and provider retry semantics: ____. Unknown-outcome reconciliation: ____. Cancellation and compensating actions: ____. Required log references and redaction: ____. Receiving owner for failed or pending work: ____.

Explainability exercise

Select a completed example only after it exists. Trace the output to its stage, handoff, source, access decision, approval if required, and destination confirmation. Record what can be established from evidence and what remains uncertain. Do not fill gaps with generated rationales presented as historical facts.