Individual skill

agent-evaluation-operations

0upvotes

Evaluate agent and skill behavior or routing.

skills/agent-evaluation-operations/SKILL.md

Read pinned source

Source commit 9922fa0af0aea32443cf7365ef5024dc7797382d

What was checked

Matches the observed repository HEAD: Yes
Scanner rules are current: No
Repository scan complete: No
Skill scan complete: No
Observed behavior: Not checked yet
Last checked: Nov 6, 2026

These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.

Install this skill

Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.

An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.

Repository context

Repository stars (not skill ratings): 137
Repository last updated: Oct 22, 2026
License: MIT

Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.

accessibility Repository topic
codex Repository topic
codex-skills Repository topic
frontend Repository topic
motion Repository topic
nextjs Repository topic
react Repository topic
tailwind Repository topic
web-design Repository topic
agent-skills Repository topic
operations Derived category

Files and excerpt

File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.

Browse files

SKILL.mdcore · 5,871 bytes
SKILL.mdcore · 5,871 bytes
SKILL.mdcore · 5,871 bytes
agents/openai.yamlasset · 256 bytes
references/fixture-execution.mddoc · 2,081 bytes
references/fixtures/draft-send.jsonasset · 351 bytes
references/regression-corpus.jsonasset · 20,362 bytes
references/skill-behavior-evaluation.mddoc · 3,133 bytes
scripts/analyze_skill_collisions.pyruns · 5,105 bytes
scripts/observe_draft_fixture.pyruns · 1,137 bytes
scripts/test_observe_draft_fixture.pyruns · 841 bytes
scripts/validate_regression_corpus.pyruns · 4,673 bytes

Read excerpt


# Agent Evaluation Operations

Evaluate the claim the change is supposed to support, not the amount of new prompt text or the number of passing examples. Routine copyediting of a test comment, ordinary execution of one existing test, or a task that merely mentions agents does not require an evaluation program.

## Choose the evaluation mode

- **Agent workflow:** test the real prompt, model, tools, approvals, state, and failure paths.
- **Skill behavior:** test whether the skill triggers on the right requests, stays out of unrelated requests, cooperates with adjacent skills, and improves outcomes without excessive context or rigidity.
- **Release comparison:** hold the harness constant and compare the current baseline with the proposed change.

For evaluating a skill creation or behavior-bearing modification, read [skill behavior evaluation](references/skill-behavior-evaluation.md). Use [the regression corpus](references/regression-corpus.json) when testing synthetic public agent and Codex operating behavior. Validate the corpus with `python3 "${CODEX_HOME:-$HOME/.codex}/skills/agent-evaluation-operations/scripts/validate_regression_corpus.py"`.

## Specify before measuring