Individual skill

skill-comply

Visualize whether skills, rules, and agent definitions are actually followed — auto-generates scenarios at 3 prompt strictness levels, runs agents, classifies behavioral sequences, and reports compliance rates with full tool call timelines. Use when checking whether agents actually follow the skills, rules, and definitions they were given, rather than assuming they do.

skills/skill-comply/SKILL.md

Read pinned source

Source commit d2ef2680594f9a17526a6e1a2e18b3d242c5d17b

What was checked

Matches the observed repository HEAD: Yes
Scanner rules are current: Yes
Repository scan complete: No
Skill scan complete: No
Observed behavior: Network or broad shell
Last checked: Nov 9, 2026

These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.

Install this skill

Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.

An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.

Repository context

Repository stars (not skill ratings): 299,750
Repository last updated: Nov 6, 2026
License: MIT

Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.

ai-agents Repository topic
anthropic Repository topic
claude Repository topic
claude-code Repository topic
developer-tools Repository topic
llm Repository topic
mcp Repository topic
productivity Repository topic
legal Derived category

Files and excerpt

File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.

Browse files

SKILL.mdcore · 2,500 bytes
SKILL.mdcore · 2,500 bytes
fixtures/compliant_trace.jsonlasset · 1,070 bytes
fixtures/noncompliant_trace.jsonlasset · 629 bytes
fixtures/tdd_spec.yamlasset · 1,266 bytes
prompts/classifier.mddoc · 1,064 bytes
prompts/scenario_generator.mddoc · 2,230 bytes
prompts/spec_generator.mddoc · 1,645 bytes
pyproject.tomlasset · 360 bytes
scripts/__init__.pyruns · 0 bytes
scripts/classifier.pyruns · 2,970 bytes
scripts/grader.pyruns · 7,767 bytes
scripts/parser.pyruns · 2,809 bytes
scripts/report.pyruns · 6,470 bytes
scripts/run.pyruns · 4,312 bytes
scripts/runner.pyruns · 22,387 bytes
scripts/scenario_generator.pyruns · 1,888 bytes
scripts/spec_generator.pyruns · 2,277 bytes
scripts/utils.pyruns · 411 bytes
tests/test_classifier.pyruns · 3,512 bytes
tests/test_grader.pyruns · 19,981 bytes
tests/test_parser.pyruns · 3,140 bytes
tests/test_runner.pyruns · 37,014 bytes
tests/test_utf8.pyruns · 10,355 bytes

Read excerpt


# skill-comply: Automated Compliance Measurement

Measures whether coding agents actually follow skills, rules, or agent definitions by:
1. Auto-generating expected behavioral sequences (specs) from any .md file
2. Auto-generating scenarios with decreasing prompt strictness (supportive → neutral → competing)
3. Running `claude -p` and capturing tool call traces via stream-json
4. Classifying tool calls against spec steps using LLM (not regex)
5. Checking temporal ordering deterministically
6. Generating self-contained reports with spec, prompts, and timelines

## Supported Targets

- **Skills** (`skills/*/SKILL.md`): Workflow skills like search-first, TDD guides
- **Rules** (`rules/common/*.md`): Mandatory rules like testing.md, security.md, git-workflow.md