Individual skill

assess-ranking-consistency

0upvotes

Audit pairwise/ranking coherence and identify inconsistent cycles/triads.

skills/assess-ranking-consistency/SKILL.md

Read pinned source

Source commit 41f752b8444ed9030dd9dc223c302ce874e51f83

What was checked

Matches the observed repository HEAD: Yes
Scanner rules are current: Yes
Repository scan complete: No
Skill scan complete: Yes
Observed behavior: Instructions only
Last checked: Nov 10, 2026

These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.

Install this skill

Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.

An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.

Repository context

Repository stars (not skill ratings): 511
Repository last updated: Oct 23, 2026
License: Apache-2.0

Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.

academic-research Repository topic
deep-research Repository topic
literature-review Repository topic
mcp Repository topic
skill Repository topic
ai-scientist Repository topic
auto-research Repository topic
claude-code Repository topic
research-agent Repository topic
scientific-discovery Repository topic
security Derived category

Files and excerpt

File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.

Browse files

SKILL.mdcore · 1,513 bytes

Read excerpt


# assess-ranking-consistency
## Purpose
Audit pairwise and aggregate rankings for incoherent cycles, reversals, and unsupported rank transitions.
## Input contract
```yaml
required: [ranked_items, pairwise_judgments, comparison_criteria]
optional: [weights, tie_policy, prior_consistency_report]
constraints: [judgments identify compared items, direction, confidence, and criterion]
```
## Procedure
1. Reconstruct the directed comparison graph and normalize ties and missing edges.
2. Search triads and longer cycles for violations of declared transitivity or criterion direction.
3. Compare aggregate order with its supporting pairwise judgments and flag reversals or low-support placements.
4. Return inconsistency records, affected items, and the minimum judgments requiring review.