Individual skill
idea-quality
Score the QUALITY of a research idea at the idea stage — given a Markdown file with Title / Motivation / Method sections (no experiments needed), produce a per-axis quality assessment with cited evidence and an overall 0–100 score plus a verdict; or, given two such idea files, a blind head-to-head comparison. TRIGGER when the user asks "how good is this idea", "rate / score / grade this research idea or proposal", "review my idea .md before I write it up", "is this contribution strong enough to pursue", "which of these two idea files is stronger", or hands over an idea Markdown file (Title/Motivation/Method) and wants a quality judgment. Use this even when the user does not say the word "score" but clearly wants an assessment of how strong an idea is. DO NOT trigger for prior-art / overlap / "is this novel vs existing work" checks (that is a literature-collision task), for full reviews of finished papers that already have results, or for generating the idea itself.
ResearchStudio-Idea/evaluation/idea_quality/SKILL.md
Source commit 063f10088af49909e1a4a7ea8d29efe19633f34e
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- Yes
- Repository scan complete
- No
- Skill scan complete
- Yes
- Observed behavior
- Instructions only
- Last checked
- Nov 2, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 3,543
- Repository last updated
- Sep 21, 2026
- License
- MIT
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
- researchstudio-idea Repository topic
- researchstudio-reel Repository topic
- presentation Repository topic
- blog-generation Repository topic
- idea-generation Repository topic
- poster-generation Repository topic
- video-generation Repository topic
- research Derived category
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
SKILL.mdcore · 10,142 bytesevals/evals.jsonasset · 2,601 bytesevals/sample_ideas/mismatch_gate.mddoc · 880 bytesevals/sample_ideas/strong_grpo.mddoc · 1,362 bytesevals/sample_ideas/weak_temperature.mddoc · 677 bytes
Read excerpt
# Idea Quality
Judge how strong a research idea is **at the idea stage** — before any experiments exist — and return a quality score with reasons a reviewer would recognize. This skill is self-contained: it judges from first principles on the three axes below. It consults no external corpus, dataset, or other skill, so its judgment is reproducible from the idea text alone.
## Input: an idea Markdown file
The idea is a `.md` file with three sections. Read the file, then map each section to what it feeds:
```markdown
# Title
<≤ ~15 words: the idea's handle>
## Motivation
<the bottleneck / gap the idea attacks, why it matters, and why it is still open>