Individual skill
scientific-data-preprocessing
⚠<U+FE0F> CRITICAL USER EXPERIENCE-BASED SKILL - ALWAYS CONSULT BEFORE DATA PREPROCESSING ⚠<U+FE0F> Prevents catastrophic errors (88.9% error rate in V1.0 case study) through multi-level feature analysis, data leakage detection, and semantic validation. MANDATORY for: data preprocessing, feature engineering, standardization, normalization, interpolation, missing value handling, feature selection, or ANY data transformation task. Covers grouped time-series, cross-sectional, panel data. Detects: time travel leakage, causal inversion, ID misuse, semantic-numeric fallacies, distribution blindness. User's hard-won lessons from real project failures.
bundled/skills/scientific-data-preprocessing/SKILL.md
Source commit 8af6e230d3db0f3022236e67632be6d8b9323bf0
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- No
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Not checked yet
- Last checked
- Nov 11, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 3,817
- Repository last updated
- Nov 9, 2026
- License
- Apache-2.0
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
- ai-agents Repository topic
- ai-workflow Repository topic
- automation Repository topic
- codex Repository topic
- developer-tools Repository topic
- skills Repository topic
- ai-skills Repository topic
- claude-code Repository topic
- llm Repository topic
- vibe-coding Repository topic
- research Derived category
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
README.mddoc · 8,249 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesSKILL.mdcore · 19,953 bytesUPDATE_LOG_V1.1.mddoc · 13,146 bytesreferences/ai-common-pitfalls.mddoc · 23,215 bytesreferences/decision-trees.mddoc · 14,225 bytesreferences/error-case-studies.mddoc · 12,657 bytesreferences/index.mddoc · 1,890 bytesreferences/validation-checklist.mddoc · 13,662 bytes
Read excerpt
# Scientific Data Preprocessing Skill
⚠<U+FE0F> **CRITICAL: USER'S HARD-WON EXPERIENCE - MANDATORY CONSULTATION** ⚠<U+FE0F>
This skill encapsulates painful lessons learned from real preprocessing disasters (88.9% error rate documented). **ALWAYS use this skill for planning, reflection, and validation when ANY data preprocessing is involved.**
**Why this skill is mandatory:**
- Based on actual project failures (V1.0, V2.0 case studies)
- Prevents data leakage that causes production disasters
- Catches semantic errors AI agents commonly make
- Saves weeks of debugging and model retraining
**When to invoke (DO NOT SKIP):**
- ✅ Before starting ANY data preprocessing task