Not in the top 1,000 by GitHub stars
Unknown-333/awesome-data-engineering-skills
36 data-engineering skills for AI coding agents — dbt, Airflow, Dagster, Prefect, Spark, Snowflake, BigQuery, Databricks, Kafka, Iceberg. Portable SKILL.md Agent Skills (the format Anthropic launched as Claude Skills), with idempotency, backfill, and data-quality know-how. Runs in Claude Code, Cursor, Codex, Copilot, Gemini CLI and more.
History
Review weekly changes to SKILL.md before updating. Dates mark the weeks in which we observed each version; checks apply to the recorded commits.
View weekly changes
skills/authoring-airflow-dags/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/building-dagster-assets/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/building-dbt-models/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/building-feature-pipelines/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/building-iceberg-tables/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/building-ingestion-pipelines/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/building-kafka-consumers/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/debugging-airflow-pipelines/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/debugging-data-pipelines/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/debugging-dbt-runs/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/designing-backfills-and-replays/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/designing-data-contracts/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/designing-medallion-architecture/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/documenting-dbt-models/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/engineering-databricks-pipelines/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/generating-synthetic-test-data/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/handling-schema-evolution/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/implementing-cdc-with-debezium/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/implementing-data-cicd/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/implementing-data-quality-checks/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/implementing-pipeline-observability/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/managing-data-lineage-openlineage/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/masking-pii-data/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/migrating-legacy-etl/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/modeling-dimensional-data/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/optimizing-bigquery-queries/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/optimizing-parquet-storage/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/optimizing-pyspark-jobs/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/optimizing-snowflake-workloads/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/optimizing-sql-queries/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/orchestrating-prefect-flows/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/processing-streaming-data/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/reviewing-data-pipeline-code/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/terraform-for-data-infra/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/testing-dbt-projects/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
skills/writing-idempotent-transformations/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
template/skill-template/SKILL.md
Week of Nov 2, 2026 · +0 / −0 lines
Before Not checked yet → After Not checked yet
1a9bde3c514e → 1a9bde3c514e
Diff text is unavailable under the recorded licenses. Line counts and the GitHub link remain available.
Week of Oct 26, 2026 · Line counts unavailable
Before Not checked yet → After Not checked yet
First observation → 1a9bde3c514e
No earlier version was observed for comparison.
Heat
1.8- Star growth, last 7 daysNot available
- Star growth, last 24 hoursNot available
- Rank movement, last 7 daysNot available
- Commits, last 30 daysNot available
- Accounts asking about it through MCP, last 7 daysNot available
- Hot votes this weekNot available
Heat never changes the order by stars, and sponsorship never touches it. How heat works
Stars over time
30-day change not yet available: not enough history.
How it works
Skills included
Repository facts
- License
- No license detected
- Created
- Aug 30, 2026
- Last pushed
- Aug 30, 2026
- Forks
- 1
- Open issues
- 0
- Project activity
- Not available
Before you install
Not checked yetAutomated signals, not a guarantee
No scan has been recorded for this repository yet.