Individual skill
skill-test
Testing framework for evaluating Databricks skills. Use when building test cases for skills, running skill evaluations, comparing skill versions, or creating ground truth datasets with the Generate-Review-Promote (GRP) pipeline. Triggers include "test skill", "evaluate skill", "skill regression", "ground truth", "GRP pipeline", "skill quality", and "skill metrics".
.test/SKILL.md
Source commit d7d36218b497414a92e584f9908cc3947400e035
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- Yes
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Network or broad shell
- Last checked
- Nov 4, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 1,987
- Repository last updated
- Nov 6, 2026
- License
- NOASSERTION
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
- agents Repository topic
- claude Repository topic
- cursor Repository topic
- databricks Repository topic
- vibecoding Repository topic
- testing Derived category
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
CUSTOMIZATION_GUIDE.mddoc · 9,012 bytesREADME.mddoc · 22,681 bytesSKILL.mdcore · 8,001 bytesSKILL.mdcore · 8,001 bytesSKILL.mdcore · 8,001 bytesSKILL.mdcore · 8,001 bytesSKILL.mdcore · 8,001 bytesTECHNICAL.mddoc · 33,690 bytesbaselines/databricks-agent-bricks/baseline.yamlasset · 521 bytesbaselines/databricks-aibi-dashboards/baseline.yamlasset · 478 bytesbaselines/databricks-apps-python/baseline.yamlasset · 328 bytesbaselines/databricks-bundles/baseline.yamlasset · 1,002 bytesbaselines/databricks-genie/baseline.yamlasset · 710 bytesbaselines/databricks-model-serving/baseline.yamlasset · 4,307 bytesbaselines/databricks-python-sdk/baseline.yamlasset · 1,470 bytesbaselines/databricks-spark-declarative-pipelines/baseline.yamlasset · 553 bytesbaselines/databricks-synthetic-data-gen/baseline.yamlasset · 521 bytesbaselines/databricks-zerobus-ingest/baseline.yamlasset · 853 bytesinstall_skill_test.shruns · 3,716 bytesnotebooks/gepa_skill_optimization_demo.ipynbruns · 25,011 bytespyproject.tomlasset · 987 bytesreferences/python-api.mddoc · 4,795 bytesreferences/scorers.mddoc · 3,960 bytesreferences/trace-eval.mddoc · 5,839 bytesreferences/workflows.mddoc · 7,095 bytesreferences/yaml-schemas.mddoc · 3,562 bytesscripts/_common.pyruns · 3,063 bytesscripts/add.pyruns · 3,535 bytesscripts/add_example.pyruns · 8,316 bytesscripts/baseline.pyruns · 920 bytesscripts/generate_examples.pyruns · 15,699 bytesscripts/generate_ground_truth.pyruns · 22,677 bytesscripts/init_skill.pyruns · 966 bytesscripts/list_traces.pyruns · 2,409 bytesscripts/mlflow_eval.pyruns · 3,149 bytesscripts/optimize.pyruns · 17,264 bytesscripts/regression.pyruns · 1,062 bytesscripts/review.pyruns · 2,061 bytesscripts/routing_eval.pyruns · 1,197 bytesscripts/run_app_eval.pyruns · 14,923 bytesscripts/run_eval.pyruns · 1,054 bytesscripts/scorers.pyruns · 887 bytesscripts/scorers_update.pyruns · 2,637 bytesscripts/sync.pyruns · 1,172 bytesscripts/trace_eval.pyruns · 4,896 bytesscripts/trace_to_examples.pyruns · 25,452 bytesskills/_routing/ground_truth.yamlasset · 8,117 bytesskills/_routing/manifest.yamlasset · 442 bytesskills/databricks-agent-bricks/candidates.yamlasset · 15 bytesskills/databricks-agent-bricks/ground_truth.yamlasset · 20,535 bytesskills/databricks-agent-bricks/manifest.yamlasset · 2,186 bytesskills/databricks-aibi-dashboards/candidates.yamlasset · 15 bytesskills/databricks-aibi-dashboards/ground_truth.yamlasset · 4,679 bytesskills/databricks-aibi-dashboards/manifest.yamlasset · 4,789 bytesskills/databricks-apps-python/candidates.yamlasset · 150 bytesskills/databricks-apps-python/ground_truth.yamlasset · 16,904 bytesskills/databricks-apps-python/manifest.yamlasset · 1,089 bytesskills/databricks-bundles/candidates.yamlasset · 192 bytesskills/databricks-bundles/ground_truth.yamlasset · 38,464 bytesskills/databricks-bundles/manifest.yamlasset · 1,194 bytesskills/databricks-config/ground_truth.yamlasset · 6,111 bytesskills/databricks-config/manifest.yamlasset · 780 bytesskills/databricks-dbsql/ground_truth.yamlasset · 13,071 bytesskills/databricks-dbsql/manifest.yamlasset · 1,441 bytesskills/databricks-docs/ground_truth.yamlasset · 5,794 bytesskills/databricks-docs/manifest.yamlasset · 800 bytesskills/databricks-genie/candidates.yamlasset · 15 bytesskills/databricks-genie/ground_truth.yamlasset · 6,336 bytesskills/databricks-genie/manifest.yamlasset · 798 bytesskills/databricks-jobs/ground_truth.yamlasset · 11,193 bytesskills/databricks-jobs/manifest.yamlasset · 1,229 bytesskills/databricks-lakebase-autoscale/ground_truth.yamlasset · 10,851 bytesskills/databricks-lakebase-autoscale/manifest.yamlasset · 873 bytesskills/databricks-lakebase-provisioned/ground_truth.yamlasset · 13,389 bytesskills/databricks-lakebase-provisioned/manifest.yamlasset · 830 bytesskills/databricks-metric-views/ground_truth.yamlasset · 47,865 bytesskills/databricks-metric-views/manifest.yamlasset · 980 bytesskills/databricks-mlflow-evaluation/ground_truth.yamlasset · 12,989 bytesskills/databricks-mlflow-evaluation/manifest.yamlasset · 1,103 bytesskills/databricks-model-serving/candidates.yamlasset · 373 bytesskills/databricks-model-serving/ground_truth.yamlasset · 23,013 bytesskills/databricks-model-serving/manifest.yamlasset · 1,952 bytesskills/databricks-python-sdk/ground_truth.yamlasset · 12,454 bytesskills/databricks-python-sdk/manifest.yamlasset · 869 bytesskills/databricks-spark-declarative-pipelines/ground_truth.yamlasset · 19,456 bytesskills/databricks-spark-declarative-pipelines/manifest.yamlasset · 1,054 bytesskills/databricks-spark-structured-streaming/ground_truth.yamlasset · 7,383 bytesskills/databricks-spark-structured-streaming/manifest.yamlasset · 943 bytesskills/databricks-synthetic-data-gen/candidates.yamlasset · 311 bytesskills/databricks-synthetic-data-gen/expected_responses/gen_serverless_job_catalog_json_002.txtdoc · 10,970 bytesskills/databricks-synthetic-data-gen/expected_responses/grp_20260302_113344.txtdoc · 8,246 bytesskills/databricks-synthetic-data-gen/expected_responses/grp_20260302_retail_csv_3tables_003.txtdoc · 10,771 bytesskills/databricks-synthetic-data-gen/expected_responses/grp_20260303_manufacturing_delta_streaming_004.txtdoc · 8,133 bytesskills/databricks-synthetic-data-gen/ground_truth.yamlasset · 11,197 bytesskills/databricks-synthetic-data-gen/manifest.yamlasset · 1,272 bytesskills/databricks-synthetic-data-generation/ground_truth.yamlasset · 14,131 bytesskills/databricks-synthetic-data-generation/manifest.yamlasset · 925 bytesskills/databricks-unity-catalog/ground_truth.yamlasset · 8,947 bytesskills/databricks-unity-catalog/manifest.yamlasset · 917 bytesskills/databricks-unstructured-pdf-generation/ground_truth.yamlasset · 9,604 bytesskills/databricks-unstructured-pdf-generation/manifest.yamlasset · 892 bytesskills/databricks-vector-search/ground_truth.yamlasset · 14,427 bytesskills/databricks-vector-search/manifest.yamlasset · 957 bytesskills/databricks-zerobus-ingest/candidates.yamlasset · 15 bytesskills/databricks-zerobus-ingest/ground_truth.yamlasset · 25,888 bytesskills/databricks-zerobus-ingest/manifest.yamlasset · 1,439 bytessrc/skill_test/__init__.pyruns · 535 bytessrc/skill_test/agent/__init__.pyruns · 272 bytessrc/skill_test/agent/executor.pyruns · 30,301 bytessrc/skill_test/cli/__init__.pyruns · 6,792 bytessrc/skill_test/cli/commands.pyruns · 51,463 bytessrc/skill_test/config.pyruns · 5,434 bytessrc/skill_test/dataset.pyruns · 4,323 bytessrc/skill_test/fixtures/__init__.pyruns · 533 bytessrc/skill_test/fixtures/setup.pyruns · 17,199 bytessrc/skill_test/grp/__init__.pyruns · 1,995 bytessrc/skill_test/grp/diagnosis.pyruns · 4,438 bytessrc/skill_test/grp/executor.pyruns · 18,990 bytessrc/skill_test/grp/pipeline.pyruns · 8,654 bytessrc/skill_test/grp/reviewer.pyruns · 7,302 bytessrc/skill_test/optimize/__init__.pyruns · 778 bytessrc/skill_test/optimize/agent_evaluator.pyruns · 29,361 bytessrc/skill_test/optimize/alignment.pyruns · 4,151 bytessrc/skill_test/optimize/asi.pyruns · 2,312 bytessrc/skill_test/optimize/assertions.pyruns · 6,955 bytessrc/skill_test/optimize/assessment_fetcher.pyruns · 7,492 bytessrc/skill_test/optimize/config.pyruns · 14,609 bytessrc/skill_test/optimize/eval_criteria.pyruns · 7,236 bytessrc/skill_test/optimize/judge_tools.pyruns · 5,160 bytessrc/skill_test/optimize/judges.pyruns · 27,526 bytessrc/skill_test/optimize/review.pyruns · 18,925 bytessrc/skill_test/optimize/runner.pyruns · 41,294 bytessrc/skill_test/optimize/skillbench_evaluator.pyruns · 32,425 bytessrc/skill_test/optimize/splitter.pyruns · 10,563 bytessrc/skill_test/optimize/tools.pyruns · 9,853 bytessrc/skill_test/optimize/utils.pyruns · 2,179 bytessrc/skill_test/runners/__init__.pyruns · 313 bytessrc/skill_test/runners/compare.pyruns · 6,688 bytessrc/skill_test/runners/evaluate.pyruns · 8,576 bytessrc/skill_test/scorers/__init__.pyruns · 817 bytessrc/skill_test/scorers/dynamic.pyruns · 1,906 bytessrc/skill_test/scorers/routing.pyruns · 6,092 bytessrc/skill_test/scorers/trace.pyruns · 10,330 bytessrc/skill_test/scorers/universal.pyruns · 5,293 bytessrc/skill_test/trace/__init__.pyruns · 1,239 bytessrc/skill_test/trace/mlflow_integration.pyruns · 13,373 bytessrc/skill_test/trace/models.pyruns · 7,859 bytessrc/skill_test/trace/parser.pyruns · 9,839 bytessrc/skill_test/trace/source.pyruns · 8,475 bytestests/__init__.pyruns · 38 bytestests/integration/__init__.pyruns · 66 bytestests/integration/conftest.pyruns · 17,198 bytestests/integration/test_review_workflow.pyruns · 13,905 bytestests/integration/test_scripts.pyruns · 12,397 bytestests/integration/test_trace_eval.pyruns · 12,853 bytestests/integration/test_trace_source.pyruns · 5,899 bytestests/test_cli.pyruns · 7,790 bytestests/test_install_aitools_agents.pyruns · 37,177 bytestests/test_optimize_e2e.pyruns · 8,988 bytestests/test_scorers.pyruns · 10,790 bytestrace-integration-plan.mddoc · 10,015 bytesuv.lockasset · 1,033,350 bytes
No licensed excerpt is available. You can inspect the pinned source.