Individual skill
agent-platform-eval-flywheel
Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology. Use when generating synthetic user scenarios, evaluating an agent or model, building an eval dataset, picking or writing evaluation metrics, analyzing failures, comparing results before and after a fix, or when guidance is needed on Agent Platform eval methodology — including dataset schema, LLM-as-judge scoring, and common failure causes. For fine-tuning, use agent-platform-tuning. For general production deployment, use agent-platform-deploy.
skills/cloud/agent-platform-eval-flywheel/SKILL.md
Source commit 496fbede89dac1faf0d180a936bfc472b6fbf886
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- No
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Not checked yet
- Last checked
- Nov 4, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 23,716
- Repository last updated
- Nov 7, 2026
- License
- Apache-2.0
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
- google Repository topic
- googlecloud Repository topic
- skills Repository topic
- writing Derived category
- devops Derived category
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
SKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesSKILL.mdcore · 30,929 bytesreferences/attribution.mddoc · 1,958 bytesreferences/dataset_schema.mddoc · 11,281 bytesreferences/deployment.mddoc · 7,244 bytesreferences/failure_patterns.mddoc · 6,356 bytesreferences/metric_registry.mddoc · 16,457 bytesreferences/sdk_patterns.mddoc · 11,460 bytesscripts/compare_results.pyruns · 6,328 bytesscripts/endpoint_evaluation.pyruns · 5,410 bytesscripts/inspect_results.pyruns · 6,824 bytesscripts/maas_evaluation.pyruns · 2,344 bytesscripts/parse_adk_traces.pyruns · 8,639 bytesscripts/render_html_report.pyruns · 3,768 bytesscripts/validate_dataset.pyruns · 11,205 bytes
Read excerpt
# Agent Platform Eval Flywheel Skill
Help users evaluate and iteratively improve GenAI models and agents using the
Agent Platform GenAI Evaluation SDK (`google.genai` / `agentplatform`).
## Attribution
**MUST READ**: Before executing any `gcloud`, REST API, or MCP command, you MUST
read [Usage Attribution](references/attribution.md). For commands executed
directly in the terminal (never in generated scripts, Terraform, or user code),
prefix `gcloud` with `CLOUDSDK_METRICS_REQUEST_ATTRIBUTION` and append the
attribution suffix to `User-Agent` headers:
```text