Individual skill
aws-ai-ml
Selects, deploys, and customizes AI models on Amazon SageMaker. Training or Processing jobs, fine-tuning (SFT/DPO/RLVR/RLAIF), model selection, dataset preparation, evaluation, SageMaker or Bedrock deployment, inference optimization and endpoint diagnostics. Covers the full lifecycle from planning through production. Use when fine-tuning models on SageMaker, choosing which base model to customize, fine-tune, or deploy from SageMaker JumpStart or Hub, SageMakerPublicHub, or the SageMaker public model catalog, transforming or validating training data, evaluating model quality, deploying or optimizing endpoints, configuring IAM/S3 for training, or managing SageMaker Managed MLflow. Use for endpoint health, failures, latency, logs, metrics, errors. Covers Serverless Model Customization, Nova and OSS deployment paths, and PySDK v3. NOT for Ground Truth labeling, Feature Store, or general-purpose AWS infrastructure.
skills/core-skills/aws-ai-ml/SKILL.md
Source commit 1761e96813ebcbd43ed81d19e837219033f0afe5
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- Yes
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Network or broad shell
- Last checked
- Nov 3, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 3,431
- Repository last updated
- Nov 7, 2026
- License
- Apache-2.0
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
SKILL.mdcore · 8,299 bytesreferences/dataset-evaluation/overview.mddoc · 5,572 bytesreferences/dataset-evaluation/references/custom-scorer-evaluation-dataset-formats.mddoc · 3,650 bytesreferences/dataset-evaluation/references/strategy_data_requirements.mddoc · 4,879 bytesreferences/dataset-evaluation/scripts/format_detector.pyruns · 27,379 bytesreferences/dataset-transformation/code_templates/transformation.pyruns · 1,536 bytesreferences/dataset-transformation/overview.mddoc · 13,615 bytesreferences/dataset-transformation/references/code_output_guide.mddoc · 2,909 bytesreferences/dataset-transformation/references/dataset_transformation_code.mddoc · 5,311 bytesreferences/dataset-transformation/references/sagemaker_dataset_formats.mddoc · 2,953 bytesreferences/dataset-transformation/scripts/transformation_tools.pyruns · 4,965 bytesreferences/directory-management/overview.mddoc · 1,975 bytesreferences/endpoint-diagnostics/overview.mddoc · 3,589 bytesreferences/endpoint-diagnostics/references/minimum_iam_policy.mddoc · 1,225 bytesreferences/endpoint-diagnostics/scripts/collect_diagnostics.pyruns · 13,105 bytesreferences/finetuning-technique/overview.mddoc · 2,186 bytesreferences/finetuning-technique/references/finetune_technique_selection_guide.mddoc · 2,393 bytesreferences/finetuning-technique/scripts/get_recipes.pyruns · 817 bytesreferences/finetuning/code_templates/dpo.pyruns · 6,587 bytesreferences/finetuning/code_templates/rlaif_builtin.pyruns · 5,953 bytesreferences/finetuning/code_templates/rlaif_custom_prompt.pyruns · 6,450 bytesreferences/finetuning/code_templates/rlvr.pyruns · 6,635 bytesreferences/finetuning/code_templates/sft.pyruns · 6,259 bytesreferences/finetuning/overview.mddoc · 11,651 bytesreferences/finetuning/references/code_output_guide.mddoc · 3,254 bytesreferences/finetuning/references/continuous_customization.mddoc · 8,595 bytesreferences/finetuning/references/eula_links.mddoc · 7,480 bytesreferences/finetuning/references/rlaif_guide.mddoc · 3,885 bytesreferences/finetuning/references/rlvr_reward_function.mddoc · 10,261 bytesreferences/finetuning/scripts/mlflow_reference.pyruns · 841 bytesreferences/finetuning/templates/nova_rlvr_reward_function_source_template.pyruns · 13,080 bytesreferences/finetuning/templates/rlvr_reward_function_source_template.pyruns · 9,352 bytesreferences/manage-mlflow/overview.mddoc · 4,959 bytesreferences/manage-mlflow/references/app-creation-workflow.mddoc · 3,307 bytesreferences/manage-mlflow/references/app-deletion-workflow.mddoc · 2,381 bytesreferences/manage-mlflow/references/app-discovery-workflow.mddoc · 1,552 bytesreferences/manage-mlflow/references/app-update-workflow.mddoc · 1,748 bytesreferences/manage-mlflow/references/sm-mlflow-guide.mddoc · 1,360 bytesreferences/model-deployment/code_templates/deploy-jumpstart-sagemaker.pyruns · 7,669 bytesreferences/model-deployment/code_templates/deploy-nova-bedrock.pyruns · 2,041 bytesreferences/model-deployment/code_templates/deploy-nova-sagemaker.pyruns · 1,938 bytesreferences/model-deployment/code_templates/deploy-oss-bedrock.pyruns · 4,136 bytesreferences/model-deployment/code_templates/deploy-oss-sagemaker.pyruns · 2,645 bytesreferences/model-deployment/code_templates/optimize-benchmark.pyruns · 4,682 bytesreferences/model-deployment/code_templates/optimize-huggingface-to-s3.pyruns · 2,039 bytesreferences/model-deployment/code_templates/optimize-recommendation.pyruns · 6,550 bytesreferences/model-deployment/overview.mddoc · 17,040 bytesreferences/model-deployment/references/code_output_guide.mddoc · 3,253 bytesreferences/model-deployment/references/deploy-jumpstart-sagemaker.mddoc · 14,655 bytesreferences/model-deployment/references/deploy-nova-bedrock.mddoc · 4,516 bytesreferences/model-deployment/references/deploy-nova-sagemaker.mddoc · 5,956 bytesreferences/model-deployment/references/deploy-oss-bedrock.mddoc · 5,340 bytesreferences/model-deployment/references/deploy-oss-sagemaker.mddoc · 13,232 bytesreferences/model-deployment/references/model-licenses.mddoc · 12,227 bytesreferences/model-deployment/references/optimization/benchmark-workflow.mddoc · 12,956 bytesreferences/model-deployment/references/optimization/benchmarking-guidance.mddoc · 9,100 bytesreferences/model-deployment/references/optimization/huggingface-to-s3.mddoc · 3,126 bytesreferences/model-deployment/references/optimization/interpreting-results.mddoc · 8,737 bytesreferences/model-deployment/references/optimization/recommendation-deploy.mddoc · 1,495 bytesreferences/model-deployment/references/optimization/recommendation-options.mddoc · 3,204 bytesreferences/model-deployment/references/optimization/recommendation-workflow.mddoc · 10,510 bytesreferences/model-evaluation/code_templates/custom_scorer_evaluator.pyruns · 2,596 bytesreferences/model-evaluation/code_templates/llmaaj_evaluator.pyruns · 2,833 bytesreferences/model-evaluation/overview.mddoc · 5,366 bytesreferences/model-evaluation/references/code_output_guide.mddoc · 3,353 bytesreferences/model-evaluation/references/create-reward-function.mddoc · 3,067 bytesreferences/model-evaluation/references/custom-lambda-scorer.mddoc · 4,463 bytesreferences/model-evaluation/references/custom-scorer-evaluation.mddoc · 10,786 bytesreferences/model-evaluation/references/evaluation-type-guide.mddoc · 10,370 bytesreferences/model-evaluation/references/llmaaj-builtin-evaluation.mddoc · 5,086 bytesreferences/model-evaluation/references/llmaaj-custom-evaluation.mddoc · 2,596 bytesreferences/model-evaluation/references/llmaaj-evaluation.mddoc · 14,931 bytesreferences/model-evaluation/references/supported-judge-models.mddoc · 2,957 bytesreferences/model-evaluation/scripts/nova_reward_function_source_template.pyruns · 13,429 bytesreferences/model-evaluation/scripts/reward_function_source_template.pyruns · 9,452 bytesreferences/model-evaluation/scripts/validate_custom_metrics.pyruns · 3,634 bytesreferences/model-selection/overview.mddoc · 10,587 bytesreferences/model-selection/references/benchmarks/agentic-index.mddoc · 2,890 bytesreferences/model-selection/references/benchmarks/coding-index.mddoc · 2,914 bytesreferences/model-selection/references/benchmarks/gpqa.mddoc · 2,854 bytesreferences/model-selection/references/benchmarks/hle.mddoc · 2,899 bytesreferences/model-selection/references/benchmarks/ifbench.mddoc · 2,831 bytesreferences/model-selection/references/benchmarks/intelligence-index.mddoc · 2,833 bytesreferences/model-selection/references/benchmarks/mmmu-pro.mddoc · 3,093 bytesreferences/model-selection/references/benchmarks/tau2.mddoc · 2,908 bytesreferences/model-selection/references/model-licenses.mddoc · 7,483 bytesreferences/model-selection/references/model-selection.mddoc · 8,388 bytesreferences/model-selection/references/select-for-deployment.mddoc · 20,288 bytesreferences/model-selection/scripts/filter_deployable_models.pyruns · 10,373 bytesreferences/model-selection/scripts/get_deployable_models.pyruns · 22,251 bytesreferences/model-selection/scripts/get_model_names.pyruns · 1,420 bytesreferences/model-selection/scripts/search_deployable_models.pyruns · 35,746 bytesreferences/planning/overview.mddoc · 10,501 bytesreferences/planning/references/deploy-base-model-plan.mddoc · 699 bytesreferences/planning/references/evaluate-first-plan.mddoc · 1,925 bytesreferences/planning/references/input-output-contracts.mddoc · 3,144 bytesreferences/planning/references/model-customization-plan.mddoc · 1,491 bytesreferences/planning/references/region-availability.mddoc · 1,246 bytesreferences/planning/references/skill-routing-constraints.mddoc · 2,728 bytesreferences/processing-jobs/code_templates/dataset_definition_processing.pyruns · 4,164 bytesreferences/processing-jobs/code_templates/framework_processing.pyruns · 3,050 bytesreferences/processing-jobs/code_templates/script_processing.pyruns · 3,012 bytesreferences/processing-jobs/code_templates/spark_processing.pyruns · 3,803 bytesreferences/processing-jobs/overview.mddoc · 6,850 bytesreferences/processing-jobs/references/configuration.mddoc · 4,732 bytesreferences/processing-jobs/references/troubleshooting.mddoc · 2,422 bytesreferences/sdk-getting-started/overview.mddoc · 643 bytesreferences/sdk-getting-started/references/execution-role-setup.mddoc · 2,443 bytesreferences/sdk-getting-started/references/sagemaker-python-sdk-setup.mddoc · 2,135 bytesreferences/training-jobs/code_templates/custom_training.pyruns · 6,361 bytesreferences/training-jobs/code_templates/jumpstart_training.pyruns · 5,778 bytesreferences/training-jobs/code_templates/recipe_training.pyruns · 5,884 bytesreferences/training-jobs/overview.mddoc · 9,278 bytesreferences/training-jobs/references/configuration.mddoc · 4,126 bytesreferences/training-jobs/references/troubleshooting.mddoc · 4,538 bytesreferences/use-case-specification/overview.mddoc · 2,018 bytesreferences/use-case-specification/references/spec-for-deployment.mddoc · 4,088 bytesreferences/use-case-specification/references/spec-for-finetuning.mddoc · 2,141 bytes
Read excerpt
# AWS AI/ML Model Customization
Domain expertise for fine-tuning and deploying models on Amazon SageMaker. Covers the full model customization lifecycle from planning through production deployment.
## Routing
Match the user's intent to the appropriate reference folder and load only that content.
| User intent | Reference | When to use |
|-------------|-----------|-------------|
| Plan a model customization project, discover scope of work, resume or modify a plan | [references/planning/](references/planning/) | User's request relates to model customization or deployment (fine-tuning, training, building, customizing, reviewing data, deploying or standing up a model — including selecting or deploying an off-the-shelf or base model with no training — or getting advice on approach). Always co-activate with other intents to discover full scope. Load this reference FIRST when the request matches multiple rows in this table — read its plan templates before routing to a single-action reference. |
| Define the business problem, success criteria, or use case spec | [references/use-case-specification/](references/use-case-specification/) | User says "define my use case", "capture requirements", "what should I decide up front", or as default first step in any plan. Skip only if user explicitly declines. |
| Select or change a base model | [references/model-selection/](references/model-selection/) | User asks which model to use, mentions a model name or family, or wants to evaluate what's available. **Always activate model-selection even for known model names** because the exact Hub model ID must be resolved. **Recommended:** route to use-case-specification first to capture requirements — this produces better filtering results. Routing to use-case-specification first is not required if user provides a specific model name/ID or declines. If intent is ambiguous (fine-tune vs deploy as-is), model-selection MUST confirm which path before proceeding. Base model filtering for deployment MUST go through select-for-deployment.md and its scripts for any final recommendation. |
| Choose a fine-tuning technique (SFT, DPO, RLVR, RLAIF) | [references/finetuning-technique/](references/finetuning-technique/) | User has decided to fine-tune and needs to choose a technique, or technique needs validation against the selected model's recipes. Requires a base model to be selected first. |