Individual skill
hugging-face-model-trainer
This skill should be used when users want to train or fine-tune language models using TRL (Transformer Reinforcement Learning) on Hugging Face Jobs infrastructure. Covers SFT, DPO, GRPO and reward modeling training methods, plus GGUF conversion for local deployment. Includes guidance on the TRL Jobs package, UV scripts with PEP 723 format, dataset preparation and validation, hardware selection, cost estimation, Trackio monitoring, Hub authentication, and model persistence. Should be invoked for tasks involving cloud GPU training, GGUF conversion, or when users mention training on Hugging Face Jobs without local GPU setup.
backend/cli/skills/ml-training/hugging-face-model-trainer/SKILL.md
Source commit a08e0ad0ad3d6448123039ee4659163eb2e35d99
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- Yes
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Network or broad shell
- Last checked
- Nov 2, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 4,351
- Repository last updated
- Nov 6, 2026
- License
- Apache-2.0
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
- agent Repository topic
- ai Repository topic
- bun Repository topic
- cli Repository topic
- llm Repository topic
- ml Repository topic
- open-source Repository topic
- research Repository topic
- science Repository topic
- ai-agent Repository topic
- hugging-face Declared skill tag
- fine-tuning Declared skill tag
- transformers Declared skill tag
- training Declared skill tag
- devops Derived category
- security Derived category
- education Derived category
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
SKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesSKILL.mdcore · 28,016 bytesreferences/gguf_conversion.mddoc · 9,863 bytesreferences/hardware_guide.mddoc · 6,778 bytesreferences/hub_saving.mddoc · 8,517 bytesreferences/reliability_principles.mddoc · 10,867 bytesreferences/trackio_guide.mddoc · 5,796 bytesreferences/training_methods.mddoc · 5,011 bytesreferences/training_patterns.mddoc · 6,127 bytesreferences/troubleshooting.mddoc · 8,858 bytesscripts/convert_to_gguf.pyruns · 12,637 bytesscripts/dataset_inspector.pyruns · 15,683 bytesscripts/estimate_cost.pyruns · 4,854 bytesscripts/train_dpo_example.pyruns · 3,118 bytesscripts/train_grpo_example.pyruns · 2,384 bytesscripts/train_sft_example.pyruns · 3,343 bytes
Read excerpt
# TRL Training on Hugging Face Jobs
## Overview
Train language models using TRL (Transformer Reinforcement Learning) on fully managed Hugging Face infrastructure. No local GPU setup required—models train on cloud GPUs and results are automatically saved to the Hugging Face Hub.
**TRL provides multiple training methods:**
- **SFT** (Supervised Fine-Tuning) - Standard instruction tuning
- **DPO** (Direct Preference Optimization) - Alignment from preference data
- **GRPO** (Group Relative Policy Optimization) - Online RL training
- **Reward Modeling** - Train reward models for RLHF
**For detailed TRL method documentation:**
```python