Individual skill
huggingface-accelerate
Wraps existing PyTorch training scripts with HuggingFace Accelerate (Accelerator class, accelerate config, accelerate launch) so the same code runs on CPU, single GPU, multi-GPU, multi-node, TPU, or Apple MPS. Covers device placement, FP16/BF16/FP8 mixed precision, gradient accumulation, distributed checkpointing, and switching between DDP, DeepSpeed ZeRO, FSDP, and Megatron backends. Use when converting a single-GPU script to multi-GPU, enabling mixed precision, configuring DeepSpeed ZeRO or FSDP, or setting up gradient accumulation. Use when one script must run on different hardware. Not for callback-heavy training loops (use PyTorch Lightning) or multi-node orchestration with hyperparameter tuning (use Ray Train).
plugins/KalarisLabs/research-agent-skills/skills/huggingface-accelerate/SKILL.md
Source commit d780783eba4ecc7c8b9429f95c9362df95f07c61
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- Yes
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Network or broad shell
- Last checked
- Nov 4, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 1,532
- Repository last updated
- Nov 6, 2026
- License
- Apache-2.0
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
- ai-coding Repository topic
- awesome Repository topic
- awesome-list Repository topic
- codex Repository topic
- codex-plugins Repository topic
- openai Repository topic
- codex-skill Repository topic
- codex-skills Repository topic
- marketplace Repository topic
- codex-marketplace Repository topic
- engineering Derived category
Declared tags are partial or unavailable.
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
SKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesSKILL.mdcore · 11,277 bytesreferences/custom-plugins.mddoc · 11,781 bytesreferences/megatron-integration.mddoc · 11,252 bytesreferences/performance.mddoc · 12,569 bytes
Read excerpt
# HuggingFace Accelerate - Unified Distributed Training
## Quick start
Accelerate simplifies distributed training to 4 lines of code.
**Installation**:
```bash
pip install accelerate
```
**Convert PyTorch script** (4 lines):
```python
import torch