Individual skill
nanogpt
Provides nanoGPT, Karpathy's minimal PyTorch GPT implementation (model.py and train.py), with workflows for training character-level Shakespeare on CPU, reproducing GPT-2 124M on OpenWebText with multi-GPU torchrun, fine-tuning pretrained GPT-2 checkpoints, and training on custom text. Use when learning how GPT and transformer blocks work from scratch. Use when running a small training experiment on CPU or a single GPU. Use when modifying a transformer variant in plain PyTorch. Use when preparing character-level or BPE binary datasets. Use when troubleshooting out-of-memory or slow training in nanoGPT. Not for production or large-scale distributed training; use HuggingFace Transformers or Megatron-LM instead.
plugins/KalarisLabs/research-agent-skills/skills/nanogpt/SKILL.md
Source commit d780783eba4ecc7c8b9429f95c9362df95f07c61
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- Yes
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Network or broad shell
- Last checked
- Nov 4, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 1,531
- Repository last updated
- Nov 6, 2026
- License
- Apache-2.0
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
- ai-coding Repository topic
- awesome Repository topic
- awesome-list Repository topic
- codex Repository topic
- codex-plugins Repository topic
- openai Repository topic
- codex-skill Repository topic
- codex-skills Repository topic
- marketplace Repository topic
- codex-marketplace Repository topic
- education Derived category
Declared tags are partial or unavailable.
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
SKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesSKILL.mdcore · 9,590 bytesreferences/architecture.mddoc · 11,716 bytesreferences/data.mddoc · 11,212 bytesreferences/training.mddoc · 13,551 bytes
Read excerpt
# nanoGPT - Minimalist GPT Training
## Quick start
nanoGPT is a simplified GPT implementation designed for learning and experimentation.
**Installation**:
```bash
pip install torch numpy transformers datasets tiktoken wandb tqdm
```
**Train on Shakespeare** (CPU-friendly):
```bash
# Prepare data