Individual skill
pufferlib
High-performance reinforcement learning framework optimized for speed and scale. Use when you need fast parallel training, vectorized environments, multi-agent systems, or integration with game environments (Atari, Procgen, NetHack). Achieves 2-10x speedups over standard implementations. For quick prototyping or standard algorithm implementations with extensive documentation, use stable-baselines3 instead.
skills/pufferlib/SKILL.md
Source commit 894598cd3a90891a077c254566276bd379038bad
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- No
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Not checked yet
- Last checked
- Nov 5, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 251
- Repository last updated
- Oct 30, 2026
- License
- Apache-2.0
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
SKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesSKILL.mdcore · 14,320 bytesreferences/environments.mddoc · 12,489 bytesreferences/integration.mddoc · 15,165 bytesreferences/policies.mddoc · 19,183 bytesreferences/training.mddoc · 8,127 bytesreferences/vectorization.mddoc · 12,962 bytesscripts/__pycache__/env_template.cpython-313.pycasset · 13,094 bytesscripts/__pycache__/test_pufferlib.cpython-313.pycasset · 2,413 bytesscripts/__pycache__/train_template.cpython-313.pycasset · 9,473 bytesscripts/env_template.pyruns · 10,376 bytesscripts/test_pufferlib.pyruns · 1,484 bytesscripts/train_template.pyruns · 7,283 bytes
Read excerpt
# PufferLib - High-Performance Reinforcement Learning
## Overview
PufferLib is a high-performance reinforcement learning library designed for fast parallel environment simulation and training. It achieves training at millions of steps per second through optimized vectorization, native multi-agent support, and efficient PPO implementation (PuffeRL). The library provides the Ocean suite of 20+ environments and seamless integration with Gymnasium, PettingZoo, and specialized RL frameworks.
## When to Use This Skill
Use this skill when:
- **Training RL agents** with PPO on any environment (single or multi-agent)
- **Creating custom environments** using the PufferEnv API
- **Optimizing performance** for parallel environment simulation (vectorization)
- **Integrating existing environments** from Gymnasium, PettingZoo, Atari, Procgen, etc.
- **Developing policies** with CNN, LSTM, or custom architectures