Individual skill

openrouter-load-balancing

Distribute OpenRouter requests across multiple keys and models for high throughput. Use when scaling beyond single-key rate limits or building high-availability systems. Triggers: 'openrouter load balance', 'openrouter scaling', 'distribute openrouter requests', 'multiple api keys'.

skills/.curated/openrouter-load-balancing/SKILL.md

Read pinned source

Source commit 0500b275e963c027f6b410e8c49c0446945c574e

What was checked

Matches the observed repository HEAD: Yes
Scanner rules are current: No
Repository scan complete: No
Skill scan complete: No
Observed behavior: Not checked yet
Last checked: Nov 12, 2026

These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.

Install this skill

Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.

An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.

Repository context

Repository stars (not skill ratings): 2,917
Repository last updated: Nov 12, 2026
License: MIT

Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.

ai Repository topic
automation Repository topic
claude-code Repository topic
devops Repository topic
mcp Repository topic
ai-agents Repository topic
anthropic Repository topic
claude-code-plugins Repository topic
developer-tools Repository topic
llm Repository topic
saas Declared skill tag
openrouter Declared skill tag
scaling Declared skill tag
high-availability Declared skill tag
load-balancing Declared skill tag
engineering Derived category

Files and excerpt

File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.

Browse files

SKILL.mdcore · 9,500 bytes
SKILL.mdcore · 9,500 bytes
SKILL.mdcore · 9,500 bytes
SKILL.mdcore · 9,500 bytes
SKILL.mdcore · 9,500 bytes
SKILL.mdcore · 9,500 bytes
references/concurrent-request-distribution.mddoc · 2,527 bytes
references/credit-aware-load-balancing.mddoc · 2,906 bytes
references/errors.mddoc · 478 bytes
references/examples.mddoc · 4,058 bytes
references/health-based-routing.mddoc · 1,706 bytes
references/model-based-load-balancing.mddoc · 1,305 bytes
references/monitoring-load-distribution.mddoc · 1,081 bytes
references/multi-key-load-balancing.mddoc · 1,698 bytes

Read excerpt

# OpenRouter Load Balancing

## Overview

A single OpenRouter API key has rate limits (requests/minute and tokens/minute). To scale beyond those limits, distribute requests across multiple keys. OpenRouter also provides server-side load balancing via provider routing and the `:nitro` variant for low-latency inference. This skill covers multi-key rotation, health-based routing, circuit breakers, and concurrent request patterns.

## Prerequisites

- Two or more OpenRouter API keys exported as `OPENROUTER_KEY_1`, `OPENROUTER_KEY_2`, `OPENROUTER_KEY_3` so the `KeyPool` has keys to rotate — see the `openrouter-install-auth` skill for creating and exporting keys
- `OPENROUTER_API_KEY` exported for the single-key concurrent-processing pattern
- Python 3.8+ with the OpenAI SDK and `requests` (`pip install openai requests`) — the concurrent example uses `AsyncOpenAI` from the same package
- Adequate credits on every key in the pool; per-key quota is visible via `GET /api/v1/auth/key`

## Instructions