Individual skill

phoenix-evals

Build and run evaluators for AI/LLM applications using Phoenix.

skills/phoenix-evals/SKILL.md

Read pinned source

Source commit edbecfa9099c4addae1f500cca1ac067204b30fd

What was checked

Matches the observed repository HEAD: Yes
Scanner rules are current: Yes
Repository scan complete: No
Skill scan complete: Yes
Observed behavior: Instructions only
Last checked: Nov 4, 2026

These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.

Install this skill

Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.

An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.

Repository context

Repository stars (not skill ratings): 40,864
Repository last updated: Nov 6, 2026
License: MIT

Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.

ai Repository topic
github-copilot Repository topic
prompt-engineering Repository topic
hacktoberfest Repository topic
agent-skills Repository topic
agents Repository topic
awesome Repository topic
custom-agents Repository topic
engineering Derived category

Files and excerpt

File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.

Browse files

SKILL.mdcore · 4,611 bytes
references/axial-coding.mddoc · 2,373 bytes
references/common-mistakes-python.mddoc · 7,156 bytes
references/error-analysis-multi-turn.mddoc · 1,371 bytes
references/error-analysis.mddoc · 4,316 bytes
references/evaluate-dataframe-python.mddoc · 4,464 bytes
references/evaluators-code-python.mddoc · 3,045 bytes
references/evaluators-code-typescript.mddoc · 1,207 bytes
references/evaluators-custom-templates.mddoc · 1,179 bytes
references/evaluators-llm-python.mddoc · 2,615 bytes
references/evaluators-llm-typescript.mddoc · 1,420 bytes
references/evaluators-overview.mddoc · 1,132 bytes
references/evaluators-pre-built.mddoc · 2,455 bytes
references/evaluators-rag.mddoc · 3,222 bytes
references/experiments-datasets-python.mddoc · 4,915 bytes
references/experiments-datasets-typescript.mddoc · 2,749 bytes
references/experiments-overview.mddoc · 1,748 bytes
references/experiments-running-python.mddoc · 2,990 bytes
references/experiments-running-typescript.mddoc · 3,205 bytes
references/experiments-synthetic-python.mddoc · 1,816 bytes
references/experiments-synthetic-typescript.mddoc · 2,266 bytes
references/fundamentals-anti-patterns.mddoc · 1,632 bytes
references/fundamentals-model-selection.mddoc · 1,458 bytes
references/fundamentals.mddoc · 1,835 bytes
references/observe-sampling-python.mddoc · 2,415 bytes
references/observe-sampling-typescript.mddoc · 3,954 bytes
references/observe-tracing-setup.mddoc · 3,396 bytes
references/production-continuous.mddoc · 3,642 bytes
references/production-guardrails.mddoc · 1,363 bytes
references/production-overview.mddoc · 2,352 bytes
references/setup-python.mddoc · 1,971 bytes
references/setup-typescript.mddoc · 981 bytes
references/validation-evaluators-python.mddoc · 1,067 bytes
references/validation-evaluators-typescript.mddoc · 4,551 bytes
references/validation.mddoc · 1,764 bytes

Read excerpt


# Phoenix Evals

Build evaluators for AI/LLM applications. Code first, LLM for nuance, validate against humans.

## Quick Reference

| Task | Files |
| ---- | ----- |
| Setup | [setup-python](references/setup-python.md), [setup-typescript](references/setup-typescript.md) |
| Decide what to evaluate | [evaluators-overview](references/evaluators-overview.md) |
| Choose a judge model | [fundamentals-model-selection](references/fundamentals-model-selection.md) |
| Use pre-built evaluators | [evaluators-pre-built](references/evaluators-pre-built.md) |
| Build code evaluator | [evaluators-code-python](references/evaluators-code-python.md), [evaluators-code-typescript](references/evaluators-code-typescript.md) |
| Build LLM evaluator | [evaluators-llm-python](references/evaluators-llm-python.md), [evaluators-llm-typescript](references/evaluators-llm-typescript.md), [evaluators-custom-templates](references/evaluators-custom-templates.md) |