Individual skill
llm-serving-auto-benchmark
Framework-independent LLM serving benchmark skill for comparing SGLang, vLLM, TensorRT-LLM, TokenSpeed, or another serving framework. Use when a user wants to find the best deployment command for one model across multiple serving frameworks under the same workload, GPU budget, and latency SLA.
skills/llm-serving-auto-benchmark/SKILL.md
Source commit b47f67f4ceeb7cca1afc4df8ac5110a5fe2b8ad1
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- Yes
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Network or broad shell
- Last checked
- Nov 10, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.
Repository context
- Repository stars (not skill ratings)
- 1,159
- Repository last updated
- Nov 9, 2026
- License
- Not available
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
SKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesSKILL.mdcore · 30,131 bytesconfigs/cookbook-llm/README.mddoc · 5,439 bytesconfigs/cookbook-llm/deepseek-math-v2.yamlasset · 3,188 bytesconfigs/cookbook-llm/deepseek-r1-0528.yamlasset · 3,240 bytesconfigs/cookbook-llm/deepseek-v3.1.yamlasset · 3,194 bytesconfigs/cookbook-llm/deepseek-v3.2.yamlasset · 3,194 bytesconfigs/cookbook-llm/deepseek-v3.yamlasset · 3,210 bytesconfigs/cookbook-llm/devstral-small-2-24b-instruct-2512.yamlasset · 3,212 bytesconfigs/cookbook-llm/ernie-4.5-21b-a3b-pt.yamlasset · 2,985 bytesconfigs/cookbook-llm/gigachat3.5.yamlasset · 2,180 bytesconfigs/cookbook-llm/glm-4.5.yamlasset · 3,073 bytesconfigs/cookbook-llm/glm-4.6.yamlasset · 3,262 bytesconfigs/cookbook-llm/glm-4.7-flash.yamlasset · 3,198 bytesconfigs/cookbook-llm/glm-4.7.yamlasset · 3,163 bytesconfigs/cookbook-llm/glm-5-fp8.yamlasset · 3,154 bytesconfigs/cookbook-llm/glm-5.3-bf16.yamlasset · 2,186 bytesconfigs/cookbook-llm/glm-5.3-flash.yamlasset · 2,460 bytesconfigs/cookbook-llm/glyph.yamlasset · 3,105 bytesconfigs/cookbook-llm/gpt-oss-120b.yamlasset · 3,168 bytesconfigs/cookbook-llm/granite-4.2-3b.yamlasset · 2,190 bytesconfigs/cookbook-llm/hy4-preview-fp8.yamlasset · 2,216 bytesconfigs/cookbook-llm/intern-s1.yamlasset · 3,278 bytesconfigs/cookbook-llm/k2-horizon-09b.yamlasset · 2,207 bytesconfigs/cookbook-llm/kimi-k2-instruct.yamlasset · 3,308 bytesconfigs/cookbook-llm/kimi-k2.5.yamlasset · 3,196 bytesconfigs/cookbook-llm/kimi-k2.6.yamlasset · 3,224 bytesconfigs/cookbook-llm/kimi-linear-48b-a3b-instruct.yamlasset · 3,188 bytesconfigs/cookbook-llm/ling-2.5-1t.yamlasset · 3,340 bytesconfigs/cookbook-llm/ling-3.0-flash-vl.yamlasset · 2,466 bytesconfigs/cookbook-llm/llada2-1-mini.yamlasset · 3,312 bytesconfigs/cookbook-llm/llama-3.1-70b-instruct.yamlasset · 3,160 bytesconfigs/cookbook-llm/llama-3.3-70b-instruct.yamlasset · 3,048 bytesconfigs/cookbook-llm/llama-4-maverick-17b-128e-instruct-fp8.yamlasset · 3,289 bytesconfigs/cookbook-llm/llama-4-scout-17b-16e-instruct.yamlasset · 3,396 bytesconfigs/cookbook-llm/mimo-v2-flash.yamlasset · 3,471 bytesconfigs/cookbook-llm/minicpm5-2b.yamlasset · 2,109 bytesconfigs/cookbook-llm/minimax-m2.1.yamlasset · 3,088 bytesconfigs/cookbook-llm/minimax-m2.5.yamlasset · 3,285 bytesconfigs/cookbook-llm/minimax-m3.yamlasset · 2,958 bytesconfigs/cookbook-llm/ministral-3-8b-instruct-2512.yamlasset · 3,201 bytesconfigs/cookbook-llm/mistral-small-4-119b-2603.yamlasset · 3,173 bytesconfigs/cookbook-llm/nemotron-3-nano-30b-a3b-bf16.yamlasset · 3,368 bytesconfigs/cookbook-llm/nemotron-3-super-120b-a12b-bf16.yamlasset · 3,384 bytesconfigs/cookbook-llm/qwen3-235b-a22b.yamlasset · 3,178 bytesconfigs/cookbook-llm/qwen3-coder-480b-a35b-instruct.yamlasset · 3,291 bytesconfigs/cookbook-llm/qwen3-coder-next.yamlasset · 3,100 bytesconfigs/cookbook-llm/qwen3-next-80b-a3b-instruct.yamlasset · 3,236 bytesconfigs/cookbook-llm/qwen35-397b-a17b-fp8.yamlasset · 3,439 bytesconfigs/cookbook-llm/qwen36-35b-a3b-fp8.yamlasset · 2,279 bytesconfigs/cookbook-llm/qwen38-27b-fp8.yamlasset · 2,350 bytesconfigs/cookbook-llm/qwen38-flash-next-fp8.yamlasset · 2,402 bytesconfigs/cookbook-llm/ring-2.5-1t.yamlasset · 3,092 bytesconfigs/cookbook-llm/step-3.5-flash.yamlasset · 3,301 bytesreferences/container-runbook.mddoc · 13,874 bytesreferences/example-plan.yamlasset · 5,129 bytesreferences/framework-reference.mddoc · 13,237 bytesreferences/paired-validation.mddoc · 5,533 bytesreferences/result-schema.mddoc · 7,609 bytesscripts/compare_benchmark_results.pyruns · 14,947 bytesscripts/validate_cookbook_configs.pyruns · 16,187 bytes
No licensed excerpt is available. You can inspect the pinned source.