Individual skill

llamacpp-guide

Run and optimize models with llama.cpp — GGUF quantization, CPU/GPU offloading, server mode, and performance tuning. Use when you need maximum local inference efficiency or cross-platform deployment.

skills/llamacpp-guide/SKILL.md

Read pinned source

Source commit faf37c0859ebf627bfcb5225e8057d088691e0ae

What was checked

Matches the observed repository HEAD: Yes
Scanner rules are current: No
Repository scan complete: No
Skill scan complete: Yes
Observed behavior: Not checked yet
Last checked: Nov 8, 2026

These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.

Install this skill

Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.

An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.

Repository context

Repository stars (not skill ratings): 54
Repository last updated: Oct 10, 2026
License: MIT

Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.

agent-skills Repository topic
ai-agents Repository topic
ai-agents-automation Repository topic
ai-skills Repository topic
awesome Repository topic
awesome-list Repository topic
chatgpt Repository topic
claude-skills Repository topic
meta-ai Repository topic
muse-ai Repository topic
devops Derived category

Files and excerpt

File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.

Browse files

SKILL.mdcore · 3,900 bytes

Read excerpt


# llama.cpp Guide

llama.cpp is the portable inference engine: C++-based, runs everywhere from phones to servers, with 
the best CPU inference in the business and broad GGUF model support. It's the power tool behind 
most serious local LLM setups.

## Overview

The mental model: models in GGUF format (quantized variants from 2-bit to 8-bit), an engine that 
splits work between CPU and GPU layers, and two interfaces — a CLI for direct use and a server 
mode exposing an OpenAI-compatible API. Performance comes from tuning thread counts, batch sizes, 
and GPU offloading to your specific hardware. It's lower-level than packaged runners, which means 
more control and more knobs.