Individual skill
llama-cpp
Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.
skills/mlops/inference/llama-cpp/SKILL.md
Source commit df50433f8d577f832c6812b9e67be8ddb766059d
What was checked
- Matches the observed repository HEAD
- Yes
- Scanner rules are current
- Yes
- Repository scan complete
- No
- Skill scan complete
- No
- Observed behavior
- Network or broad shell
- Last checked
- Nov 11, 2026
These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.
Install this skill
Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.
Standard SKILL.md format has not been attested at this commit. No installation command is available; inspect the source.
Repository context
- Repository stars (not skill ratings)
- 212
- Repository last updated
- Nov 7, 2026
- License
- Apache-2.0
Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.
Files and excerpt
File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.
Browse files
SKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesSKILL.mdcore · 6,553 bytesreferences/optimization.mddoc · 1,659 bytesreferences/quantization.mddoc · 4,956 bytesreferences/server.mddoc · 2,259 bytes
Read excerpt
## Kheish Compatibility
This skill is repo-local and stays inactive until explicitly activated.
When the original instructions refer to legacy tool names, use these Kheish mappings:
- `terminal` => `bash`
- `web_extract` => `web_fetch`, plus `web_search` when discovery is needed
- `search_files` => `grep_search` and `glob_search`
- `browser_*` tools require a browser-capable surfaced tool or MCP; if none is available, use the closest available surface and say so explicitly
When the instructions mention local helper files, resolve them from `${KHEISH_SKILL_DIR}`.
# llama.cpp