framework-internalsdevelopment
llama-cpp
Run quantized LLMs locally with llama.cpp — CPU+GPU inference, GGUF format, OpenAI-compatible server, and Python bindings.
maintainer
AlexAI-MCP
Updated 4/7/2026
Stars
62
Forks
14
quick start
Installation and usage
Run quantized LLMs locally with llama.cpp — CPU+GPU inference, GGUF format, OpenAI-compatible server, and Python bindings.
Installation
$ install --globalskills.sh
Usage
Once installed, you can use this skill by running the following command in your terminal:
skills use llama-cpp