home/categories/llm-ai/eyadsibai-ltk-plugins-ltk-data-skills-llm-inference-skill-md
llm-aidata-ai

llm-inference

Use when "LLM inference", "serving LLM", "vLLM", "llama.cpp", "GGUF", "text generation", "model serving", "inference optimization", "KV cache", "continuous batching", "speculative decoding", "local LLM", "CPU inference"

eyadsibai
maintainer
eyadsibai
Actualizado 1/15/2026
Estrellas
0
Forks
0
quick start

Installation and usage

Use when "LLM inference", "serving LLM", "vLLM", "llama.cpp", "GGUF", "text generation", "model serving", "inference optimization", "KV cache", "continuous batching", "speculative decoding", "local LLM", "CPU inference"

Instalación
$ install --globalskills.sh
Uso

Después de instalarlo, puedes usar este skill ejecutando el siguiente comando en tu terminal:

skills use llm-inference