home/categories/llm-ai/eyadsibai-ltk-plugins-ltk-data-skills-llm-inference-skill-md
llm-aidata-ai

llm-inference

Use when "LLM inference", "serving LLM", "vLLM", "llama.cpp", "GGUF", "text generation", "model serving", "inference optimization", "KV cache", "continuous batching", "speculative decoding", "local LLM", "CPU inference"

eyadsibai
maintainer
eyadsibai
更新於 1/15/2026
星標
0
分支
0
quick start

Installation and usage

Use when "LLM inference", "serving LLM", "vLLM", "llama.cpp", "GGUF", "text generation", "model serving", "inference optimization", "KV cache", "continuous batching", "speculative decoding", "local LLM", "CPU inference"

安裝
$ install --globalskills.sh
使用

安裝後,您可以透過在終端機執行以下指令來使用此技能:

skills use llm-inference