home/categories/llm-ai/eyadsibai-ltk-plugins-ltk-data-skills-llm-inference-skill-md
llm-aidata-ai

llm-inference

Use when "LLM inference", "serving LLM", "vLLM", "llama.cpp", "GGUF", "text generation", "model serving", "inference optimization", "KV cache", "continuous batching", "speculative decoding", "local LLM", "CPU inference"

eyadsibai
maintainer
eyadsibai
آخر تحديث 1/15/2026
النجوم
0
التفرعات
0
quick start

Installation and usage

Use when "LLM inference", "serving LLM", "vLLM", "llama.cpp", "GGUF", "text generation", "model serving", "inference optimization", "KV cache", "continuous batching", "speculative decoding", "local LLM", "CPU inference"

التثبيت
$ install --globalskills.sh
الاستخدام

بعد التثبيت، يمكنك استخدام هذه المهارة بتشغيل الأمر التالي في الطرفية:

skills use llm-inference