home/categories/machine-learning/melodic-software-claude-code-plugins-plugins-systems-design-skills-llm-serving-patterns-skill-md
machine-learningdata-ai
llm-serving-patterns
LLM inference infrastructure, serving frameworks (vLLM, TGI, TensorRT-LLM), quantization techniques, batching strategies, and streaming response patterns. Use when designing LLM serving infrastructure, optimizing inference latency, or scaling LLM deployments.
maintainer
melodic-software
Mis à jour 1/19/2026
Étoiles
11
Forks
1
quick start
Installation and usage
LLM inference infrastructure, serving frameworks (vLLM, TGI, TensorRT-LLM), quantization techniques, batching strategies, and streaming response patterns. Use when designing LLM serving infrastructure, optimizing inference latency, or scaling LLM deployments.
Installation
$ install --globalskills.sh
Utilisation
Après l'installation, vous pouvez utiliser ce skill en exécutant la commande suivante dans votre terminal :
skills use llm-serving-patterns