home/categories/machine-learning/melodic-software-claude-code-plugins-plugins-systems-design-skills-llm-serving-patterns-skill-md
machine-learningdata-ai
llm-serving-patterns
LLM inference infrastructure, serving frameworks (vLLM, TGI, TensorRT-LLM), quantization techniques, batching strategies, and streaming response patterns. Use when designing LLM serving infrastructure, optimizing inference latency, or scaling LLM deployments.
maintainer
melodic-software
업데이트됨 1/19/2026
스타
11
포크
1
quick start
Installation and usage
LLM inference infrastructure, serving frameworks (vLLM, TGI, TensorRT-LLM), quantization techniques, batching strategies, and streaming response patterns. Use when designing LLM serving infrastructure, optimizing inference latency, or scaling LLM deployments.
설치
$ install --globalskills.sh
사용법
설치 후 터미널에서 다음 명령을 실행하여 이 스킬을 사용할 수 있습니다:
skills use llm-serving-patterns