home/categories/llm-ai/vasilyu1983-ai-agents-public-frameworks-shared-skills-skills-ai-llm-inference-skill-md

llm-aidata-ai

ai-llm-inference

Name: ai-llm-inference
Author: vasilyu1983

Operational patterns for LLM inference: latency budgeting, tail-latency control, caching, batching/scheduling, quantization/compression, parallelism, and reliable serving at scale. Emphasizes production-grade performance, cost control, and observability.

소스 보기 llm-ai

maintainer

vasilyu1983

업데이트됨 1/9/2026

스타

포크

quick start

Installation and usage

설치

$ install --globalskills.sh

사용법

설치 후 터미널에서 다음 명령을 실행하여 이 스킬을 사용할 수 있습니다:

skills use ai-llm-inference