home/categories/containers/bagelhole-devops-security-agent-skills-infrastructure-local-ai-llm-inference-scaling-skill-md
containersdevops
llm-inference-scaling
Auto-scale LLM inference clusters on Kubernetes using KEDA, custom GPU metrics, and horizontal pod autoscaling. Handle traffic spikes, implement queue-based scaling, and optimize cost with spot instances for AI workloads.
maintainer
BagelHole
آخر تحديث 3/2/2026
النجوم
18
التفرعات
2
quick start
Installation and usage
Auto-scale LLM inference clusters on Kubernetes using KEDA, custom GPU metrics, and horizontal pod autoscaling. Handle traffic spikes, implement queue-based scaling, and optimize cost with spot instances for AI workloads.
التثبيت
$ install --globalskills.sh
الاستخدام
بعد التثبيت، يمكنك استخدام هذه المهارة بتشغيل الأمر التالي في الطرفية:
skills use llm-inference-scaling