home/categories/machine-learning/doanchienthangdev-omgkit-plugin-skills-ai-engineering-inference-optimization-skill-md
machine-learningdata-ai
inference-optimization
Optimizing AI inference - quantization, speculative decoding, KV cache, batching, caching strategies. Use when reducing latency, lowering costs, or scaling AI serving.
maintainer
doanchienthangdev
آخر تحديث 1/8/2026
النجوم
1
التفرعات
0
quick start
Installation and usage
Optimizing AI inference - quantization, speculative decoding, KV cache, batching, caching strategies. Use when reducing latency, lowering costs, or scaling AI serving.
التثبيت
$ install --globalskills.sh
الاستخدام
بعد التثبيت، يمكنك استخدام هذه المهارة بتشغيل الأمر التالي في الطرفية:
skills use inference-optimization