home/categories/llm-ai/cuba6112-skillfactory-skills-unsloth-inference-skill-md
llm-aidata-ai

unsloth-inference

Deploying fine-tuned models for production inference using native kernel optimization, vLLM, or SGLang. Triggers: inference, serving, vllm, sglang, for_inference, model merging, openai api.

cuba6112
maintainer
cuba6112
آخر تحديث 12/26/2025
النجوم
0
التفرعات
0
quick start

Installation and usage

Deploying fine-tuned models for production inference using native kernel optimization, vLLM, or SGLang. Triggers: inference, serving, vllm, sglang, for_inference, model merging, openai api.

التثبيت
$ install --globalskills.sh
الاستخدام

بعد التثبيت، يمكنك استخدام هذه المهارة بتشغيل الأمر التالي في الطرفية:

skills use unsloth-inference