home/categories/cloud/hsliuustc0106-vllm-omni-skills-skills-vllm-omni-serving-skill-md
clouddevops

vllm-omni-serving

Launch and configure vLLM-Omni API servers for production model serving. Use when starting a model server, configuring stage pipelines, setting up GPU memory, enabling optimizations, or deploying models behind a load balancer.

hsliuustc0106
maintainer
hsliuustc0106
업데이트됨 3/4/2026
스타
50
포크
17
quick start

Installation and usage

Launch and configure vLLM-Omni API servers for production model serving. Use when starting a model server, configuring stage pipelines, setting up GPU memory, enabling optimizations, or deploying models behind a load balancer.

설치
$ install --globalskills.sh
사용법

설치 후 터미널에서 다음 명령을 실행하여 이 스킬을 사용할 수 있습니다:

skills use vllm-omni-serving