home/categories/cloud/hsliuustc0106-vllm-omni-skills-skills-vllm-omni-serving-skill-md
clouddevops

vllm-omni-serving

Launch and configure vLLM-Omni API servers for production model serving. Use when starting a model server, configuring stage pipelines, setting up GPU memory, enabling optimizations, or deploying models behind a load balancer.

hsliuustc0106
maintainer
hsliuustc0106
์—…๋ฐ์ดํŠธ๋จ 2026. 3. 4.
์Šคํƒ€
50
ํฌํฌ
17
quick start

Installation and usage

Launch and configure vLLM-Omni API servers for production model serving. Use when starting a model server, configuring stage pipelines, setting up GPU memory, enabling optimizations, or deploying models behind a load balancer.

์„ค์น˜
$ install --globalskills.sh
์‚ฌ์šฉ๋ฒ•

์„ค์น˜ ํ›„ ํ„ฐ๋ฏธ๋„์—์„œ ๋‹ค์Œ ๋ช…๋ น์„ ์‹คํ–‰ํ•˜์—ฌ ์ด ์Šคํ‚ฌ์„ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค:

skills use vllm-omni-serving