skills.homes logoskills.homescapability registry
home/categories/machine-learning/gpu-cli-gpu-skills-gpu-inference-server-skill-md
cd ..
machine-learningdata-ai

gpu-inference-server

Set up AI inference servers on cloud GPUs. Create private LLM APIs (vLLM, TGI), image generation endpoints, embedding services, and more. All with OpenAI-compatible interfaces that work with existing tools.

स्रोत देखेंmachine-learning
gpu-cli
maintainer
gpu-cli
अपडेट किया गया 1/17/2026
स्टार
0
फोर्क
0
quick start

Installation and usage

Set up AI inference servers on cloud GPUs. Create private LLM APIs (vLLM, TGI), image generation endpoints, embedding services, and more. All with OpenAI-compatible interfaces that work with existing tools.

इंस्टॉलेशन
$ install --globalskills.sh
उपयोग

इंस्टॉल करने के बाद, आप टर्मिनल में यह कमांड चलाकर इस स्किल का उपयोग कर सकते हैं:

skills use gpu-inference-server