home/categories/llm-ai/atrawog-bazzite-ai-plugins-bazzite-ai-jupyter-skills-inference-skill-md
llm-aidata-ai

inference

Fast inference with Unsloth and vLLM backend. Covers model loading, fast_generate(), thinking model output parsing, and memory management for efficient inference.

atrawog
maintainer
atrawog
Actualizado 1/12/2026
Estrellas
0
Forks
0
quick start

Installation and usage

Fast inference with Unsloth and vLLM backend. Covers model loading, fast_generate(), thinking model output parsing, and memory management for efficient inference.

Instalación
$ install --globalskills.sh
Uso

Después de instalarlo, puedes usar este skill ejecutando el siguiente comando en tu terminal:

skills use inference