home/categories/llm-ai/atrawog-bazzite-ai-plugins-bazzite-ai-jupyter-skills-inference-skill-md

llm-aidata-ai

inference

Name: inference
Author: atrawog

Fast inference with Unsloth and vLLM backend. Covers model loading, fast_generate(), thinking model output parsing, and memory management for efficient inference.

查看源码 llm-ai

maintainer

atrawog

更新于 1/12/2026

星标

分支

quick start

Installation and usage

Fast inference with Unsloth and vLLM backend. Covers model loading, fast_generate(), thinking model output parsing, and memory management for efficient inference.

安装

$ install --globalskills.sh

使用

安装后，您可以通过在终端运行以下命令来使用此技能：

skills use inference