home/categories/machine-learning/scientiacapital-unsloth-mcp-server-claude-skills-unsloth-tokenizer-skill-md
machine-learningdata-ai

unsloth-tokenizer

Analyze, compare, and work with tokenizers using Unsloth tools. Compare different tokenizers, analyze token efficiency, and integrate with Unsloth models. For SuperBPE training, see the 'superbpe' skill.

ScientiaCapital
maintainer
ScientiaCapital
更新于 1/18/2026
星标
1
分支
0
quick start

Installation and usage

Analyze, compare, and work with tokenizers using Unsloth tools. Compare different tokenizers, analyze token efficiency, and integrate with Unsloth models. For SuperBPE training, see the 'superbpe' skill.

安装
$ install --globalskills.sh
使用

安装后,您可以通过在终端运行以下命令来使用此技能:

skills use unsloth-tokenizer