home/categories/machine-learning/scientiacapital-unsloth-mcp-server-claude-skills-unsloth-tokenizer-skill-md
machine-learningdata-ai

unsloth-tokenizer

Analyze, compare, and work with tokenizers using Unsloth tools. Compare different tokenizers, analyze token efficiency, and integrate with Unsloth models. For SuperBPE training, see the 'superbpe' skill.

ScientiaCapital
maintainer
ScientiaCapital
์—…๋ฐ์ดํŠธ๋จ 2026. 1. 18.
์Šคํƒ€
1
ํฌํฌ
0
quick start

Installation and usage

Analyze, compare, and work with tokenizers using Unsloth tools. Compare different tokenizers, analyze token efficiency, and integrate with Unsloth models. For SuperBPE training, see the 'superbpe' skill.

์„ค์น˜
$ install --globalskills.sh
์‚ฌ์šฉ๋ฒ•

์„ค์น˜ ํ›„ ํ„ฐ๋ฏธ๋„์—์„œ ๋‹ค์Œ ๋ช…๋ น์„ ์‹คํ–‰ํ•˜์—ฌ ์ด ์Šคํ‚ฌ์„ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค:

skills use unsloth-tokenizer