framework-internalsdevelopment
unsloth-quantization
Utilizing Dynamic 4-bit quantization, FP8 training, and 8-bit optimizers to minimize VRAM usage without sacrificing accuracy. Triggers: quantization, dynamic 4-bit, fp8, bitsandbytes, adamw_8bit, qat.
maintainer
cuba6112
更新於 12/26/2025
星標
0
分支
0
quick start
Installation and usage
Utilizing Dynamic 4-bit quantization, FP8 training, and 8-bit optimizers to minimize VRAM usage without sacrificing accuracy. Triggers: quantization, dynamic 4-bit, fp8, bitsandbytes, adamw_8bit, qat.
安裝
$ install --globalskills.sh
使用
安裝後，您可以透過在終端機執行以下指令來使用此技能：
skills use unsloth-quantization