home/categories/framework-internals/aradotso-trending-skills-skills-turboquant-pytorch-skill-md
framework-internalsdevelopment

turboquant-pytorch

PyTorch implementation of TurboQuant for LLM KV cache compression using two-stage vector quantization (random rotation + Lloyd-Max + QJL residual correction).

Aradotso
maintainer
Aradotso
Actualizado 3/28/2026
Estrellas
26
Forks
6
quick start

Installation and usage

PyTorch implementation of TurboQuant for LLM KV cache compression using two-stage vector quantization (random rotation + Lloyd-Max + QJL residual correction).

Instalación
$ install --globalskills.sh
Uso

Después de instalarlo, puedes usar este skill ejecutando el siguiente comando en tu terminal:

skills use turboquant-pytorch