home/categories/machine-learning/orchestra-research-ai-research-skills-04-mechanistic-interpretability-transformer-lens-skill-md
machine-learningdata-ai

transformer-lens-interpretability

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.

Orchestra-Research
maintainer
Orchestra-Research
Updated 12/17/2025
Stars
6563
Forks
515
quick start

Installation and usage

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.

Installation
$ install --globalskills.sh
Usage

Once installed, you can use this skill by running the following command in your terminal:

skills use transformer-lens-interpretability