home/categories/machine-learning/davila7-claude-code-templates-cli-tool-components-skills-ai-research-distributed-training-accelerate-skill-md
machine-learningdata-ai

huggingface-accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

davila7
maintainer
davila7
Updated 1/20/2026
Stars
17577
Forks
1576
quick start

Installation and usage

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

Installation
$ install --globalskills.sh
Usage

Once installed, you can use this skill by running the following command in your terminal:

skills use huggingface-accelerate