home/categories/framework-internals/letta-ai-skills-letta-benchmarks-trajectory-feedback-torch-pipeline-parallelism-skill-md
framework-internalsdevelopment

torch-pipeline-parallelism

Guidance for implementing PyTorch pipeline parallelism for distributed model training. This skill should be used when tasks involve implementing pipeline parallelism, distributed training with model partitioning across GPUs/ranks, AFAB (All-Forward-All-Backward) scheduling, or inter-rank tensor communication using torch.distributed.

letta-ai
maintainer
letta-ai
更新於 1/19/2026
星標
31
分支
5
quick start

Installation and usage

Guidance for implementing PyTorch pipeline parallelism for distributed model training. This skill should be used when tasks involve implementing pipeline parallelism, distributed training with model partitioning across GPUs/ranks, AFAB (All-Forward-All-Backward) scheduling, or inter-rank tensor communication using torch.distributed.

安裝
$ install --globalskills.sh
使用

安裝後,您可以通過在終端運行以下命令來使用此技能:

skills use torch-pipeline-parallelism