home/categories/framework-internals/letta-ai-skills-letta-benchmarks-trajectory-feedback-torch-pipeline-parallelism-skill-md
framework-internalsdevelopment

torch-pipeline-parallelism

Guidance for implementing PyTorch pipeline parallelism for distributed model training. This skill should be used when tasks involve implementing pipeline parallelism, distributed training with model partitioning across GPUs/ranks, AFAB (All-Forward-All-Backward) scheduling, or inter-rank tensor communication using torch.distributed.

letta-ai
maintainer
letta-ai
更新于 1/19/2026
星标
31
分支
5
quick start

Installation and usage

Guidance for implementing PyTorch pipeline parallelism for distributed model training. This skill should be used when tasks involve implementing pipeline parallelism, distributed training with model partitioning across GPUs/ranks, AFAB (All-Forward-All-Backward) scheduling, or inter-rank tensor communication using torch.distributed.

安装
$ install --globalskills.sh
使用

安装后,您可以通过在终端运行以下命令来使用此技能:

skills use torch-pipeline-parallelism