home/categories/architecture-patterns/nvidia-nemo-megatron-bridge-skills-perf-techniques-hybrid-context-parallel-skill-md
architecture-patternsdevelopment

hybrid-context-parallel

Operational guide for enabling hierarchical context parallelism in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification. Use when the user asks about hierarchical_context_parallel_sizes, a2a+p2p, CP scaling beyond KV heads, or multi-level context parallelism.

NVIDIA-NeMo
maintainer
NVIDIA-NeMo
Обновлено 3/20/2026
Звёзды
560
Форки
263
quick start

Installation and usage

Operational guide for enabling hierarchical context parallelism in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification. Use when the user asks about hierarchical_context_parallel_sizes, a2a+p2p, CP scaling beyond KV heads, or multi-level context parallelism.

Установка
$ install --globalskills.sh
Использование

После установки вы можете использовать этот skill, выполнив следующую команду в терминале:

skills use hybrid-context-parallel