home/categories/framework-internals/nvidia-nemo-megatron-bridge-skills-perf-techniques-expert-parallel-overlap-skill-md
framework-internalsdevelopment
expert-parallel-overlap
Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatcher backends such as DeepEP and HybridEP.
maintainer
NVIDIA-NeMo
Обновлено 3/31/2026
Звёзды
560
Форки
263
quick start
Installation and usage
Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatcher backends such as DeepEP and HybridEP.
Установка
$ install --globalskills.sh
Использование
После установки вы можете использовать этот skill, выполнив следующую команду в терминале:
skills use expert-parallel-overlap