skills.homes logoskills.homescapability registry
home/categories/framework-internals/nvidia-nemo-megatron-bridge-skills-perf-techniques-expert-parallel-overlap-skill-md
cd ..
framework-internalsdevelopment

expert-parallel-overlap

Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatcher backends such as DeepEP and HybridEP.

عرض المصدرframework-internals
NVIDIA-NeMo
maintainer
NVIDIA-NeMo
آخر تحديث 3/31/2026
النجوم
560
التفرعات
263
quick start

Installation and usage

Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatcher backends such as DeepEP and HybridEP.

التثبيت
$ install --globalskills.sh
الاستخدام

بعد التثبيت، يمكنك استخدام هذه المهارة بتشغيل الأمر التالي في الطرفية:

skills use expert-parallel-overlap