home/categories/framework-internals/nvidia-nemo-megatron-bridge-skills-perf-techniques-expert-parallel-overlap-skill-md
framework-internalsdevelopment
expert-parallel-overlap
Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatcher backends such as DeepEP and HybridEP.
maintainer
NVIDIA-NeMo
์
๋ฐ์ดํธ๋จ 2026. 3. 31.
์คํ
560
ํฌํฌ
263
quick start
Installation and usage
Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatcher backends such as DeepEP and HybridEP.
์ค์น
$ install --globalskills.sh
์ฌ์ฉ๋ฒ
์ค์น ํ ํฐ๋ฏธ๋์์ ๋ค์ ๋ช ๋ น์ ์คํํ์ฌ ์ด ์คํฌ์ ์ฌ์ฉํ ์ ์์ต๋๋ค:
skills use expert-parallel-overlap