home/categories/framework-internals/ecnu-icalk-autoskill-skillbank-convskill-english-gpt4-8-glm4-7-implement-moe-mamba-model-for-text-generation-skill-md
framework-internalsdevelopment
implement-moe-mamba-model-for-text-generation
Implement a PyTorch-based MoE-Mamba model featuring an input-dependent selection mechanism and Mixture of Experts (MoE) layer for text generation tasks, including data loading, training, and evaluation workflows.
maintainer
ECNU-ICALK
Updated 3/13/2026
Stars
304
Forks
34
quick start
Installation and usage
Implement a PyTorch-based MoE-Mamba model featuring an input-dependent selection mechanism and Mixture of Experts (MoE) layer for text generation tasks, including data loading, training, and evaluation workflows.
Installation
$ install --globalskills.sh
Usage
Once installed, you can use this skill by running the following command in your terminal:
skills use implement-moe-mamba-model-for-text-generation