home/categories/machine-learning/ecnu-icalk-autoskill-skillbank-convskill-english-gpt4-8-glm4-7-pytorch-moe-transformer-training-with-custom-gelu-and-metrics-skill-md
machine-learningdata-ai
pytorch-moe-transformer-training-with-custom-gelu-and-metrics
Configure and train a Mixture of Experts (MoE) Transformer model in PyTorch, implementing a custom GELU activation function, learning rate warmup, and comprehensive evaluation metrics (Precision, Recall, F1).
maintainer
ECNU-ICALK
Обновлено 3/13/2026
Звёзды
304
Форки
34
quick start
Installation and usage
Configure and train a Mixture of Experts (MoE) Transformer model in PyTorch, implementing a custom GELU activation function, learning rate warmup, and comprehensive evaluation metrics (Precision, Recall, F1).
Установка
$ install --globalskills.sh
Использование
После установки вы можете использовать этот skill, выполнив следующую команду в терминале:
skills use pytorch-moe-transformer-training-with-custom-gelu-and-metrics