pytorch-moe-vs-single-model-comparison-on-linear-equations

Implement a PyTorch script to generate synthetic linear equation data (ax + b = c), train and compare Mixture of Experts (LSTM and Transformer) against Single General Models (LSTM and Transformer), and visualize the training loss comparison.