skills.homes logoskills.homescapability registry
home/categories/machine-learning/benchflow-ai-skillsbench-tasks-mhc-layer-impl-environment-skills-nanogpt-training-skill-md
cd ..
machine-learningdata-ai

nanogpt-training

Train GPT-2 scale models (~124M parameters) efficiently on a single GPU. Covers GPT-124M architecture, tokenized dataset loading (e.g., HuggingFace Hub shards), modern optimizers (Muon, AdamW), mixed precision training, and training loop implementation.

سورس دیکھیںmachine-learning
benchflow-ai
maintainer
benchflow-ai
اپ ڈیٹ ہوا 1/19/2026
اسٹارز
946
فورکس
244
quick start

Installation and usage

Train GPT-2 scale models (~124M parameters) efficiently on a single GPU. Covers GPT-124M architecture, tokenized dataset loading (e.g., HuggingFace Hub shards), modern optimizers (Muon, AdamW), mixed precision training, and training loop implementation.

انسٹالیشن
$ install --globalskills.sh
استعمال

انسٹال کرنے کے بعد، آپ یہ اسکل ٹرمینل میں درج ذیل کمانڈ چلا کر استعمال کر سکتے ہیں:

skills use nanogpt-training