home/categories/machine-learning/ecnu-icalk-autoskill-skillbank-convskill-chinese-gpt4-8-pytorch-dynamic-loss-weighting-skill-md
machine-learningdata-ai

pytorch-dynamic-loss-weighting

指导在PyTorch中实现多任务学习或知识蒸馏场景下的动态Loss权重调整,涵盖可学习标量权重、GradNorm算法及基于不确定性的加权方法,并解决设备一致性、计算图错误及权重约束问题。

ECNU-ICALK
maintainer
ECNU-ICALK
Updated 3/16/2026
Stars
304
Forks
34
quick start

Installation and usage

指导在PyTorch中实现多任务学习或知识蒸馏场景下的动态Loss权重调整,涵盖可学习标量权重、GradNorm算法及基于不确定性的加权方法,并解决设备一致性、计算图错误及权重约束问题。

Installation
$ install --globalskills.sh
Usage

Once installed, you can use this skill by running the following command in your terminal:

skills use pytorch-dynamic-loss-weighting