[KongchangAI]
Concept

GradNorm

A gradient balancing strategy in multi-task learning that dynamically adjusts the loss weights of each task so that gradient norms tend toward consistency, thereby alleviating gradient conflicts among tasks.

Timeline (last 90 days)

Oct 22

GradNorm dynamically adjusts the loss weights of each task to make gradient norms converge, and PCGrad projects and resolves conflicts when gradient directions clash.

Unverified50%

All Facts (1)

Source Articles