GradNorm Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks

GradNorm:GradientNormalizationforAdaptiveLossBalancinginDeepMultitaskNetworksZhaoChen1VijayBadrinarayanan1Chen-YuLee1AndrewRabinovich1Abstractsuchassmartphones,wearabledevices,androbots/drones.Such...