Variants of RMSProp and Adagrad with Logarithmic Regret Bounds

VariantsofRMSPropandAdagradwithLogarithmicRegretBoundsMaheshChandraMukkamala12MatthiasHein1AbstractThegoalofthispaperistwofold.First,weproposeSC-AdagradwhichisavariantofAdagradadaptedtotheAdaptiveg...