Dorsal Stream

Computer Vision and Machine Learning

© 2020 Dushyant Mehta

Linking Regularization and Learning Rate For Better Generalization in NNs

Summary of some experiments concerning increasing the explicit regularization as the learning rate is decreased in the hopes of achieving better generalization performance.

Extended abstract PDF (Couldn’t be bothered to copy it all here)