Don’t look backwards, LookAhead!
The LookAhead optimizer makes your model less sensitive to the choice of hyperparameters
Published in
5 min readMay 30, 2020
The task of an optimizer is to look for such a set of weights for which a NN model yields the lowest possible loss. If you only had one weight and a loss function like the one depicted below you wouldn’t have to be a genius to find the solution.
