dm.cs.tu-dortmund.de/en/mlbits/class-nnet-regularization/
Regularization Techniques for Neural Networks – Lecture Notes
{\text{standard SGD}}}} \textcolor[RGB]{132,184,24}{{}+\frac{2\lambda }{n} w_{i,j}^{(t)}} \right) \\[3ex] w_{i,j}^{(t+1)} & = w_{i,j}^{(t)} \left(1-\frac{2\lambda }{n}\right) - \eta _i \frac{\partial \m …