nharbour + annealing   4

Train your deep model faster and sharper — two novel techniques
I explain Snapshot Ensembling and FreezeOut that aim to boost accuracy and make deep learning take less time.
learning-rate  annealing  cosine  deep-learning  fastai  cyclical 
december 2017 by nharbour
Learning Rate Schedules and Adaptive Learning Rate Methods for Deep Learning
When training deep neural networks, it is often useful to reduce learning rate as the training progresses. This can be done by using pre-defined learning rate schedules or adaptive learning rate…
learning-rate  annealing  deep-learning  decay 
december 2017 by nharbour

Copy this bookmark: