machine learning

Learning rate finder and Cyclical Learning Rates for Neural Networks with CIFAR10 – Keras R

By: jlao

On: 01/01/2019

In this post, we will verify the technique developed in 2015 and described in the paper Cyclical Learning Rates for Training Neural Networks. This technique describes a new method for changing the learning rate on each iteration (or batch) inread more →

Changing learning rate during training on each batch/iteration (using callbacks in R keras)

By: jlao

On: 27/12/2018

In this post, we will explain how to change the learning rate in each iteration or batch in the training process of a Keras model using R language. Change the learning rate (lr) in each epoch is usually the mostread more →