I'm new in ML. While I was reading about backpropagation Suddenly, I have question.
In backpropagation learning of a neural network,
Do we should start with a small learning rate and slowly increase it during the learning process? or
Do we should start with big learning rate and slowly reduce it during the learning process?
Which one is correct?