15

Do we have to scale input data for neural network? How does it affect the final solution of neural network?

I've tried to find some reliable sources on that. The book "elements of statistical learning" (page 400) says it will help choosing reasonable initial random weights to start with.

Aren't the final weights deterministic regardless of the initial random weights we use?

Thank you.

1 Answer 1

20

Firstly, there are many types of ANNs, I will assume you are talking about the simplest one - multilayer perceptron with backpropagation.

Secondly, in your question you are mixing up data scaling (normalization) and weight initialization.

You need to randomly initialize weights to avoid symmetry while learning (if all weights are initially the same, their update will also be the same). In general, concrete values don't matter, but too large values can cause slower convergence.

You are not required to normalize your data, but normalization can make learning process faster. See this question for more details.

Your Answer

Reminder: Answers generated by Artificial Intelligence tools are not allowed on Stack Overflow. Learn more

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.