In forward-propagation, we connected the input layer to the hidden layer to the output layer. In back-propagation, we take the reverse approach.
