Getting ready

A deep neural network means that there are multiple hidden layers connecting the input to the output layer. Multiple hidden layers ensure that the neural network learns a complex non-linear relation between the input and output, which a simple neural network cannot learn (due to a limited number of hidden layers).

A typical deep feedforward neural network looks as follows: