However, having several layers in a deep neural network, each with several neurons that are fully connected, we usually have hundreds and thousands of weights and biases that define the value of the cost function. Therefore, the cost function in a deep learning can take complex forms, with more than one minimum.