Each layer has one or more artificial neurons which differ by each other for the activation function that serves the specific purpose of the layer.

Feed-Forward networks