Activation Functions in DNN

Heilbronn Germany (Picture Credit: Srijay Kolvekar)

In artificial neural networks, activation function plays an important role in determining the output of the neuron. To make it sound more realistic, we can simply compare the activation function to the biological neurons which fire the signal to other connected neurons.