Activation Functions in DNN

Heilbronn Germany (Picture Credit: Srijay Kolvekar)
Biological vs Artificial Neuron
Neuron with activation function

Linear activation function

Linear activation function
Linear activation function

Nonlinear activation function

Unit step function
Unit Step Function
sign function
Sign activation function
Sigmoid function
Sigmoid activation function
Tanh function
Hyperbolic tan activation function
Relu function
ReLU activation function
Leaky ReLU

Deep Learning Enthusiast | Masters Student University of Stuttgart.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store