A concise analysis of roles and types of activation functions in neural networks. Detailed pros and cons of 5 popularly used ones in an Artificial Neural Network. — Activation function, as the name suggests, decides whether a neuron should be activated or not based on the addition of a bias with the weighted sum of inputs. Hence, it is a very significant component of Deep Learning, as they in a way determine the output of models. …