What is the role of activation functions in neural networks?

Activation functions determine whether a neuron should be activated or not, influencing how the network learns and models non-linear relationships. Common activation functions include:
Sigmoid: Maps input values between 0 and 1.
ReLU (Rectified Linear Unit): Maps negative values to zero and keeps positive values unchanged.
Tanh: Maps input values between -1 and 1.