ELU (Exponential Linear Unit) is the smoother Leaky ReLU. It softens the corner at zero by letting the negative side curve downward exponentially toward a fixed floor at -α, instead of continuing as a flat-rate line that bleeds forever.
Members read on: the worked example and the full walkthrough.



