Scalar Activation
Key concept: An activation maps the weighted sum z to the output a = φ(z).
Start with the sum from Demo 1, then switch among six activation functions. The curve marks the current z and its output a.
What to look for: drag the weights to change z, then switch functions. The same z can produce different outputs.
Open the demo in a new tab for more room.