I am reading some texts for deep learning, but everyone seems to take it as self-explanatory. :)
My understanding is that the activation function gets a WX + b
which equals, lets say 1.745, as an input and returns a...value. What does this value represent? Is it just a new "weight"? Is it something else?