Activation function [Google Scholar] [Wikipedia] Notes: neural network, RELU, softmax Papers: Function used to compute output of a node from the inputs. Has to be non-linear. Notes related to Activation function Rectified linear unit (RELU), Soft max
