Initialize the activation function for each neuron

model.setActivationFunction(ftype)
model.setActivationFunction(ftype, 'OptionName', optionValue, ...)

Input

• ftype: The type of activation function. default 'Sigmoid'. Possible activation functions:
  • Identity Identity function: f(x) = x
  • Sigmoid Symmetrical sigmoid: f(x) = beta * (1-exp(-alpha*x))/(1+exp(-alpha*x)). See note below.
  • Gaussian Gaussian function: f(x) = beta * exp(-alpha*x*x)

Options

• Param1 The first parameter of the activation function, alpha. default 0
• Param2 The second parameter of the activation function, beta. default 0

Currently the default and the only fully supported activation function is 'Sigmoid'.

Note

If you are using the default Sigmoid activation function with the default parameter values Param1=0 and Param2=0 then the function used is y = 1.7159*tanh(2/3 * x), so the output will range from [-1.7159, 1.7159], instead of [0,1].