get
Get activations by identifier
identifier (str or callable) – the identifier of activations
callable activation
softplus2
out = log(exp(x)+1) - log(2) softplus function that is 0 at x=0, the implementation aims at avoiding overflow
x – (Tensor) input tensor
(Tensor) output tensor