Comment Comment by go_prodev GELU really is like magic:UNARY(GELU, b / 2 * (1 + tanh(.7978845 * (b + .044715 * b * b * b)))) parent go_prodev 1 year ago
UNARY(GELU, b / 2 * (1 + tanh(.7978845 * (b + .044715 * b * b * b))))