Comment Comment by Hawkenfall A more in-depth paper about this found the Swish activation often outperformed other functions: https://arxiv.org/abs/1710.05941 parent Hawkenfall 7 years ago
