Mish

$$\text{Mish}(x)=x\cdot \tanh (\text{softplus}(x))$$

torch
Github

Apparently acts as regularization.

Loss landscape visualization / comparison