gelus

Yongqiang Cheng4 个月前
gaussian·error linear·units·gelus
Gaussian Error Linear Units (GELUs)https://arxiv.org/abs/1606.08415The Gaussian Error Linear Unit (GELU) is a high-performing neural network activation function.