技术栈
units
Yongqiang Cheng
3 个月前
gaussian
·
error linear
·
units
·
gelus
Gaussian Error Linear Units (GELUs)
https://arxiv.org/abs/1606.08415The Gaussian Error Linear Unit (GELU) is a high-performing neural network activation function.