sageattention2

jerwey1 天前
sageattention2
SageAttention2原理和计算过程SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization