Triton implementation of FlashAttention2 that adds Custom Masks.
语言:Python · GitHub 星标:180 · Fork:16
话题:attention · attention-mechanism · cuda-kernels · deep-learning · flash-attention · flash-attention-2 · triton · triton-lang
在 GitHub 上查看原仓库