astramind-ai/Mixture-of-depths

Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

语言：Python · GitHub 星标：176 · Fork：16

在 GitHub 上查看原仓库