Landscape

• Linear attention, 2020
• Delta Net, 2021
• Log-linear attention

Related

• Reformer, 2020