Alex Open Research Wiki

Tag: linear-attention

8 items with this tag.

  • Jul 17, 2026

    Gated DeltaNet

    • entity
    • linear-attention
    • recurrent-state
    • state-space-models
    • long-context
    • hybrid-models
  • Jul 17, 2026

    Hippocampal Linear Attention

    • entity
    • linear-attention
    • recurrent-state
    • exact-memory
    • kv-cache
    • long-context
  • Jul 17, 2026

    Gated Delta Networks: Improving Mamba2 with Delta Rule

    • linear-attention
    • recurrent-state
    • state-space-models
    • long-context
    • inference-efficiency
    • hybrid-models
  • Jul 17, 2026

    A Hippocampus for Linear Attention: An Exact Memory for What the Recurrent State Forgets

    • linear-attention
    • recurrent-state
    • exact-memory
    • kv-cache
    • associative-recall
    • long-context
    • inference-efficiency
  • Jun 30, 2026

    Gated DeltaNet-2

    • entity
    • linear-attention
    • recurrent-state
    • state-space-models
    • long-context
  • Jun 30, 2026

    Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention

    • linear-attention
    • recurrent-state
    • state-space-models
    • long-context
    • inference-efficiency
  • Jun 19, 2026

    LT2

    • entity
    • looped-transformers
    • linear-attention
    • sparse-attention
    • long-context
  • Jun 19, 2026

    LT2: Linear-Time Looped Transformers

    • looped-transformers
    • linear-attention
    • sparse-attention
    • long-context
    • parameter-efficiency

Created with Quartz v4.5.2 © 2026