Alex Open Research Wiki

Tag: attention

4 items with this tag.

  • Sep 28, 2026

    Use What You Know: Causal Foundation Models with Partial Graphs

    • causality
    • foundation-models
    • partial-graphs
    • attention
    • in-context-learning
  • Jun 30, 2026

    Oryx

    • entity
    • hybrid-models
    • long-context
    • recurrent-state
    • attention
    • fixed-flops
  • Jun 30, 2026

    Multi-Mixer Models: Flexible Sequence Modeling with Shared Representations

    • hybrid-models
    • long-context
    • recurrent-state
    • attention
    • inference-efficiency
    • fixed-flops
  • May 18, 2026

    WavSpA: Wavelet Space Attention for Boosting Transformers' Long Sequence Learning Ability

    • transformers
    • attention
    • wavelets
    • long-sequence-modeling

Created with Quartz v4.5.2 © 2026