Alex Open Research Wiki

Tag: credit-assignment

4 items with this tag.

  • Oct 25, 2026

    Dust: Pretraining Transformers Without Backpropagation

    • zeroth-order
    • activation-perturbation
    • credit-assignment
    • pretraining
  • Oct 25, 2026

    SOMA: Scaling Zero-Order Pretraining through Model Sharding

    • zeroth-order
    • recurrent-models
    • ensembles
    • credit-assignment
    • training-efficiency
  • Oct 25, 2026

    Scaling Recurrent Neural Networks to a Billion Parameters with Zero-Order Optimization

    • zeroth-order
    • recurrent-models
    • bptt
    • credit-assignment
  • Oct 25, 2026

    Forward-Only Sequence Training

    • zeroth-order
    • credit-assignment
    • recurrent-models
    • bptt
    • training-efficiency

Created with Quartz v4.5.2 © 2026