Alex Open Research Wiki
Search
Search
Dark mode
Light mode
Explorer
Tag: pretraining
3 items with this tag.
Oct 25, 2026
Dust
activation-perturbation
zeroth-order
pretraining
Oct 25, 2026
Dust: Pretraining Transformers Without Backpropagation
zeroth-order
activation-perturbation
credit-assignment
pretraining
Oct 25, 2026
Noise: Speedrun for Pretraining without Backpropagation
zeroth-order
benchmark
speedrun
pretraining
compute-accounting