Alex Open Research Wiki
Search
Search
Dark mode
Light mode
Explorer
Tag: information-theory
2 items with this tag.
Jun 20, 2026
LLMs as Noisy Channels
entity
llm-scaling-laws
information-theory
training-dynamics
Jun 20, 2026
LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
llm-scaling-laws
information-theory
training-dynamics
quantization
supervised-fine-tuning