“Broken Neural Scaling Laws”; New Scaling Law; SotA Extrapolation of All Things 2 evc123 4 years ago 0 comments
What do we already know about Generalization? What should we ask next about it? r reddit.com 1 evc123 8 years ago 0 comments
Revisiting Small Batch Training for Deep Neural Networks g graphcore.ai 2 evc123 8 years ago 0 comments
Revisiting Small Batch Training for Deep NNs; batch_size less than 64 is best a arxiv.org 1 evc123 8 years ago 0 comments
Prefrontal cortex as a meta-reinforcement learning system [DeepMind] b biorxiv.org 3 evc123 8 years ago 0 comments
The scaling laws have broken: https://arxiv.org/abs/2210.14891