teddykoker
Joined 6 years ago
Karma
361
Submissions
29
Member since
May 11
https://twitter.com/teddykoker
teddykoker.com
View on Hacker NewsRecent submissions
Comment · 9 months ago
OpenEquivariance [1] is another good baseline for with kernels for the Clebsch-Gordon tensor product and convolution, and it is fully open source. Both kernel implementations have been successfully implemented into existing machine learning interatomic potentials, e.g. [2,3].
[1] https://github.com/PASSIONLab/OpenEquivariance
Comment · 3 years ago
A related line of work is "Thinking Like Transformers" [1]. They introduce a primitive programming language, RASP, which is composed of operations capable of being modeled with transformer components, and demonstrate how different programs can be written with it, e.g. histograms, sorting. Sasha Rush and Gail Weiss have an excellent blog post on it as well [2]. Follow on work actually demonstrated how RASP-like programs could actually be compiled into model weights without training [3].
[1] https://arxiv.org/abs/2106.06981
Comment · 4 years ago
See also Radio2Speech [1] which uses a UNet to recover audio from a RF beam.
Comment · 4 years ago
Link to paper [1]. It looks like the authors construct a basic autoencoder to predict frames in videos of various videos (double pendulum, lava lamp, etc.) and then use the Levina–Bickel algorithm [2] to determine the expected "intrinsic dimension" of the latent space of the autoencoder. They then refer to the size of the intrinsic dimension as the "minimum number of variables required by the system to accurately capture the motion.", e.g. 24 for a video of a fireplace.
Personally, I wonder how much information this actually provides about a system. Since the neural network is non-linear, a single latent variable may theoretically function as more than one state variable.
[1]: https://www.nature.com/articles/s43588-022-00281-6.epdf?shar...
Comment · 4 years ago
According to [1], the byte pair encoding for “Apoploe vesrreaitais” (the words producing bird images) is "apo, plo, e</w>, ,ve, sr, re, ait, ais</w>", and Apo-didae & Plo-ceidae are families of birds.
[1] https://twitter.com/barneyflames/status/1531736708903051265?...