alevskaya
Joined 14 years ago
Joined 14 years ago
I was an experimental synbio person for decades, and I did plenty of microbial pathogen work. I've also worked on frontier LLMs for the last decade. All of this stuff is gated by experimental effort, not AI!
Alphafold can't reliably predict thermal energy landscapes or make functional predictions - and how could it? It wasn't trained on anything that could capture structure - function relationships.
Again, most people just have no idea how hard - fundamentally hard - molecular physics is to predict, and how necessary experiments are for any development of biological systems.
It's the fact that the complexity of molecular physics scales exponentially in particle number. No amount of thinking is going to punch through that. You've got to do experiments. The slow loop through reality is not optional, and in the case of "superviruses" would require a lot of iterative experimental development in humans.
(And please knock off the bio infohazard act - I routinely get asked about scenarios that AIxBio safety people cook up and they always involve some howler misunderstanding of basic facts in biology or medicine. Just talk about an idea if you have it.)
The biorisk scenarios that the AI safety folks flog are fever-dreamed fantasies that have only the most tenuous connection to biological reality. As someone who cares about the real bio-risks of natural pathogens, I get pretty tired of fear-based marketing pretending that AI is a bigger threat than, say, animal agriculture.
JAX/XLA does offer some really nice tools for doing automated sharding of models across devices, but for really large performance-optimized models we often handle the comms stuff manually, similar in spirit to MPI.
The odd set of claims is that somehow biology has 1) figured out how to preserve long-range entanglement and coherent states at 300K in a solvated environment when we struggle to do so in cold vacuum for quantum computing and 2) somehow still manages to selectively couple this to the -known- neuronal computational processes that are experimentally proven to be essential to thought and consciousness.
This more or less amounts to assertions that "biology is magic" without any substantive experimental evidence over the last thirty years that any of the above is actually happening. That's why most biophysicists and neuroscientists don't take it at all seriously.
It's hard to buy that their proposed stories are the simplest explanation for these few measurements. Much more boring phenomena can influence QY. e.g. simply occluding fluorophores from the bulk solvent can have a huge influence on QY and spectra. (I used to design biological fluorescent reporter reagents...)
It's hard to buy that their proposed stories are the simplest explanation for these few measurements. Much more boring phenomena can influence QY. e.g. simply occluding fluorophores from the bulk solvent can have a huge influence on QY.
Fold prediction is an incredibly useful tool for scientists and genetic engineers to help design new proteins, but it doesn't magically solve molecular or cell biology. Designing new functions and mechanisms is still going to involve a huge amount of labor and brute-force experimentation.
I certainly don't think it will help at all with stability. Things like Q/K layernorm are better tricks for softmax stability when scaling: https://arxiv.org/pdf/2302.05442.pdf