Comment Comment by famouswaffles Exactly. Feed a sequence of proteins to a transformer and biological structure and function will emerge in the inner layers.https://www.pnas.org/doi/full/10.1073/pnas.2016239118Why? Because it needs to learn that to make correct predictions.All it takes to incentive a transformer to learn something is data that would require learning it to predict.It's fairly obvious (and not just because of this) that LLMs model emotion somehow. They need to. parent famouswaffles 3 years ago
https://www.pnas.org/doi/full/10.1073/pnas.2016239118
Why? Because it needs to learn that to make correct predictions.
All it takes to incentive a transformer to learn something is data that would require learning it to predict.
It's fairly obvious (and not just because of this) that LLMs model emotion somehow. They need to.