We know that transformers can generalize within the training set. We know that transformers can make connections between wildly different domains (at least when prompted).
Of course it can't generalize beyond training - why would it? But at the same time, there is probably huge amounts of value lurking INSIDE the training data that humans haven't unlocked yet.
We know that transformers can generalize within the training set. We know that transformers can make connections between wildly different domains (at least when prompted).
Of course it can't generalize beyond training - why would it? But at the same time, there is probably huge amounts of value lurking INSIDE the training data that humans haven't unlocked yet.