This is probably a silly question, but is the internal monologue useful training data? It's where the work is done, but without the input or output, it seems hard to get any useful context.
In other words, what would the data be used to train for? It has to improve some kind of objective function. But it's a little hard to see what the objective function would be if it's just raw inner monologue.
In other words, what would the data be used to train for? It has to improve some kind of objective function. But it's a little hard to see what the objective function would be if it's just raw inner monologue.