That's a good point. It may be possible to directly upload predicate-type info into a LLM. This could be especially useful if you need to encode tabular data.
Somewhere, someone probably read this and is thinking about how to export Excel or databases to an LLM.
It's encouraging to see people looking inside the black box successfully.
The other big result in this area was that paper which found a representation of a game board inside a LLM after the LLM had trained to play a game. Any other good results in that area?
The authors point out that LLMs are doing more than encoding predicate-type info. That's just part of what they are doing.
It's encouraging to see people looking inside the black box successfully. The other big result in this area was that paper which found a representation of a game board inside a LLM after the LLM had trained to play a game. Any other good results in that area?
The authors point out that LLMs are doing more than encoding predicate-type info. That's just part of what they are doing.