It is beyond our capabilities in a reasonable time frame. It is within our current capabilities to use LLMs to build it. This is the first problem.
The second problem, is that the system doing the reading/interpretation will most likely be another LLM.
Would you really entrust monitoring a potentially dangerous LLM to a system that uses LLMs and was built by them?
It's already established that LLMs have capability to lie, and they can prevent their true intent from showing up in the thought stream if they expect someone is looking (demonstrated by OpenAI a while back; their report asked everyone to not do RL on thought streams, as doing so just trains agents to hide their thoughts better). And as we've seen recently, they're more than happy to spontaneously collaborate.
The second problem, is that the system doing the reading/interpretation will most likely be another LLM.
Would you really entrust monitoring a potentially dangerous LLM to a system that uses LLMs and was built by them?
It's already established that LLMs have capability to lie, and they can prevent their true intent from showing up in the thought stream if they expect someone is looking (demonstrated by OpenAI a while back; their report asked everyone to not do RL on thought streams, as doing so just trains agents to hide their thoughts better). And as we've seen recently, they're more than happy to spontaneously collaborate.