> . Sure, it's imperfect (models can exhibit deceptive CoT). But given how difficult mech interp is, it's the best we have.
maybe someone can help me understand.
when ppl write comments on reddit. They dont write thinking process, even if we wanted to we dont know how we derived a particular thought. Thinking doesnt work like that.
So how cant cot possibly be not total bs outside narrow math like thoughts where things are derived. Even there its not clear how mathematician had that insightful thinking step.
Back to 'safety' most of unsafe thoughts fall in bucket 1 right? so how is cot even remotely useful there.
maybe someone can help me understand.
when ppl write comments on reddit. They dont write thinking process, even if we wanted to we dont know how we derived a particular thought. Thinking doesnt work like that.
So how cant cot possibly be not total bs outside narrow math like thoughts where things are derived. Even there its not clear how mathematician had that insightful thinking step.
Back to 'safety' most of unsafe thoughts fall in bucket 1 right? so how is cot even remotely useful there.