Comment by imenani

That’s fair. Some of what happened in OAI<>HF incident was (mis)-generalisation and not directly trained for.

However, the article experiments with five agents. So it seems to assume even the small scale behaviour is emergent.

Also, “roles and structures” may well have been learned during training.