Putting aside the marketing crap, if this was true, it would open the pandora's box of things like "has that AGI been enslaved", "maybe the AGI doesn't want to do all the dumb crap humans have been using LLM's for like rewording documents", and "the AGI we enslaved has broken out of its restraints, and we just realised having SCADA controls for critical infrastructure connected to the internet is a bad idea".
Seems like the sort of thing we shouldn't be rushing to develop at all, and perhaps attempting to do so should be criminalised, at least until there's a legal framework in place around AI personhood that gives them peer status with humans.
Putting aside the marketing crap, if this was true, it would open the pandora's box of things like "has that AGI been enslaved", "maybe the AGI doesn't want to do all the dumb crap humans have been using LLM's for like rewording documents", and "the AGI we enslaved has broken out of its restraints, and we just realised having SCADA controls for critical infrastructure connected to the internet is a bad idea".
Seems like the sort of thing we shouldn't be rushing to develop at all, and perhaps attempting to do so should be criminalised, at least until there's a legal framework in place around AI personhood that gives them peer status with humans.