From my reading we're in agreement basically. The only real difference is that I think AGI is destined to ultimately describe ship's computer but not Data based on current trajectory—largely because trillions of dollars really want to slap that term on a product.
And I don't really think it's entirely unreasonable because there does actually seem to be a real gap in terminology. Even Star Trek didn't really imagine a computer system that's general but exists without consciousness, the whole message of the Exocomp story
is exactly that—it's a huge breakthrough that they invented a general system and it
turns out to be conscious. And the show makes a point that while the computers they have are incredibly advanced it's ultimately the product of human programming. We seem to just have assumed that any general
system would be conscious and the term AGI was born of that assumption.
And I don't really think it's entirely unreasonable because there does actually seem to be a real gap in terminology. Even Star Trek didn't really imagine a computer system that's general but exists without consciousness, the whole message of the Exocomp story is exactly that—it's a huge breakthrough that they invented a general system and it turns out to be conscious. And the show makes a point that while the computers they have are incredibly advanced it's ultimately the product of human programming. We seem to just have assumed that any general system would be conscious and the term AGI was born of that assumption.