Wait, are you literally saying that modern LLMs are not "magic" (or AGI) because we know how it works?
If that is the case, then it trivially follows that humanity will never be able to build AGI, because every time we build something new, we will understand how we built it, which disqualifies it from being an AGI.
But that doesn't seem like a useful definition to me.
If that is the case, then it trivially follows that humanity will never be able to build AGI, because every time we build something new, we will understand how we built it, which disqualifies it from being an AGI.
But that doesn't seem like a useful definition to me.