ggsp
Joined 12 years ago
Joined 12 years ago
For anyone wondering, the thing lives at https://compile-xc.org/ ;)
I'd argue that evolution has accomplished plenty of incredibly complex designs without an ounce of consciousness in play—much more complex than anything humanity has made. And I'd add that even we puny humans have been able to create intelligence without consciousness, meaning the concept of one being orthogonal to the other does not at all seem far fetched to me.
I think Blindsight quickly runs into questions which people will disagree on rather strongly, based on their beliefs and world views. Which I'd say is a marker of a good sci-fi book.
I can’t yet. I think that I'd want at least two things it doesn't have: the ability to retain what it learned yesterday (without me carrying it in the context window and thus micromanaging it), and the ability to prioritize correctly, i.e. tell which of the n things it could do next is the one that actually matters.
Can't say for sure that those are enough, but not having them seems to be most of why I still have to "babysit" these incredible tools.