It's neat, but will never happen. The prototype misses the subtle intersection of all the
constraints necessary for good design on the iPad. At a high level, here are a few that you want to optimize for:
- Efficiency: how fast can the user perform the task at hand?
- Intuitivity: how likely is it the user will understand how to use it without direct instruction? (based upon trial and error, previous experience, etc.)
- Consistency: how much is it like other patterns in the same UI/environment?
- Metaphor: how much does it 'feel' like other real-world objects and leverages how the user understands them already?
These are of course a sample of high level overlapping themes. This particular prototype is obviously optimizing for efficiency. It does so very well, but at a very, very deep cost to the others. It is an undiscoverable interface. It utterly destroys the direct manipulation illusion of the iPad. It causes the virtual keys to no longer be metaphorical buttons since you can drag across them for an effect. It is inconsistent with other use of gestures, particularly since you are controlling a cursor remotely much like you would with a mouse (likely a fire-able proposition at Apple!)
The thing that makes Apple's work so amazing is the balance they manage to strike between these things and so consistently get it right. For a power user, give me vim, Maya, Photoshop, and other tools that optimize for efficiency (much like this prototype does.) But when designing things that are meant to be universally available, a more subdued and balanced approach across these types of constraints is necessary.
- Efficiency: how fast can the user perform the task at hand?
- Intuitivity: how likely is it the user will understand how to use it without direct instruction? (based upon trial and error, previous experience, etc.)
- Consistency: how much is it like other patterns in the same UI/environment?
- Metaphor: how much does it 'feel' like other real-world objects and leverages how the user understands them already?
These are of course a sample of high level overlapping themes. This particular prototype is obviously optimizing for efficiency. It does so very well, but at a very, very deep cost to the others. It is an undiscoverable interface. It utterly destroys the direct manipulation illusion of the iPad. It causes the virtual keys to no longer be metaphorical buttons since you can drag across them for an effect. It is inconsistent with other use of gestures, particularly since you are controlling a cursor remotely much like you would with a mouse (likely a fire-able proposition at Apple!)
The thing that makes Apple's work so amazing is the balance they manage to strike between these things and so consistently get it right. For a power user, give me vim, Maya, Photoshop, and other tools that optimize for efficiency (much like this prototype does.) But when designing things that are meant to be universally available, a more subdued and balanced approach across these types of constraints is necessary.