Comment by Tcepsa

Presumably it captures a screenshot and then uses CV on the resulting image to "see" the application and identify the various things that you might want to click.