Comment by Timwi

How do you think humans experience desktop interfaces? “Basically just OCR'ing screenshots” is exactly what humans do.