Comment by jancsika

Could you build this into a protocol?

Like an ssh setting that only allows incoming connections that can prove (well, suggest) their proximity by a series of latency tests?