Comment by z3t4

Did you use WiFi? An old Wifi router can easily add half a second of latency. Even high end Wifi endpoint still adds a few ms of latency which can be significant considering that short distances (20 miles) of fiber has sub ms latency. A software router or switch can also add up to a ms of latency. Could also try SSH (tunnel) instead of VPN as SSH encryption might be faster.