During a Google podcast below[1] a host (reportedly with a PhD in Quantum Mechanics) expressed a similar opinion as you at first, then started to take the threat more seriously as he heard from an experienced Google colleague.. This was in 2024 before the Google Willow announcement[2]. Thank you for your thoughtful response!
1. https://cloud.withgoogle.com/cloudsecurity/podcast/ep164-qua...
2. https://blog.google/technology/research/google-willow-quantu...