Just as a quick follow up, I completely forgot about the tool BackupLoupe[1]. It allows you to slice into your existing Time Machine backups and find out all manner of information on what's going on, what is backed up, when and what is taking up so much space.
[1]: https://www.soma-zone.com/BackupLoupe/