Comment by lowdose

Migrate to bigquery, twitter runs on it. No storage cost and you can plugin google datastudio, bigqueryml and automate a lot with cloud-functions. Show them how to do better and graduate on that. They will thank you for it because of the complexity you have removed for all your colleagues.