Comment by uxcolumbo

Are there any cheaper alternatives to Databricks, EC2, DynamoDB, S3 solution? Where cost is more predictable and controlled?

What's a good roll your own solution? DB storage doesn't need to be dynamic like with DynamoDB. At max 1TB - maybe double in the future.

Could this be done on a mid size VPS (32GB RAM) hosting Apache Spark etc - or better to have a couple?

P.S. total beginner in this space, hence the (naive) question.