Yeah, ELT is really pretty simple it gets hyped up too much as being super innovative. DEV time is expensive so optimize for it instead of saving CPU cycles / disk space.
Instead of trying to save space in your destination app by filtering data and only pushing what you need into your Database/Datawarehouse (Snowflake, Redshift, Postgres, MSSQL, etc) throw all of your data from your sources into the Database. They are super fast and storage is cheap. The expensive thing now is DEV time so optimize for that.
Instead of trying to save space in your destination app by filtering data and only pushing what you need into your Database/Datawarehouse (Snowflake, Redshift, Postgres, MSSQL, etc) throw all of your data from your sources into the Database. They are super fast and storage is cheap. The expensive thing now is DEV time so optimize for that.