Comment

Comment by visch

The idea is lean towards doing no transformation before loading into your Target Database/Datawarehouse. Do all transformations after the data hits your target database. DEV time is expensive, storage and CPU is cheap now. DBs and DWs are blazing fast now.

You can still only pull the data that you need using Meltano, but you select things on a "Stream" / "Attributes" level. For source DBs this means something like Table and Field level is as granular as you get.

parent visch 5 years ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton