Data Engineering

Things to know

Everything I have learned since the beginning about Data Engineering is a very bland overview.

It seems really simple but it’s not.

##A standard ETL pipeline works like this.

-Extract the data -Transform the data -Load the data.

Sounds simple enough. But that is only first stages.

Now lets go into more detail.

What data source are you extracting from? CSV, API, Excel Workbook, Text,