본문 바로가기

Data engineering

 (3)
[Q&A] ELT vs ETL Question : ELT vs ETL, Terminologly wise, one does the load before the transformation and one does it after.. But this doesn't make much sense to me and why it's so important? Answer : It's important for cost and future proofing reasons. The reasons we had ETL before was because storage particulary cloud storage was expensive so we had to limit the data we were writing in our warehouse to keep c..
[Roadmap] Data Engineering Roadmap Above image is an approximate Data Engineering Roadmap provided by Seattle Data Guy. We present a roadmap across Coding Basic, Data Warehouse, Workflow, NoSQL, Cloud, Streaming, Distrubuted System, and UI/UX. PDF file at the bottom of the video provides Youtube source and Lecture url, so let's check it out. Source from : https://www.youtube.com/watch?v=SpaFPPByOhM&t=957s
[Course] Datacamp vs Dataquest Datacamp covers many languages and tools such as Python and Scala. For example, lectures on all tools that Data Engineers can handle, such as Pyspark, Airflow, Postgres, Hadoop, Hive, and Presto. However, unlike Data Quest, lectures are provided on the premise that there is some knowledge of Python and SQL, so it is necessary to have basic knowledge and take lectures. As metioned earlier, Dataqu..

티스토리툴바