How to build an ELT pipeline in 1 hour, using industry standard tools such as dbt, Snowflake and Airflow. This is a live coding tutorial, where I’ll walk you through the thinking process, and show you every step. We’ll cover basic data modeling techniques (fact tables, data marts), snowflake RBAC concepts, and how to orchestrate a dbt project using Airflow. Drop down in the comments section what Data Engineering topics you would like to see in the future!

Timestamps ⏰
0:00 Intro
1:35 Setup dbt + Snowflake
7:52 Configure dbt_project.yml and packages
11:45 Create source and staging tables
17:41 Transformed models (fact tables, data marts)
20:25 Macro functions
24:23 Generic and singular tests
29:35 Deploy models using Airflow

Live Coding notes
https://bittersweetmallf00.notion.s...

Who am I? ‍♂
I'm Jay, I love making videos about travel, selfhelp and tech. I currently work in New York City as a data engineer, but I grew up in Malaysia and lived in the UK when I was 19. Back then, I had no idea what life was about, moving to so many places, navigating career in Tech. Today, I've learned a lot and wanna share my perspective through filmmaking.

Socials
linkedin:   / jayzern  
insta:   / jayzern  

Sub Count: 7,163