Data Engineer Project: An endtoend Airflow data pipeline with BigQuery, dbt Soda, and more!

BECOME A PRO WITH AIRFLOW: https://www.udemy.com/course/thecomp...

In the Retail data pipeline project, you will learn:
➡ How to create a data pipeline in Airflow from scratch
➡ How to set up your Airflow local environment with the Astro CLI
➡ How to run data quality checks in your pipeline with Soda
➡ How to integrate dbt and run your models with Airflow and Comos
➡ How to isolate tasks to avoid dependency conflicts
➡ How to upload a CSV file into Google Cloud Storage
➡ How to ingest data into a BigQuery table using the Astro SDK
and more!

This a complete 1hr project just for you ❤

Here are the steps with the code snippets:
https://robustdinosaur2ef.notion.si...

Fasten your seatbelt, take a deep breath, and.... let's go!