The Modern Data Stack gives us a wide range of free technology for data ingestion, data storage, data transformation, data orchestration, and data visualization.

Pedram Navid, Head of Data Engineering and DevRel at Dagster, walks us through one data pipeline design using a number of opensource solutions, including Dagster, dbt, PopSQL, and the Mastodon API, DuckDB, dbtduckdbt, Evidence, Sling and Steampipe.

The pipeline is used to analyze bird observation data from the Cornell Lab.

Github Repo: https://github.com/dagsterio/mdsfest...
Source Data: https://feederwatch.org/explore/rawd...

Try Dagster today with a 30day free trial: https://dagster.io/lp/dagstercloudt...