Watch a demo on what Laktory, the dataframecentric open source ETL framework is all about!
We will cover how to:
Declare a data pipeline backed by Polars dataframes and run it locally
Change backend to Spark dataframe and run it on a Databricks cluster
Deploy as a databricks job and as a Delta Live Tables using Laktory CLI
Okube and Laktory are official Databricks partners.
https://www.okube.ai
https://www.laktory.ai