Grow your YouTube views, likes and subscribers for free
Get Free YouTube Subscribers, Views and Likes

How To | Lakehouse as Code ep. 03 | Data Pipeline Jobs

Follow
okube

Welcome to the Lakehouse as Code miniseries! In this series, we'll guide you stepbystep through deploying a complete lakehouse using Laktory with infrastructure as code. From Unity Catalog setup to orchestrating data pipelines and configuring your workspace, we’ve got everything covered.

Before watching this episode, make sure to watch previous ones:
01. Unity Catalog
   • How To | Lakehouse as Code ep. 01 | U...  
02. Workspace
   • How To | Lakehouse as Code ep. 02 | W...  

In this third episode, we focus on creating Databricks general purpose and data pipeline jobs. You’ll learn how to:
Configure and deploy a simple Hello Job
Declare a multitables data pipeline
Define transformations using both SQL and Spark DataFrame
Develop and debug the pipeline from your IDE
Deploy as a Databricks Job

More information available in blog post:
  / lakehousecode03datapipelinejobsolivi...  

Stay tuned for upcoming episodes where we’ll dive even deeper into the lakehouse deployment process!

Laktory Install Instruction
https://www.laktory.ai/install/'>https://www.laktory.ai/install/

Source Code
https://github.com/okubeai/okubesam...

Okube and Laktory are proud to be official Databricks partners.

https://www.okube.ai
https://www.laktory.ai

posted by fo4li2e29l