Get free YouTube views, likes and subscribers
Get Free YouTube Subscribers, Views and Likes

4.03 Mastering End-To-End KQL Transformations In Microsoft Fabric

Follow
Fikrat Azizov

   • Microsoft Fabric For Beginners  
In this tutorial, I explore KQL processing capabilities in Microsoft Fabric.
I explain basic KQL operators and commands and demonstrate their usage.
I also explain different tools to automate data movement and transformations within KQL database and demonstrate usage of table update, cache and retention policies.
Furthermore I show how to use Spark notebooks and Data Pipelines to orchestrate KQL transformations.
Finally, I demonstrate visualization options, like render operators and Power BI dashboards to consume KQL data.
You can download demo script from here: https://github.com/fazizov/youtube/bl...

Chapters:
00:00 Introduction
01:18 Preview
04:21 DemoQuerysets
08:48 Basic columnlevel KQL operators
12:09 Aggregate operators
12:47 Join operators
13:29 Table management commands
14:20 Table write commands
15:16 Multistep transformationslet operator
16:49 KQL Functions
17:55 Overview of data movement and transformation automation optionsData Pipelines, Spark Notebooks, Table Update Policies
21:17 What is table update policy?
24:41 Demo using data pipelines to orchestrate KQL transformations
26:22 Materialized views
27:54 Referring to KQL tables from Spark notebooks
30:15 Cache and Retention policies
30:50 Table update policies
32:23 Building endtoend streaming pipelines in KQL
36:35 Dimensional transformations
43:42 Materialized views
44:50 KQL visualizationsrender operator
45:49 Power BI visualizations in KQL

Please subscribe:    / @fazizov  
Follow me on Linkedin: www.linkedin.com/in/fikratazizov865a0528
and X: @fikrat_azizov

Official Documentation:
https://learn.microsoft.com/enus/fab...
https://learn.microsoft.com/enus/fab...
https://learn.microsoft.com/enus/azu...
https://learn.microsoft.com/enus/str...
https://learn.microsoft.com/enus/azu...

Hashtags:
#datafactory, #microsoft,#microsoftfabric ,#azure, #dataengineering,#cloudcomputing, #dataanalytics, #lakehouse, #azuretutorial, #azuretraining, #datapipeline, #dataextraction , #dataintegration, #datatransfer, #dataflow, #spark, #deltalake, #synapse, #synapsedataenginering, #demo, #datalake, #transformation, #ingested, #datawarehouse, #dataintegration,#bigdata, #bigdatatechnologies, #pyspark, #sparksql, #notebook ,#transformationvideo, #bronze, #medallion, #modeling, #facts, #silver, #gold, #historical data, #streaming,#kql, #realtime, #realtimeanalytics, #dimensional, #transformationvideos

posted by marrokinabe