Monitoring & optimizing performance in Microsoft Fabric | DP-600 EXAM PREP (8 of 12)

Video Description

IMPORTANT! As of 15th Nov 2024, the DP-600 study guide has CHANGED! For updated DP-600 study notes & discussion: https://www.skool.com/microsoft-fabric/about/ In this video (8 of 12 in the series), we cover the following sections of the DP-600 study guide: - Identify and resolve data loading performance bottlenecks in dataflows, notebooks, and SQL queries - Implement performance improvements in dataflows, notebooks, and SQL queries - Identify and resolve issues with Delta table file sizes - Implement file partitioning for analytics workloads in a lakehouse Specifically, we take a look at concepts like: dataflow performance monitoring, dataflow staging, dataflow fast copy, SQL DMVs, SQL Query Insights, Spark monitoring, Spark History Server, the Capacity Metrics App, the Monitoring Hub, Delta file optimization, File Partitioning, VACUUM & OPTIMIZE. This video is part of the DP-600 Exam Preparation series: https://www.youtube.com/playlist?list=PLug2zSFKZmV05ZJcmHemXxyJjPVXeQ2qS Timeline 0:00 Intro 1:14 Framing performance optimization in Fabric 4:00 Monitoring Hub 6:13 Capacity Metrics App 9:18 Dataflow monitoring 9:55 Dataflow staging 12:06 Dataflow fast copy 12:41 SQL Dynamic Management Views (DMVs) 15:00 SQL Query Insights 16:28 Spark monitoring 17:15 Spark History Server 18:06 Delta table optimization (intro) 18:38 File partitioning 25:30 V-order optimization 27:00 Delta OPTIMIZE & VACUUM 27:36 Spark coalesce() and repartition() 29:20 Practice Questions 34:15 Outro and next steps #microsoftfabric #dp600 #powerbi