Data pipeline vs Dataflow vs Shortcut vs Notebook in Microsoft Fabric

Learn Microsoft Fabric with Will March 11, 2024
Video Thumbnail
Learn Microsoft Fabric with Will Logo

Learn Microsoft Fabric with Will

@learnmicrosoftfabric

About

I help beginner and experienced data professionals learn Microsoft Fabric. I teach Microsoft Fabric full-time, so I spend most of my waking hours thinking about how to implement & teach Microsoft Fabric - to help you learn and advance your career in this exciting new data platform. I trained as a Data Scientist (MSc) and have 9 years of varied industry experience in Data Visualization, Data Engineering, Data Science, Real-Time Analytics, Data Strategy & Architecture, and now Training 😀 If you're serious about learning Microsoft Fabric, subscribe to the channel, and follow the links below to join our Fabric communities!

Video Description

10+ hours of FREE Fabric Training: https://www.skool.com/microsoft-fabric/classroom/d154aad4?md=3b108b0e216c46c88d891407ccd8647b Looking for Fabric consultancy? Fill in this form: https://forms.office.com/e/h5FaVBwQ7s So you want to move your analytics workloads from a Power BI-centric model to a Fabric-centric model? But how do you do that? This video is the third in the series where I discuss different options for getting data into Microsoft Fabric, including Data Pipelines, Dataflow Gen2, Fabric Notebooks, OneLake Shortcuts, Database Mirroring. We talk about the pros and cons of each to help you make better architectural decisions in Microsoft Fabric. Catch up on the Power BI to Microsoft Fabric Transition Guide series here: https://www.youtube.com/playlist?list=PLug2zSFKZmV3eee0W2PJU8XNJbu1dn3-P Timeline 0:00 Intro 1:08 Series review 1:29 The problem 3:07 Overview of the different methods 5:19 Data ingestion principles 7:29 Dataflow overview 7:54 Dataflow: when to use/ when not to use 10:09 Dataflow: implementation notes 13:11 Data pipeline overview 13:27 Pipelines: when to use/ not to use 15:35 Pipelines: implementation notes 17:38 Notebooks overview 18:29 Notebooks: when to use/ not to use 20:16 File/database replication overview 22:30 Shortcuts overview 22:52 Internal shortcut limitations 24:05 Shortcuts: implementation notes 25:17 Database mirroring overview 27:53 What to consider when choosing a method #powerbi #microsoftfabric #dataanalytics