Microsoft Fabric: Change Data Capture Copy Job On Prem SQL Server to Fabric SQL DB

Video Description

Change Data Capture, CDC, from an on premise SQL Server to a Microsoft Fabric SQL Database? Here it is! Plus we show how to use the Mirror of the Fabric SQL Database to access your data in a Lakehouse or a Warehouse any way you want your data Bradley Ball, aka @SQLBalls , has got you covered! Part 1 Microsoft Fabric: Incremental Copy Job on Prem SQL to Fabric SQL DB or Warehouse https://www.youtube.com/watch?v=Q8ifzuOWbI8&t Change data capture (CDC) in Copy Job (Preview) https://learn.microsoft.com/en-us/fabric/data-factory/cdc-copy-job What is Copy job in Data Factory for Microsoft Fabric? https://learn.microsoft.com/en-us/fabric/data-factory/what-is-copy-job /******************* /CONNECT WITH US!! /******************* Tales from the Field Blusky: talesfromthefield.bsky.social Twitter/X: https://x.com/TalesftField Linkedin: https://www.linkedin.com/company/100091910/ Bradley Ball Blusky: sqlballs.bsky.social Twitter/X: https://x.com/SQLBalls Linkedin: https://www.linkedin.com/in/sqlballs/ Daniel Taylor Blusky: dbabulldog.bsky.social Twitter/X: https://x.com/dbabulldog Linkedin: https://www.linkedin.com/in/danieltaylor3/ Bradley Schacht Blusky: bradleyschacht.bsky.social Twitter/X: https://x.com/BradleySchacht LinkedIn: https://www.linkedin.com/in/bradleyschacht/ Neeraj Jhaveri Blusky: neerajny.bsky.social Twitter/X: https://x.com/neeraj_jhaveri Linkedin: https://www.linkedin.com/in/neerajjhaveri/ Josh Luedeman Blusky: joshluedeman.bsky.social Twitter/X: https://x.com/joshluedeman Linkedin: https://www.linkedin.com/in/joshluedeman/ Chapters 00:00 Limitations of Watermark Copy Jobs 01:47 Demo Environmental Review Microsoft Fabric & SQL Server 02:43 Demo Setting up Change Data Capture on the Database & Tables 03:45 Demo Create Copy Job using CDC 05:25 Demo Running the Copy Job 05:37 Demo Examine the Fabric SQL Database Mirror & Replication 06:10 Demo Create Shortcut from Mirror to Lakehouse 06:45 Demo Create three point naming convention view in Warehouse to Mirror 07:13 Demo Validate totals on SQL Server, Fabric SQL DB, Warehouse, Lakehouse, & Mirror 08:12 Demo Create Updates 08:36 Demo Run Copy Job 08:48 Demo View Mirror Replication 09:06 Demo Validate totals on SQL Server, Fabric SQL DB, Warehouse, Lakehouse, & Mirror 9:35 Demo Insert 50K rows and Update rows divisible by 2 9:50 Demo Run Copy Job 10:03 Demo Validate totals on SQL Server, Fabric SQL DB, Warehouse, Lakehouse, & Mirror 10:34 Demo Deleting Rows 10:45 Demo Run Copy Job 10:59 Demo Validate totals on SQL Server, Fabric SQL DB, Warehouse, Lakehouse, & Mirror #microsoftfabric #fabric #MSFTFabric #Warehouse #datawarehouse #CDC #ChangeDataCapture #pipeline #datapipelines #datafactory #sqlserver #ssms #lakehouse #shortcuts