Automagic Data Anomaly Detection in Fabric | Data Exposed MVP Edition

Estimated read time 3 min read

Post Content

​ #AzureSQL #SQL #LearnSQL

As we’re pushed into an AI-driven automatic world, it’s helpful if our chosen data platform automagically detects errors and takes actions to resolve those errors. How do we set that up? Join Anna Hoffman and Matt Gordon for a few minutes to see how to do just that.

✅ Chapters:
0:20 Intro to Matt Gordon, Microsoft MVP
1:20 Introduction to a large Global Glass sporting event (scenario for the demos)
2:08 Find anomalies in ticket sales or ETL pipelines
2:58 How to set up Change Event Streaming
6:04 Event stream in Fabric
6:30 What is an Eventhouse in Fabric
7:08 Anomaly detection
8:10 Code for detecting anomalies
8:30 Creating alerts with Activator in Fabric
9:00 Custom actions, notebooks, etc
9:30 Automagic line of code
10:22 Tips and tricks for getting started
10:40 Managed identities
10:50 It’s just SQL plus customization

✅ Resources:
A good general blog can be found at https://community.fabric.microsoft.com/t5/Fabric-Updates-Blog/Stream-SQL-Change-Events-to-Microsoft-Fabric-Eventstream-with/ba-p/5172004. A step-by-step tutorial (mostly) can be found at https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/stream-sql-change-events-to-eventstream. Anomaly detection primer can be found at https://learn.microsoft.com/en-us/fabric/real-time-intelligence/anomaly-detection?tabs=eventhouse.

About Matt Gordon:
Matt is a Microsoft Data Platform MVP and has worked with Microsoft data technology since 2000 and Azure AI since 2017. He is the leader of the Lexington, KY Data Technology Group and a frequent domestic and international community speaker. He’s a Redgate Community Ambassador and an author of two books. His original data professional role was in database development, which quickly evolved into query tuning work as a DBA in the healthcare realm. He has supported several critical systems utilizing SQL Server, Azure SQL, and Microsoft Fabric and managed dozens of 24/7/365 data estates. As a consultant, he works with customers large, medium, and small to migrate to the cloud, make their data estate operate efficiently, and find the right tools and solutions within the Microsoft data & AI ecosystem.

About MVPs:
Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the “bleeding edge” and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others – that’s what sets them apart. Learn more: https://aka.ms/mvpprogram

📌 Let’s connect:
LinkedIn, X, Bluesky, Github: @sqlatspeed
Twitter: Anna Hoffman, https://twitter.com/AnalyticAnna
Twitter: AzureSQL, https://aka.ms/azuresqltw

🔴 To watch other MVP Edition episodes, see our playlist: https://aka.ms/dataexposedmvps

To check out even more Data Exposed episodes, see our playlist: https://aka.ms/dataexposedyt

🔔 Subscribe to our channels for even more SQL tips:
Microsoft Azure SQL: https://aka.ms/msazuresqlyt
Microsoft SQL Server: https://aka.ms/mssqlserveryt
Microsoft Developer: https://aka.ms/microsoftdeveloperyt

#AzureSQL #SQLServer   Read More Microsoft Developer 

You May Also Like

More From Author