Post Content
Security and performance are top of mind for every data engineer. In this episode, Santhosh Kumar Ravindran joins Anna Hoffman to demonstrate how to securely connect Spark to on-premises and private data sources using Managed Private Endpoints using private link service connectivity and enforce inbound and outbound restrictions. Plus, learn how to optimize costs with Autoscale billing and unlock up to 4x faster performance with the Native Execution Engine all without any code changes.
0:00 Introduction
3:20 Security for Fabric Data Engineering
7:30 Demo
11:00 Autoscale Billing for Spark – Flexible, Pay as you go
12:55 Acceleration Without Additional Cost with Native Engine
✅ Resources:
Overview of Managed Private Endpoints for Fabric: https://learn.microsoft.com/en-us/fabric/security/security-workspace-level-private-links-overview
Native Execution Engine for Fabric Data Engineering: https://learn.microsoft.com/en-us/fabric/data-engineering/native-execution-engine-overview?tabs=sparksql
Autoscale Billing for Spark in Microsoft Fabric: https://learn.microsoft.com/en-us/fabric/data-engineering/autoscale-billing-for-spark-overview
📌 Let’s connect:
Twitter – Anna Hoffman, https://twitter.com/AnalyticAnna
Twitter – AzureSQL, https://aka.ms/azuresqltw
🔴 Watch even more Data Exposed episodes: https://aka.ms/dataexposedyt
🔔 Subscribe to our channels for even more SQL tips:
Microsoft Azure SQL: https://aka.ms/msazuresqlyt
Microsoft SQL Server: https://aka.ms/mssqlserveryt
Microsoft Developer: https://aka.ms/microsoftdeveloperyt
#AzureSQL #SQL #LearnSQL Read More Microsoft Developer
