In November 2024, AWS updated its guidance for SAP Data Extraction with a Glue connector.
This adds to the previous guidance using Amazon AppFlow service. But when to use what? lets dive in
Amazon Appflow Approach
AppFlow is the AWS pre-configured integration service, if you are familiar with SAP Integration Suite, Fivetran, Airbyte or similars, you already know the drill. One tool to connect all, highly transactional, easy to configure.
AppFlow has a pre-configured SAP OData Connector, so we don’t need to build it. Since its launch, it has been super easy to set up a data flow from SAP to AWS in just a few clicks, great for prototyping and relative small data sets replication.
AppFlow makes it simple, in 4 steps you define the flow, you prepare the data, add transformations, partitioning and aggregation if necessary and in a few clicks you have your raw data on AWS.
Integration is quite flexible in a low-code no-code fashion and allows modern file formats, the next step, depending of the case, would be to curate the data, with services like Glue.
New AWS Glue Approach
Now, AWS has introduced an AWS Glue OData connector for SAP, contrary to an Integration service, Glue provides a serverless data processing (ETL) service. It’s based on Spark.
Glue is more suitable for extensive data integration as well as distributed data processing capabilities, complex transformations, and analytics.
So this week, AWS announced the Odata Connector on Glue. Great because we dont need to learn Scala to build our own connector.
AWS provides more than 40 predefined connectors, plus hundreds of more connectors available through the AWS Marketplace. Glue capabilities are immense, they not only provide extensive ETL capabilities, but most importantly, they store the Data Catalog, a critical feature for search and query using Amazon Athena or Amazon Redshift.
AWS Glue ETL Workflow. Courtesy of AWS
For entire details of the new Glue connector to SAP, read this blog;
https://aws.amazon.com/blogs/big-data/scaling-rise-with-sap-data-and-aws-glue/
Key Differences and when to use
Literature
https://docs.aws.amazon.com/glue/latest/dg/connecting-to-data-sap-odata.html
https://aws.amazon.com/blogs/big-data/scaling-rise-with-sap-data-and-aws-glue/
In November 2024, AWS updated its guidance for SAP Data Extraction with a Glue connector.This adds to the previous guidance using Amazon AppFlow service. But when to use what? lets dive in Amazon Appflow ApproachAppFlow is the AWS pre-configured integration service, if you are familiar with SAP Integration Suite, Fivetran, Airbyte or similars, you already know the drill. One tool to connect all, highly transactional, easy to configure.AppFlow has a pre-configured SAP OData Connector, so we don’t need to build it. Since its launch, it has been super easy to set up a data flow from SAP to AWS in just a few clicks, great for prototyping and relative small data sets replication. AppFlow makes it simple, in 4 steps you define the flow, you prepare the data, add transformations, partitioning and aggregation if necessary and in a few clicks you have your raw data on AWS. Integration is quite flexible in a low-code no-code fashion and allows modern file formats, the next step, depending of the case, would be to curate the data, with services like Glue. New AWS Glue ApproachNow, AWS has introduced an AWS Glue OData connector for SAP, contrary to an Integration service, Glue provides a serverless data processing (ETL) service. It’s based on Spark.Glue is more suitable for extensive data integration as well as distributed data processing capabilities, complex transformations, and analytics.So this week, AWS announced the Odata Connector on Glue. Great because we dont need to learn Scala to build our own connector. AWS provides more than 40 predefined connectors, plus hundreds of more connectors available through the AWS Marketplace. Glue capabilities are immense, they not only provide extensive ETL capabilities, but most importantly, they store the Data Catalog, a critical feature for search and query using Amazon Athena or Amazon Redshift.AWS Glue ETL Workflow. Courtesy of AWS For entire details of the new Glue connector to SAP, read this blog;https://aws.amazon.com/blogs/big-data/scaling-rise-with-sap-data-and-aws-glue/ Key Differences and when to useLiteraturehttps://docs.aws.amazon.com/glue/latest/dg/connecting-to-data-sap-odata.htmlhttps://aws.amazon.com/blogs/big-data/scaling-rise-with-sap-data-and-aws-glue/ Read More Technology Blogs by Members articles
#SAP
#SAPTechnologyblog
