AWS Tutorials – Building ETL Pipeline using AWS Glue and Step Functions

The script URL - https://github.com/aws-dojo/analytics/blob/main/stepfunctionsetl.py

In AWS, ETL pipelines can be built using AWS Glue Job and Glue Crawler. AWS Glue Jobs are responsible for data transformation while Crawlers are responsible for data catalog. Amazon Step Functions is one approach to create such pipelines. In this tutorial, learn how to use Step Functions build ETL pipeline in AWS.