Integrating AWS Glue Jobs with S3 Notifications and EventBridgeIn my last post I created a standalone AWS Glue job for loading and transforming data from S3 into Redshift. Here, I’m expanding that scenario by integrating the job with S3 notifications, Lambda functions, EventBridge rules and SNS messaging. Specifically this will […] “Integrating AWS Glue Jobs with S3 Notifications and EventBridge” |
Author: Andrew Smith
Loading data into Amazon Redshift using AWS GlueAWS Glue is a fully managed, cloud-native, AWS service for performing extract, transform and load operations across a wide range of data sources and destinations. It supports connectivity to Amazon Redshift, RDS and S3, as well as to a variety of third-party database engines running on EC2 instances. It’s a serverless […] “Loading data into Amazon Redshift using AWS Glue” |
Using Amazon SQS with AWS Lambda FunctionsThe IoT scenario from my last post is expanded here to use an SQS queue in between the AWS IoT Rules engine and the Lambda function used to write inbound sensor data to the PostgreSQL database. This decouples the Rules engine and the Lambda function, allowing for flexibility and resiliency when […] “Using Amazon SQS with AWS Lambda Functions” |