Author: Andrew Smith

Integrating AWS Glue Jobs with S3 Notifications and EventBridge

In my last post I created a standalone AWS Glue job for loading and transforming data from S3 into Redshift.

Here, I’m expanding that scenario by integrating the job with S3 notifications, Lambda functions, EventBridge rules and SNS messaging. Specifically this will […] “Integrating AWS Glue Jobs with S3 Notifications and EventBridge”

Loading data into Amazon Redshift using AWS Glue

AWS Glue is a fully managed, cloud-native, AWS service for performing extract, transform and load operations across a wide range of data sources and destinations.

It supports connectivity to Amazon Redshift, RDS and S3, as well as to a variety of third-party database engines running on EC2 instances. It’s a serverless […] “Loading data into Amazon Redshift using AWS Glue”

Using Amazon SQS with AWS Lambda Functions

The IoT scenario from my last post is expanded here to use an SQS queue in between the AWS IoT Rules engine and the Lambda function used to write inbound sensor data to the PostgreSQL database.

This decouples the Rules engine and the Lambda function, allowing for flexibility and resiliency when […] “Using Amazon SQS with AWS Lambda Functions”