Safely Launch Spark job using AWS Lambda and SNS

Introduction In this post, we are going to learn how to safely launch Apache Spark job using AWS lambda function and SNS topic. We are going to use Assume Role in our lambda function. This way it is much safer and no need to use long-term user access credentials. The…

Read more »

Invoking lambda function using SNS Trigger

Introduction In this post, we are going to learn invoking lambda function¬†using SNS Trigger. We will use SNS topic to display how lambda function captures SNS notifications. Prerequisites SNS topic Lambda function Create SNS Topic Go to SNS management console. Create a new topic with name¬†LambdaSNSTopic. For more information see…

Read more »