Safely send data to AWS SQS from Spark worker machines

In this post, we are going to learn how to send messages to AWS SQS from spark worker machines using assume role. We will cover send data using Spark Executors and STS assume roles to communicate with AWS SQS service. Prerequisites Running Spark cluster on AWS AWS SQS Spark worker…

Read more »