## Build a serverless pipeline to analyze streaming data using AWS Glue, Apache Hudi & Amazon S3

This repository consists a Cloudformation template and pyspark code sample for Glue streaming job to implement following ETL pipeline :

<img width="652" alt="Screenshot 2022-01-29 at 12 21 45 AM" src="https://user-images.githubusercontent.com/46901738/151604760-5809ebaa-fe0d-4260-9316-1562cef9c687.png">

Related AWS Blog : https://aws.amazon.com/blogs/big-data/build-a-serverless-pipeline-to-analyze-streaming-data-using-aws-glue-apache-hudi-and-amazon-s3/

## Security

See [CONTRIBUTING](CONTRIBUTING.md#security-issue-notifications) for more information.

## License

This library is licensed under the MIT-0 License. See the LICENSE file.