Building a Batch Data Pipeline with Athena and MySQL

An End-To-End Tutorial for Beginners

Photo by Redd F on Unsplash

In this story I will speak about one of the most popular ways to run data transformation tasks — batch data processing. This data pipeline design pattern becomes incredibly useful when we need to process data in chunks making it very efficient for ETL jobs that require scheduling. I will demonstrate how it can be…