How I Built CI/CD For Data Pipelines in Apache Airflow on AWS

Modern data engineering requires automated deployment processes

Photo by Sanaan Mazhar from Pexels | Branded content disclosure

Apache Airflow is a commonly used platform for building data engineering workloads. There are so many ways to deploy Airflow that it’s hard to provide one simple answer on how to build a continuous deployment process. In this article, we’ll focus on S3 as…