Pandas for Data Engineers

Advanced techniques to process and load data efficiently

AI-generated image using Kandinsky

In this story, I would like to talk about things I like about Pandas and use often in ETL applications I write to process data. We will touch on exploratory data analysis, data cleansing and data frame transformations. I will demonstrate some of my favourite techniques to optimize memory usage and process large amounts of…