Why I Stopped Dumping DataFrames to a CSV and Why You Should Too
It’s time to say goodbye to pd.to_csv() and pd.read_csv()
Published in
4 min readMay 10, 2022
Building an end-to-end data-driven pipeline is challenging and demanding. Having been there myself, the process is extremely tedious, and one may inevitably end up with numerous intermediate files. While these files are usually meant to serve as checkpoints or…