Stop persisting pandas data frames in CSVs
Advantages of pickle, parquet, and others— faster, more reliable and efficient
Published in
10 min readAug 20, 2020
CSV is a great format for data exchange. It’s understood all around the world and editable in a regular notepad. That doesn’t mean that it’s suitable for persisting all DataFrames. CSVs can be slow to read and write, they take more disk space, and most…