Stop persisting pandas data frames in CSVs

Advantages of pickle, parquet, and others— faster, more reliable and efficient

Vaclav Dekanovsky
Towards Data Science
10 min readAug 20, 2020

--

Different methods how to persist pandas dataframe

CSV is a great format for data exchange. It’s understood all around the world and editable in a regular notepad. That doesn’t mean that it’s suitable for persisting all DataFrames. CSVs can be slow to read and write, they take more disk space, and most…

--

--

Data scientist who loves to explore everything and write about the topics from multiple points of view.