Making Sense of Big Data
Reducing memory usage in pandas with smaller datatypes
Optimizing pandas memory usage by the effective use of datatypes
Published in
6 min readMar 15, 2021
Managing large datasets with pandas is a pretty common issue. As a result, a lot of libraries and tools have been developed to ease that pain. Take, for instance, the pydatatable library mentioned…