How to Speed up Python Data Pipelines up to 91X?

A 5-minute tutorial that could save months of your big-data projects.

Thuwarakesh Murallie
Towards Data Science
5 min readJul 18, 2021

--

Speed up big-data projects
Photo by Vicky Yu on Unsplash

The frustrating thing about being a data scientist is waiting for big-data pipelines to finish.

Although python is the romantic language of data scientists, it isn’t the fastest. This scripting language is interpreted at the time of…

--

--

I write about data science and consult at Stax, where I help clients unlock insights from data to drive business growth. https://www.the-analytics.club