Making Sense of Big Data

Big Data Engineering — Best Practices

What you should keep in mind when implementing Big Data data processing pipelines.

Kaya Kupferschmidt
9 min readSep 12, 2020

--

Photo by tian kuan on Unsplash

This is part 1 of a series on data engineering in a big data environment. It will reflect my personal journey of lessons learnt and culminate in the open source tool Flowman I created to take the…

--

--