Big Data Engineering —Declarative Data Flows

Separating functional and non-functional requirements by using a declarative language approach.

Photo by Mike Benna on Unsplash

This is part 3 of a series on data engineering in a big data environment. It will reflect my personal journey of lessons learnt and culminate in the open source tool Flowman I created to take the burden of reimplementing all the…