Data Engineering: What is it?

A definition based in data and historical context

David Layton
Towards Data Science
5 min readMay 13, 2020

--

Data Engineering: What is it?
Source: Cdd20, via pixabay (CC0)

Data Engineering is on a meteoric rise. As a proportion of jobs advertised in the UK, data engineering has more than doubled over that past two years. At 1.5%, that’s nearly 2,200 open positions. By comparison, “Software Engineer” makes up about 4.6%. And “Project Manager” 3.1%.

--

--

Former CERN physicist; current agile evangelist, data engineer & scientist — running my consultancy, dataunbound.co.uk, since 2009