Why is Debugging Data Flows Hard?

User study observations from how humans debug errors in large data flows

“Where are these errors in my output coming from?!” Findings errors in the outputs of the large data flows are a common issue. Large data flows ingest several datasets, which are processed through many code modules which are potentially written by multiple developers.

Image by Author.