Data Testing: It's About Both Problem Detection and Quality of Responseby@kyleweaton

Data Testing: It's About Both Problem Detection and Quality of Response

by Kyle Eaton9mNovember 17th, 2020
Read on Terminal Reader
Read this story w/o Javascript
tldt arrow

Too Long; Didn't Read

The real challenge (and art!) of data testing is how you detect data problems and how you respond to them. The first line of response to a failed data test, before any humans are notified, are automated responses of the system to the test failure that decide whether and how to continue any pipeline runs. Who will actually see and respond to those notifications? Some factors to take into account are: Who gets notified and when? Upstream data producers, downstream data consumers, the team that owns the data pipelines, anyone else?

Company Mentioned

Mention Thumbnail
featured image - Data Testing: It's About Both Problem Detection and Quality of Response
Kyle Eaton HackerNoon profile picture
Kyle Eaton

Kyle Eaton

@kyleweaton

Community Manager of Great Expectations

About @kyleweaton
LEARN MORE ABOUT @KYLEWEATON'S
EXPERTISE AND PLACE ON THE INTERNET.
L O A D I N G
. . . comments & more!

About Author

Kyle Eaton HackerNoon profile picture
Kyle Eaton@kyleweaton
Community Manager of Great Expectations

TOPICS

THIS ARTICLE WAS FEATURED IN...

Permanent on Arweave
Read on Terminal Reader
Read this story in a terminal
 Terminal
Read this story w/o Javascript
Read this story w/o Javascript
 Lite