paint-brush
The Importance of Monitoring Big Data Analytics Pipelinesby@elixir
175 reads

The Importance of Monitoring Big Data Analytics Pipelines

by Divij Vaidya15mSeptember 13th, 2020
Read on Terminal Reader
Read this story w/o Javascript
tldt arrow

Too Long; Didn't Read

In this article, we first explain the requirements for monitoring your big data analytics pipeline. We go into the key aspects that you need to consider to build a system that provides holistic observability. This article covers some key ideas to gain observability into big data applications. The user personas for the data application observability can be broadly bucketed into the categories described below. Each kind of user has different requirement for data freshness, query latency, type and granularity of information. These insights lead to:lower infrastructure cost by improving resource utilization.increased user productivity by ease of debugging and troubleshooting.

Companies Mentioned

Mention Thumbnail
Mention Thumbnail

Coin Mentioned

Mention Thumbnail
featured image - The Importance of Monitoring Big Data Analytics Pipelines
Divij Vaidya HackerNoon profile picture
Divij Vaidya

Divij Vaidya

@elixir

L O A D I N G
. . . comments & more!

About Author

Divij Vaidya HackerNoon profile picture
Divij Vaidya@elixir

TOPICS

THIS ARTICLE WAS FEATURED IN...

Permanent on Arweave
Read on Terminal Reader
Read this story in a terminal
 Terminal
Read this story w/o Javascript
Read this story w/o Javascript
 Lite
Omnimd
Pye
Startupnchill