Introduction to Delight: Spark UI and Spark History Serverby@jstephan
171 reads

Introduction to Delight: Spark UI and Spark History Server

by Jean-Yves "JY" Stephan7mMay 8th, 2021
Read on Terminal Reader
Read this story w/o Javascript
tldt arrow

Too Long; Didn't Read

Delight is a free, hosted, cross-platform monitoring dashboard for Apache Spark with memory and CPU metrics that will hopefully delight you! It works on top of Databricks, EMR, Dataproc, HDInsight, HDP/CDP, and open-source platforms too. Delight helps you understand and improve the performance of your Spark applications. It gives you access to: CPU & Memory metrics aligned with your Spark jobs & stages. The Spark UI itself (so you don't need to run the Spark History Server) A hosted backend responsible for collecting these metrics, parsing them, and hosting the dashboard at https://delight.co.

Companies Mentioned

Mention Thumbnail
Mention Thumbnail
featured image - Introduction to Delight: Spark UI and Spark History Server
Jean-Yves "JY" Stephan HackerNoon profile picture
Jean-Yves "JY" Stephan

Jean-Yves "JY" Stephan

@jstephan

Co-Founder @ Data Mechanics (www.datamechanics.co). Previously software engineer @ Databricks.

About @jstephan
LEARN MORE ABOUT @JSTEPHAN'S
EXPERTISE AND PLACE ON THE INTERNET.
L O A D I N G
. . . comments & more!

About Author

Jean-Yves "JY" Stephan HackerNoon profile picture
Jean-Yves "JY" Stephan@jstephan
Co-Founder @ Data Mechanics (www.datamechanics.co). Previously software engineer @ Databricks.

TOPICS

THIS ARTICLE WAS FEATURED IN...

Permanent on Arweave
Read on Terminal Reader
Read this story in a terminal
 Terminal
Read this story w/o Javascript
Read this story w/o Javascript
 Lite