Understanding HDInsight Spark jobs and data through visualizations in the Jupyter Notebook

added by DotNetKicks
4/29/2019 5:09:18 PM

1 Kicks, 133 Views

The Jupyter Notebook on HDInsight Spark clusters is useful when you need to quickly explore data sets, perform trend analysis, or try different machine learning models. Not being able to track the status of Spark jobs and intermediate data can make it difficult for data scientists to monitor a…