Powerful Debugging Tools for Spark for Azure HDInsight

added by DotNetKicks
9/6/2018 4:09:14 PM

1 Kicks, 1496 Views

Microsoft runs one of the largest big data cluster in the world - internally called "Cosmos". This runs millions of jobs across hundreds of thousands of servers over multiple Exabytes of data. Being able to run and manage jobs of this scale by developers was a huge challenge.