Apache Spark jobs gain up to 9x speed up with HDInsight IO Cache

added by DotNetKicks
10/16/2018 5:19:20 PM


Today, we are pleased to reveal the preview of HDInsight IO Cache, a new transparent data caching feature of Azure HDInsight that provides customers with up to a 9x performance improvement for Apache Spark jobs. We know from our customers that when it comes to analytics cost efficiency of managed cloud-based Apache Hadoop and Spark services is one of their major attractors.