DryadLINQ Tutorial: Part 1 – Distributed Storage Catalog (DSC) Basics

home
architecture
view story

7 Kicks

DryadLINQ Tutorial: Part 1 – Distributed Storage Catalog (DSC) Basics(blogs.microsoft.co.il)

submitted by roadan(135) 10 months, 27 days ago

One of the most exciting additions to Windows HPC Server 2008 R2 SP2 (currently in beta) is the support for DryadLINQ. DryadLINQ is an API that allows the creation and execution of large scale, data-parallel compute tasks. One of the core capabilities of Dryad (the underlying framework used by DryaLINQ) is the ability to distribute the data over the cluster and maintain data locality by executing the code on the node storing the data. In order to do both, Dryad utilizes a mechanism called The Distributed Storage Catalog (DSC) which I will cover in this post.

add a comment |category: Architecture |Views: 39
Tweet