Advancement of parallel systems skeletons

并行系统骨架的进步

• 批准号: 250301-2011
• 负责人: Goswami, Dhrubajyoti
• 金额: $ 1.75万
• 依托单位: Concordia University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2012
• 资助国家: 加拿大
• 起止时间: 2012-01-01 至 2013-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=508163
• 关键词: Advancement; parallel; systems; skeletons

The idea of design patterns has been widely researched and applied in parallel application design and development. In most existing works on patterns in parallel programming, the emphasis is on aiding an application developer during the design and development phases of an application. In addition to the traditional applications of patterns, this proposed research extends the use of patterns towards (i) systems, dependability and performance specific aspects of parallel programs, targeting two categories of users: application and system designers/developers; and (ii) assisting in non-trivial, practical, and useful parallel application domains. More specifically, the proposed research focuses on the following systems and dependability specific aspects: (a) fault-tolerance: fault-tolerance strategies differ for different patterns in order to minimize overhead. For example, fault-tolerance strategy for a master-worker pattern with no interaction among workers will differ from the scenario where workers form distinct communication subgroups. This necessitates proper design of strategies specific to patterns; (b) atomicity: since patterns abstract the behavioral requirements of an application, atomicity requirement checking of parallel programs could be facilitated by the use of patterns; this needs extensive research. From the performance side: (c) scheduling strategies for different patterns differ on a heterogeneous computing environment in order to minimize idling time, reduce communication cost and thus enhance efficiency. For example, a task farm with independent dynamic tasks needs to be scheduled differently from a pipeline or a systolic array. Hence designing of appropriate scheduling strategies is crucial for performance. In the non-trivial applications category: (d) two such application domains are recently being investigated and will be reported in the main proposal. In all of these works, the targeted hardware platform is a commodity heterogeneous parallel computing environment, consisting of nodes with multi-core CPUs and GPUs of dissimilar architectures interconnected via high-speed network, where achieving efficiency through proper utilization of resources is a challenge and dependability is a requirement for the developed application.

设计模式的思想在并行应用程序设计和开发中得到了广泛的研究和应用。在大多数关于并行编程模式的现有工作中，重点是在应用程序的设计和开发阶段为应用程序开发人员提供帮助。除了模式的传统应用之外，这项研究将模式的使用扩展到（i）并行程序的系统、可靠性和性能特定方面，针对两类用户：应用程序和系统设计者/开发人员； (ii) 在重要、实用且有用的并行应用领域提供帮助。更具体地说，所提出的研究重点关注以下系统和可靠性特定方面：（a）容错：不同模式的容错策略有所不同，以便最大限度地减少开销。例如，工作人员之间没有交互的主工作人员模式的容错策略将不同于工作人员形成不同通信子组的情况。这需要针对特定​​模式正确设计策略； (b) 原子性：由于模式抽象了应用程序的行为要求，因此使用模式可以促进并行程序的原子性要求检查；这需要广泛的研究。从性能方面来看：（c）异构计算环境下不同模式的调度策略不同，以最大限度地减少空闲时间，降低通信成本，从而提高效率。例如，具有独立动态任务的任务场需要以不同于管道或脉动阵列的方式进行调度。因此，设计适当的调度策略对于性能至关重要。在重要应用类别中：（d）最近正在研究两个这样的应用领域，并将在主要提案中报告。 在所有这些工作中，目标硬件平台是一个商品异构并行计算环境，由通过高速网络互连的不同架构的多核CPU和GPU的节点组成，其中通过正确利用资源来实现效率是一个挑战和挑战。可靠性是所开发的应用程序的要求。