Reconfigurable Parallel Processing Plug＆Play Clustering

可重构并行处理即插即用集群

• 批准号: 12558025
• 负责人: MATSUOKA Satoshi
• 金额: $ 5.18万
• 依托单位: Tokyo Institute of Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 2000
• 资助国家: 日本
• 起止时间: 2000 至 2001
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-12558025/
• 关键词: Plug ＆ Play; Lucie; Dependable computing; Fault-tolerant MPI; Automated Cluster Installation and Configuration; Node hot swap; Large-scale cluster management; チェックポイント; マイグレーション; 並列処理; クラスタ評価環境; Plug ＆ Play; Lucie; Dependable computing; Fault-tolerant MPI; Automated Cluster Installation and Configuration; Node hot swap; Large-scale cluster management; チェックポイント; マイグレーション; 並列処理; クラスタ評価環境

The objective of the project is to push the technological envelop of fault tolerance and reconfigurability in large-scale clustering such that the clusters become almost self-sustaining, and reconfiguring is a matter of "Plug&Play". Some of the salient results are as follows :1) Construction of the "Plug&Play" clustering testbed (20 nodes of DELL Inspiron , Mobile Celeron 600 MHz, 128 MB Memory, 20 GB HDD, 3COM Plug＆Play PCMCIA 100Base-T Network Card). This served as a flexible testbed for middleware development. It was also very compact (a small rack) and low power (less than 400 watts/20 nodes)2) Development of the Parakeet Fault Tolerant, High-Performance Cluster MPI which allows various checkpointing algorithms to be selected from a set of available algorithm by the user according to his application characteristics. Parakeet is an entirely user-level implementation, is portable and efficient, and frees the users from checkpointing concerns within his code. We have implemented vario … More us checkpointing strategies to achieve the best efficiency, and conducted detailed performance analysis comparing with full restart.3) Self-organizing cluster middleware, the Lucie prototype. As a basic technology, plug＆play clustering requires hot swapping of nodes, reconfiguration of software organization within a node, and dynamic partition management. Lucie builds on existing Linux tools to implement full cluster configuration capabilities in an automated fashion. Lucie allows fully automated (re)installation and configuration of every node in a cluster in a very rapid fashion.4) Prototyping scalable, secure and self-organizing cluster communication. We have identified that scalable, reliable, secure, and self-organizing communication within the cluster node is the essential foundation for reliable, plug＆play clustering. We have prototyped some of the ideas in the Gfarm (cluster middleware for Petascale Datagrid processing) job manager : there, the self-organizing process ring structure governs all the nodes, and jobs can be started up rapidly in parallel, in a safe secure manner. Less

该项目的目的是在大规模聚类中推动容错和重新配置的技术信封，以使簇几乎变得自我维持，重新配置是“插件”的问题。一些显着的结果如下：1）构建“插头”聚类测试床（Dell Inspiron的20个节点，移动Celeron 600 MHz，128 MB内存，20 GB HDD，3COM HDD，3COM插头＆Play PCMCIA 100BASE-T网络卡）。这是中间件开发的灵活测试床。它也非常紧凑（一个小架子）和低功率（小于400瓦/20个节点）2）开发长尾小鹦鹉的耐受性耐受性，高性能群集MPI，允许用户根据用户的应用程序特征从一组可用的算法中选择各种检查点算法。长尾小鹦鹉是一种完全是用户级的实现，是便携式和高效的，可以使用户摆脱其代码中的检查点的关注点。我们已经实施了各种……更多的美国检查点策略，以实现最佳效率，并进行了详细的性能分析，与完整重新启动相比。3）自组织集群中间件，露西原型。作为一项基本技术，插头聚类需要热量交换节点，在节点内重新配置软件组织以及动态分区管理。 Lucie建立在现有的Linux工具上，以自动化的方式实现完整的群集配置功能。 Lucie允许以非常快速的方式以群集中每个节点的全自动（RE）安装和配置。4）原型可扩展，安全和自组织的集群通信。我们已经确定群集节点内的可扩展，可靠，安全和自组织的通信是可靠，插件聚类的重要基础。我们已经原型了GFARM中的一些想法（用于Petascale DataGrid处理的集群中间件）工作经理：在那里，自组织的过程环结构控制了所有节点，并且可以以安全的安全方式并行迅速地启动工作。较少的