Studies on Remote Parallel Pipe Mechanism for Wide-Area Distributed Metacomputing

广域分布式元计算远程并行管道机制研究

• 批准号: 15500044
• 负责人: AMANO Hirofumi
• 金额: $ 2.3万
• 依托单位: KYUSHU UNIVERSITY
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2003
• 资助国家: 日本
• 起止时间: 2003 至 2004
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-15500044/
• 关键词: wide-area distributed metacomputing; remote parallel pipe; grid computing; parallel processing; distributed processing; MPI; OpenMP

In wide-area distributed metacomputing by virtually integrated multiple computing resources on WAN, sufficient performance cannot be achieved through conventional LAN-oriented parallel processing methods based on the data-parallel approach. Therefore, this project focused on remote parallel pipe mechanism which performs high-speed parallel data transfer from one parallel program to another parallel program on a remote site like a pipeline, to alleviate the negative effect of the communication latency.In 2003,a prototype system successfully achieved parallel data transfer between multiple MPI programs running on distinct parallel machines. Since this mechanism is not incorporated in the standard MPI functions, it is an original contribution of this project. Network striping technique was also adopted in the prototype to fully exploit the communication band width between parallel computers, and its effectiveness was verified through experiments.In 2004,this prototype was upgraded to an integrated function library which can be used on generic PC clusters. In a typical PC cluster, external communication link is limited to only one node to save the number of global IP addresses assigned, and the parallel pipe approach faces a difficulty in data scattering/gathering and network striping control. The completed library can hide this complicated work from the programmer's view. Other research results are related to IPv6 technology to utilize other nodes having no external link, and authentication mechanism to achieve safe wide-area distributed metacomputing.

在广域网上虚拟集成多种计算资源的广域分布式元计算中，传统的基于数据并行方式的面向局域网的并行处理方法无法获得足够的性能。因此，该项目的重点是远程并行管道机制，它像管道一样在远程站点上从一个并行程序到另一个并行程序进行高速并行数据传输，以减轻通信延迟的负面影响。2003年，一个原型系统成功实现了运行在不同并行机上的多个MPI程序之间的并行数据传输。由于该机制未纳入标准 MPI 功能中，因此它是该项目的原创贡献。原型机还采用了网络条带技术，充分利用并行计算机之间的通信带宽，并通过实验验证了其有效性。2004年，原型机升级为可在通用PC集群上使用的集成函数库。在典型的PC集群中，外部通信链路仅限于一个节点，以节省分配的全局IP地址的数量，并且并行管道方法面临数据分散/收集和网络条带化控制的困难。完成的库可以将这项复杂的工作从程序员的视野中隐藏起来。其他研究成果涉及IPv6技术，利用其他没有外部链接的节点，以及认证机制来实现安全的广域分布式元计算。

项目成果

The Synchronization Mechanisms in Sensor Networks

传感器网络中的同步机制

• 发表时间: 2005
• 期刊: The 4th Asia Pacific International Symposium on Information technology
• 作者: H.Lee;J.Y.Lee;S.Y.Han;T.Nanri;Y.Kwon
• 通讯作者: Y.Kwon

Implementation of One-sided Communication Library for Hierarchical Clusters

分层集群单侧通信库的实现

• 发表时间: 2004
• 期刊: The 3rd Core University Program Seminar on Next Generation Internet between Kyushu Univ. and Chungnam National Univ.
• 作者: K.Kim;G.Yamazaki 他2名;H.Yotsuyanagi;中嶋昭夫 他3名;Takeshi Nanri
• 通讯作者: Takeshi Nanri

MO-SRVにおけるGrid計算サービスのための分散認証機構に関する考察

MO-SRV网格计算服务分布式认证机制的思考

• 发表时间: 2005
• 期刊: 情報処理学会第67回全国大会講演論文集 (3)
• 作者: 甲斐啓文;伊東栄典;大庭淳一;青柳睦
• 通讯作者: 青柳睦

A study for schema integration for Web syllabi(in Japanese)

Web大纲模式整合研究（日文）

• 发表时间: 2004
• 期刊: Proc.of DICOMO 2004
• 作者: Eisuke Itoh;Yufeng Dou;Sachio Hirokawa
• 通讯作者: Sachio Hirokawa

佐藤 周行, 南里 豪志, 長尾 光悦, 高井 昌彰, 平野彰雄: "An MPICH-G Network on SuperSINET and its Performance"情報処理学会研究会報告. HPC-97-8(開催済み,雑誌未着). (2004)

Shuyuki Sato、Goji Nanzato、Koetsu Nagao、Masaaki Takai、Akio Hirano：“SuperSINET 上的 MPICH-G 网络及其性能”日本信息处理学会 HPC-97-8 研究小组报告（已举行，杂志尚未收到）。 (2004)