Cluster Network with the Capability of Autonomously Supporting Parallel and Distributed Computing

具有自主支持并行和分布式计算能力的集群网络

基本信息

批准号：
14580361
负责人：
WADA Koichi
金额：
$ 2.24万
依托单位：
University of Tsukuba
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (C)
财政年份：
2002
资助国家：
日本
起止时间：
2002 至 2003
项目状态：
已结题

项目摘要

The objective of this research is to investigate the network architecture for high-performance cluster computers. In this research, a network interface, a network switch, device drivers, and communication APIs have been developed and evaluated. The network interface(NI) is connected to the host PC via PCI bus. The NI and the switch consist of the dedicated hardware for efficient communication and a high-performance processor. The processor is tightly coupled with the communication hardware to provide the capability of autonomous support for communication frequently observed in parallel and distributed computing. We have developed a novel link-layer protocol, which extracts a maximum potential performance of the physical layer, and implemented by hardware. We have also developed an access analysis software. This software, based on the information of synchronizations, analyzes access dependency among shared variables and generates calls to the appropriate data transfer functions. To realize an efficient programming environment, high-performance communication library, a standard communication protocol TCP/IP, and the standard message passing library MPI have been developed.From the results of evaluation, it has been confirmed that the proposed network can achieve low-latency and high-throughput communication. It has been also confirmed that 88% of throughput of the physical layer can be extracted by effective use of high-level autonomy and dedicated hardware of the proposed network. The results of the comparison with other conventional networks showed that we can obtain high communication performance for the standard communication software such as MPI and TCP/IP.

这项研究的目的是研究高性能集群计算机的网络体系结构。在这项研究中，已经开发和评估了网络接口，网络开关，设备驱动程序和通信API。网络接口（NI）通过PCI总线连接到主机PC。 NI和开关由专用硬件组成，用于有效通信和高性能处理器。处理器与通信硬件紧密相结合，以提供自主支持的能力，以便在并行和分布式计算中经常观察到的通信。我们已经开发了一种新颖的链路层协议，该协议提取了物理层的最大潜在性能，并通过硬件实现。我们还开发了访问分析软件。该软件基于同步信息，分析共享变量之间的访问依赖关系，并生成对适当数据传输功能的调用。为了实现有效的编程环境，已经开发了高性能通信库，标准通信协议TCP/IP和标准消息传递库MPI。从评估的结果中，已经证实，所提出的网络可以实现低延迟和高关注交流。还可以证实，可以通过有效使用提出的网络的高级自主权和专用硬件来提取物理层的吞吐量的88％。与其他常规网络的比较结果表明，我们可以为MPI和TCP/IP等标准通信软件获得高度的通信性能。