In this paper, we report on a project to develop a unified approach for building a library of collective communication operations that performs well on a cross-section of problems encountered in real applications. The target architecture is a two-dimension
Building a High-Performance Collective Communication Library Mike Barnett Department of Computer Science University of Idaho Moscow, Idaho 83844-1010 Lance Shuler Parallel Computing Sciences Department, 1424 Sandia National Laboratory Albuquerque, New Mexico 87185-1109 Satya Gupta and David G. Payne Supercomputer Systems Division Intel Corporation 15201 N.W. Greenbrier Pkwy Beaverton, Oregon 97006 Robert van de Geijn Department of Computer Sciences The University of Texas at Austin Austin, Texas 78712{1188
Jerrell Watts Computer Science Department California Institute of Technology Pasadena, California 91125
Abstract In this paper, we report on a project to develop a uni ed approach for building a library of collective communication operations that performs well on a cross-section of problems encountered in real applications. The target architecture is a two-dimensional mesh with worm-hole routing, but the techniques are more general. The approach di ers from traditional library implementations in that we address the need for implementations that perform well for various sized vectors and grid dimensions, including non-power-oftwo grids. We show how a general approach to hybrid algorithms yields performance across the entire range of vector lengths. Moreover, many scalable implementations of application libraries require collective communication within groups of nodes. Our approach yields the same kind of performance for group collective communication. Results from the Intel Paragon system are included. To obtain this library for Intel systems contact intercom@cs.utexas.edu.
monly used collective communication algorithms. It is this emphasis on a high-performance implementation that sets it aside from the MPI e ort 16], which tries to standardize the interface to communication libraries. Indeed, we expect the fruits of our e orts to be incorporated into implementations of the MPI standard. The following collective communication operations have been identi ed as being useful in many applications: broadcast, scatter, gather, collect and global combine. Typical approaches to implementing such collective communication algorithms are limited to considering the case of short vectors, which are treated with one technique, or to considering the case of long vectors, for which very di erent techniques are appropriate. For a general purpose library, it is crucial that an implementation performs well for all vector lengths. In an earlier paper 1], we have presented a general approach to building collective communication libraries. In this paper, we give a further description of this approach, with emphasis on an explanation of hybrids.
1 Introduction The Interprocessor Collective Communication (InterCom) Project is a comprehensive study of techniques for a high-performance implementation of com-
2 Target Architectures Our current implementation assumes a twodimensional physical mesh of processing nodes, with
as users we should expect high-performance ...building collective communication libraries from a ...A library for the Intel Touchstone Delta and ...
A High-Performance Communication Service for Parallel Computing on Distributed...Keywords – collective communications, digital signal processors, distributed ...
2003 S. H. Lee Goals Synergy Accountability Skills Collective Performance ...communication 3 Pillars for TRUST-BUILDING Open Meetings Shared Leadership Skip...
google,gwt,Android,编程,engine ...
collective-operation performance close to its worst... are building large clusters instead of (or, ...() function, the communication library merely ...
On Implementing High-Performance Collective I/O Phillip M. Dickens Rajeev ...collective I/O library and show the impact on performance resulting from ...
cient Collective Operations for Communication on ...These patterns are used by ECO’s library of ...The advent of high-performance and gigabit ...
ECO: Ef?cient Collective Operations for Communication on Heterogeneous ...Even with high-performance networks, it is necessary to use appropriate ...
A High-Performance Gas-Separation Membrane_工学_高等教育_教育专区。Angewandte DOI: 10.1002/anie.201006141 Chemie MOF Membranes A High-Performance Gas-...
Contraception 76 (2007) 228 – 232 Original research article Development of a high-performance liquid chromatographic method for the determination of ...
热门文档