All-to-all communication

All-to-all communication is a computer communication method in which each sender transmits messages to all receivers within a group.[1] This contrasts with the point-to-point method in which each sender communicates with one receiver.

All-to-all communication is the most general communication method, and is also the most intensive in the sense that a large number of messages are required.[1]

All-to-all communication may be performed as "all scatter" in which each sender performs its own scatter in which the messages are distinct for each receiver, or "all broadcast" in which they are the same.[2]

The MPI message passing method which is the de facto standard on large computer clusters includes the MPI_Alltoall method.[3]

See also

References

  1. ↑ 1.0 1.1 Encyclopedia of Parallel Computing, Volume 4 by David Padua 2011 ISBN 0387097651 page 43
  2. ↑ Interconnection Networks by Jose Duato, Sudhakar Yalamanchili and Lionel Ni 2012 ISBN 1558608524 pages 210-211
  3. ↑ Improved MPI All-to-all Communication on a Giganet SMP Cluster by Jesper Larsson Träff 2002 Proceedings of the 9th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface ISBN 3-540-44296-0 pages 392-400