Multi-SPMD Programming Model
with YML and XcalableMP
Miwako Tsuji, Hitoshi Murai, Taisuke Boku, Mitsuhisa Sato,
Serge G. Petiton, Nahid Emad, Thomas Dufaud, Joachim Protze,
Christian Terboven, and Matthias S. Müller
Abstract This chapter describes a multi-SPMD (mSPMD) programming model
and a set of software and libraries to support the mSPMD programming model. The
mSPMD programming model has been proposed to realize scalable applications on
huge and hierarchical systems. It has been evident that simple SPMD programs
such as MPI, XMP, or hybrid programs such as OpenMP/MPI cannot exploit
the postpeta- or exascale systems efficiently due to the increasing complexity of
applications and systems. The mSPMD programming model has been designed to
adopt multiple programming models across different architecture levels. Instead of
invoking a single parallel program on millions of processor cores, multiple SPMD
programs of moderate sizes can be worked together in the mSPMD programming
model. As components of the mSPMD programming model, XMP has been supported. Fault-tolerance features, correctness checks, and some numerical libraries’
implementations in the mSPMD programming model have been presented.
M. Tsuji () · H. Murai · M. Sato
RIKEN Center for Computational Science, Kobe, Japan
e-mail: miwako.tsuji@riken.jp; h-murai@riken.jp; msato@riken.jp
T. Boku
Center for Computational Sciences, University of Tsukuba, Tsukuba, Japan
e-mail: taisuke@ccs.tsukuba.ac.jp
S. G. Petiton
LIFL, Université de Lille, Lille, France
e-mail: serge.petiton@univ-lille.fr
N. Emad · T. Dufaud
Li-Parad, UVSQ, Versailles, France
e-mail: nahid.emad@uvsq.fr; thomas.dufaud@uvsq.fr
J. Protze · C. Terboven · M. S. Müller
RWTH Aachen University, Aachen, Germany
e-mail: protze@itc.rwth-aachen.de; terboven@itc.rwth-aachen.de; mueller@itc.rwth-aachen.de
© The Author(s) 2021
M. Sato (ed.), XcalableMP PGAS Programming Language,
https://doi.org/10.1007/978-981-15-7683-6_9
219
with YML and XcalableMP
Miwako Tsuji, Hitoshi Murai, Taisuke Boku, Mitsuhisa Sato,
Serge G. Petiton, Nahid Emad, Thomas Dufaud, Joachim Protze,
Christian Terboven, and Matthias S. Müller
Abstract This chapter describes a multi-SPMD (mSPMD) programming model
and a set of software and libraries to support the mSPMD programming model. The
mSPMD programming model has been proposed to realize scalable applications on
huge and hierarchical systems. It has been evident that simple SPMD programs
such as MPI, XMP, or hybrid programs such as OpenMP/MPI cannot exploit
the postpeta- or exascale systems efficiently due to the increasing complexity of
applications and systems. The mSPMD programming model has been designed to
adopt multiple programming models across different architecture levels. Instead of
invoking a single parallel program on millions of processor cores, multiple SPMD
programs of moderate sizes can be worked together in the mSPMD programming
model. As components of the mSPMD programming model, XMP has been supported. Fault-tolerance features, correctness checks, and some numerical libraries’
implementations in the mSPMD programming model have been presented.
M. Tsuji () · H. Murai · M. Sato
RIKEN Center for Computational Science, Kobe, Japan
e-mail: miwako.tsuji@riken.jp; h-murai@riken.jp; msato@riken.jp
T. Boku
Center for Computational Sciences, University of Tsukuba, Tsukuba, Japan
e-mail: taisuke@ccs.tsukuba.ac.jp
S. G. Petiton
LIFL, Université de Lille, Lille, France
e-mail: serge.petiton@univ-lille.fr
N. Emad · T. Dufaud
Li-Parad, UVSQ, Versailles, France
e-mail: nahid.emad@uvsq.fr; thomas.dufaud@uvsq.fr
J. Protze · C. Terboven · M. S. Müller
RWTH Aachen University, Aachen, Germany
e-mail: protze@itc.rwth-aachen.de; terboven@itc.rwth-aachen.de; mueller@itc.rwth-aachen.de
© The Author(s) 2021
M. Sato (ed.), XcalableMP PGAS Programming Language,
https://doi.org/10.1007/978-981-15-7683-6_9
219