Barrier synchronization hierarchical algorithm for multicore shared-memory systems
https://doi.org/10.55648/1998-6920-2022-16-2-3-11
Abstract
A hierarchical MPI barrier synchronization algorithm creating groups of processes that share common re-
sources at the memory hierarchy levels (L2/L3 caches, NUMA node, socket) is proposed. Synchronization is
performed in groups at each level of the hierarchy. Experiments on a dual-socket server with two Huawei
Kunpeng processors (128 cores, 4 NUMA nodes) showed that the proposed algorithm with NUMA nodes
process grouping provides the minimum execution time compared to known methods and is resistant to differ-
ent schemes of process placement.
About the Author
Mikhail Georgievich Kurnosov
Siberian State University of Telecommunications and Information Science
Russian Federation
Mikhail G. Kurnosov, Doctor of technical sciences, Professor
Russian Federation
Mikhail G. Kurnosov, Doctor of technical sciences, Professor
Novosibirsk
References
1. Jain S., Kaleem R., Balmana M., Langer A., Durnov D., Sannikov A. and Garzaran M. Framework for Scalable Intra-Node Collective Operations using Shared Memory. Proc. of the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC-2018), 2018, pp. 374-385.
2. Kurnosov M.G., Tokmasheva E.I. Optimizacija bar'ernoj sinhronizacii na asimmetrichnyh NUMApodsistemah processornyh jader [Barrier Optimization on Asymmetrical NUMA Subsystems]. Vestnik SibGUTI, 2021, no. 1, pp. 36-49.
3. Yew P.C., Tzeng N.F., Lawrie D.H. Distributing Hot Spot Addressing in Large Scale Multiprocessors. IEEE Transactions on Computers, 1987, vol. C-36, iss. 4, pp. 388-395.
4. Mellor-Crummey J.M., Scott M.L. Algorithms for Scalable Synchronization on Shared-memory Multiprocessors. ACM Transactions on Computer Systems, 1991, vol. 9(1), pp. 21-65.
5. Hengsen D., Finkel R., Manber U. Two Algorithms for Barrier Synchronization. Int. Journal of Parallel Programming, 1988, vol. 17, iss. 1, pp. 1-17.
6. Brooks E. The butterfly barrier. Journal of Parallel Programming, 1986, vol. 15, iss. 4, pp. 295-307.
Review
For citations:
Kurnosov M.G. Barrier synchronization hierarchical algorithm for multicore shared-memory systems. The Herald of the Siberian State University of Telecommunications and Information Science. 2022;(2):3-11. (In Russ.) https://doi.org/10.55648/1998-6920-2022-16-2-3-11
Views:
4998
JATS XML
Email this article 
