Shared Memory Access Optimization Analysis System for PMIx Standard Implementation
https://doi.org/10.55648/1998-6920-2024-18-1-29-39
Abstract
The results in the field of system software stacks optimization for distributed computing systems based on the process management Interface (PMI) are obtained. Algorithms for synchronizing access to shared memory with a predominance of reading operations which are typical for PMIx implementation,are considered. The locking schemes N(mutex+signal) are proposed.
About the Authors
K. E. Kramarenko
The Institute of Semiconductor Physics, Siberian Branch of the Russian Academy of Sciences (ISP SB RAS);
Siberian State University of Telecommunications and Information Science (SibSUTIS)
Russian Federation
Russian Federation
Konstantin E. Kramarenko, Software engineer of ISP SB RAS; Senior lecturer, SibSUTIS
630090, Novosibirsk,
630102, Novosibirsk, Kirov St. 86
A. Y. Polyakov
NVIDIA
United States
United States
Artem Yu. Polyakov, Senior software architect
Santa Clara, California
A. V. Efimov
The Institute of Semiconductor Physics, Siberian Branch of the Russian Academy of Sciences (ISP SB RAS);
Siberian State University of Telecommunications and Information Science (SibSUTIS)
Russian Federation
Russian Federation
Alexander V. Efimov, Senior software engineer ISP SB RAS; Ph.D., docent, SibSUTIS
630090, Novosibirsk,
630102, Novosibirsk, Kirov St. 86
References
1. Khoroshevskii V. G. Arkhitektura vychislitel'nykh sistem [Architectures of computer systems]. Moscow, MGTU im. Baumana, 2008. 520 p.
2. Yu W., Wu J., Panda D. K. Fast and Scalable Startup of MPI Programs in InfiniBand Clusters. Proc. 11th International Conference on High Performance Computing (HiPC), Bangalore, India, 19-22 December, 2004, pp. 440-449.
3. Balaji P., Buntinas D., Goodell D., at. al. PMI: A Scalable Parallel Processmanagement Interface for Extreme-scale Systems. Proc. 17th European MPI Users’ Group Meeting Conference on Recent Advances in the Message Passing Interface (EuroMPI’10), Springer-Verlag, Berlin, Heidelberg, pp. 31-41.
4. Castain R. H., Solt D., Hursey J., Bouteiller A. PMIx: Process Management for Exascale Environments. Proc. 24th European MPI Users’ Group Meeting (EuroMPI ’17). ACM, New York, NY, USA, Article no. 14, 10 p.
5. Polyakov A., Karasev B., Hursey J. et. al. A Performance Analysis and Optimization of PMIx-based HPC Software Stacks. EuroMPI '19: Proceedings of the 26th European MPI Users' Group Meeting, September, 2019, article no. 9, pp. 1-10.
6. PMIx Consortium. 2017–2020. Process Management Interface for Exascale (PMIx) Standard (version 3.1), available at: https://github.com/pmix/pmixstandard/releases/download/v3.1/pmix-standard-3.1.pdf (accessed: 10.04.2023).
7. Open PMIx master repository, available at: https://github.com/openpmix/openpmix (accessed: 10.04.2023).
8. Message Passing Interface Forum. 2015. MPI-3.1: Official document, available at: http://www.mpi-forum.org/docs (accessed: 10.04.2023).
9. Argonne National Laboratory. 2014. Hydra Process Management Framework, available at: https://wiki.mpich.org/mpich/index.php/Hydra_Process_Management_Framework (accessed: 10.04.2023).
10. PMIx Reference RunTime Environment (PRRTE), available at: https://github.com/openpmix/prrte (accessed: 10.04.2023).
11. SchedMD, LLC. 2017. SLURM Workload Manager, available at: https://slurm.schedmd.com/ (accessed: 10.04.2023).
12. Chakraborty S., Subramoni H., Perkins J., Panda D. K. SHMEMPMI – Shared Memory Based PMI for Improved Performance and Scalability. Proc. 24th IEEE European MPI Users’ Group Meeting (CCGrid), pp. 60-69.
13. Calciu I., Dice D., Lev Y., Luchangco V. et. al. NUMA-aware reader-writer locks. Proc. 18th ACM SIGPLAN symposium on Principles and practice of parallel programming, ACM, New York, NY, USA, 2013, pp. 157-166.
14. IEEE Standard for Information Technology–Portable Operating System Interface (POSIX(R)) Base Specifications, iss. 7. IEEE Std 1003.1-2017 (Revision of IEEE Std 1003.1-2008), Jan, 2018, pp. 1-3951.
15. Hsieh W. C., Weihl W. E. Scalable Reader-Writer Locks for Parallel Systems. Proc. Sixth IEEE International Parallel Processing Symposium, 1992, pp. 656-659.
16. IEEE Standard for Information Technology–Portable Operating System Interface (POSIX(R)) Base Specifications, iss. 7. IEEE Std 1003.1-2017 (Revision of IEEE Std 1003.1-2008), Jan, 2018, pp. 1-3951, available at: https://doi.org/10.1109/IEEESTD.2018.8277153 (accessed: 01.09.2023).
17. Mellor-Crummey J., Scott M. Algorithms for scalable synchronization on shared-memory multiprocessors. ACM Trans. Comput. Syst, 1991, no. 9, pp. 21-65.
18. Mellor-Crummey J. Algorithms for Scalable Lock Synchronization on Shared-memory Multiprocessors. Department of Computer Science Rice University, Lecture 18. 17 March, 2009, pp. 1-49. available at: https://cs.anu.edu.au/courses/comp8320/lectures/aux/comp422-Lecture18-HWLocks.pdf (accessed: 10.04.2023).
19. Mikrobenchmark [Microbenchmark], available at: https://bitly.su/Wtxe0Z (accessed: 05.02.2023).
20. OpenPMIx, available at: https://shorturl.at/kwx14 (accessed: 16.04.2023).
21. Efimov A. V., Plyakov A. U., Kramarenko K. E., Bochkarev B. V. Optimizatsiya dostupa k obshchei pamyati dlya realizatsii standarta PMIx [Optimization of access to shared memory for the implementation of the PMIx standard]. Vestnik SibGUTI, 2020, no. 4, pp. 28-38.
Review
For citations:
Kramarenko K.E., Polyakov A.Y., Efimov A.V. Shared Memory Access Optimization Analysis System for PMIx Standard Implementation. The Herald of the Siberian State University of Telecommunications and Information Science. 2024;18(1):29-39. (In Russ.) https://doi.org/10.55648/1998-6920-2024-18-1-29-39
Views:
1795
Email this article 
