A closed-cycle gasoline compression ignition (GCI) engine simulation near top dead center (TDC) was used to profile the performance of a parallel commercial engine computational fluid dynamics (CFD) code, as it was scaled on up to 4096 cores of an IBM Blue Gene/Q (BG/Q) supercomputer. The test case has 9 × 106 cells near TDC, with a fixed mesh size of 0.15 mm, and was run on configurations ranging from 128 to 4096 cores. Profiling was done for a small duration of 0.11 crank angle degrees near TDC during ignition. Optimization of input/output (I/O) performance resulted in a significant speedup in reading restart files, and in an over 100-times speedup in writing restart files and files for postprocessing. Improvements to communication resulted in a 1400-times speedup in the mesh load balancing operation during initialization, on 4096 cores. An improved, “stiffness-based” algorithm for load balancing chemical kinetics calculations was developed, which results in an over three-times faster runtime near ignition on 4096 cores relative to the original load balancing scheme. With this improvement to load balancing, the code achieves over 78% scaling efficiency on 2048 cores, and over 65% scaling efficiency on 4096 cores, relative to 256 cores.
Development of a Stiffness-Based Chemistry Load Balancing Scheme, and Optimization of Input/Output and Communication, to Enable Massively Parallel High-Fidelity Internal Combustion Engine Simulations
9700 S. Cass Avenue,
Argonne, IL 60439
e-mail: harms@alcf.anl.gov
6400 Enterprise Lane,
Madison, WI 53719
e-mail: priyesh.srivastava@convergecfd.com
6400 Enterprise Lane,
Madison, WI 53719
e-mail: shaoping.quan@convergecfd.com
9700 S. Cass Avenue,
Argonne, IL 60439
e-mail: mgarcia@alcf.anl.gov
9700 S. Cass Avenue,
Argonne, IL 60439
e-mail: harms@alcf.anl.gov
6400 Enterprise Lane,
Madison, WI 53719
e-mail: priyesh.srivastava@convergecfd.com
6400 Enterprise Lane,
Madison, WI 53719
e-mail: shaoping.quan@convergecfd.com
9700 S. Cass Avenue,
Argonne, IL 60439
e-mail: mgarcia@alcf.anl.gov
Contributed by the Internal Combustion Engine Division of ASME for publication in the JOURNAL OF ENERGY RESOURCES TECHNOLOGY. Manuscript received January 12, 2016; final manuscript received January 12, 2016; published online February 23, 2016. Editor: Hameed Metghalchi.
The United States Government retains, and by accepting the article for publication, the publisher acknowledges that the United States Government retains, a non-exclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this work, or allow others to do so, for United States government purposes.
Kodavasal, J., Harms, K., Srivastava, P., Som, S., Quan, S., Richards, K., and García, M. (February 23, 2016). "Development of a Stiffness-Based Chemistry Load Balancing Scheme, and Optimization of Input/Output and Communication, to Enable Massively Parallel High-Fidelity Internal Combustion Engine Simulations." ASME. J. Energy Resour. Technol. September 2016; 138(5): 052203. https://doi.org/10.1115/1.4032623
Download citation file: