IB-LBM parallel optimization method mixed with multiple task scheduling modes

doi:10.11772/j.issn.1001-9081.2019081401

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (2): 386-391.DOI: 10.11772/j.issn.1001-9081.2019081401

• DPCS 2019 • Previous Articles Next Articles

IB-LBM parallel optimization method mixed with multiple task scheduling modes

Zhixiang LIU¹, Huichao LIU¹, Dongmei HUANG¹^,²(), Liping ZHOU³, Cheng SU⁴

^1.College of Information Technology，Shanghai Ocean University，Shanghai 201306，China
^2.Shanghai University of Electric Power，Shanghai 200090，China
^3.School of Computer Engineering and Science，Shanghai University，Shanghai 200444，China
^4.East China Sea Forecast Center，East China Sea Branch of the State Oceanic Administration，Shanghai 200136，China

Received:2019-07-31 Revised:2019-08-30 Accepted:2019-09-19 Online:2019-09-29 Published:2020-02-10
Contact: Dongmei HUANG
About author:LIU Zhixiang， born in 1986， Ph. D.， lecturer. His research interests include high performance computing， computational fluid dynamics.
LIU Huichao， born in 1996， M. S. candidate. His research interests include high performance computing.
ZHOU Liping， born in 1984， M. S.， experimentalist. Her research interests include parallel computing.
SU Cheng， born in 1962， professor. His research interests include spatial information， hydrographic surveying and charting.
Supported by:
the Shanghai Sailing Program(18YF1410100);the National Natural Science Foundation of China(91630206);the Program for the Capacity Development of Shanghai Local Colleges(17050501900);the Funding Program of Shanghai University Young Teacher Training(ZZSHOU18012);the Doctoral Scientific Research Start Foundation of Shanghai Ocean University(A2-2006-00-200338)

多种任务调度混合的IB-LBM并行优化方法

刘智翔¹, 刘慧超¹, 黄冬梅¹^,²(), 周丽萍³, 苏诚⁴

^1.上海海洋大学信息学院，上海 201306
^2.上海电力大学，上海 200090
^3.上海大学计算机工程与科学学院，上海 200444
^4.国家海洋局东海分局东海预报中心，上海 200136

通讯作者: 黄冬梅
作者简介:刘智翔（1986—），男，湖南邵东人，讲师，博士，CCF会员，主要研究方向：高性能计算、计算流体力学
刘慧超（1996—），男，山东潍坊人，硕士研究生，主要研究方向：高性能计算
周丽萍（1984—），女，江西临川人，实验师，硕士，主要研究方向：并行计算
苏诚（1962—），男，上海人，教授，主要研究方向：空间信息、海洋测绘。
基金资助:
上海市青年科技英才扬帆计划资助项目(18YF1410100);国家自然科学基金资助项目(91630206);上海市地方高校能力建设项目(17050501900);上海高校青年教师培养资助计划项目(ZZSHOU18012);上海海洋大学博士科研启动基金资助项目(A2-2006-00-200338)

Abstract

Abstract:

When using Immersed Boundary-Lattice Boltzmann Method （IB-LBM） to solve the flow field， in order to obtain more accurate results， a larger and denser flow field grid is often required， which results in a long time of simulation process. In order to improve the efficiency of the simulation， according to the characteristics of IB-LBM local calculation， combined with three different task scheduling methods in OpenMP， a parallel optimization method of IB-LBM was proposed. In the parallel optimization， three task scheduling modes were mixed to solve the load imbalance problem caused by single task scheduling. The structural decomposition was performed on IB-LBM， and the optimal scheduling mode of each structure part was tested. Based on the experimental results， the optimal scheduling combination mode was selected. At the same time， it could be concluded that the optimal combination is different under different thread counts. The optimization results were verified by speedup， and it could be concluded that when the number of threads is small， the speedup approaches the ideal state； when the number of threads is large， although the additional time consumption of developing and destroying threads affects the optimization of performance， the parallel performance of the model is still greatly improved. The flow field simulation results show that the accuracy of IB-LBM simulation of fluid-solid coupling problems is not affected after parallel optimization.

Key words: immersed boundary method, lattice Boltzmann method, flow field, OpenMP, task scheduling, parallel, speedup

摘要：

在使用浸入边界-格子玻尔兹曼方法（IB-LBM）求解流场时，为了得出比较精确的结果，往往需要规模较大、较密集的流场网格，这就会造成模拟过程时间长的问题。为了提高模拟的效率，利用IB-LBM局部计算的特点，结合OpenMP中三种不同的任务调度方式，给出了IB-LBM的并行优化方法。在并行优化中混合使用三种任务调度方式，以弥补单一任务调度造成的负载不均衡问题；将IB-LBM进行结构化分解，测试每一结构部分的最优调度方式，根据实验结果选择最优的调度组合方式，而在不同线程数下，最优的组合方式是不同的。优化结果通过并行加速比来检验，可以得出：在线程数较少的情况下，加速比趋近于理想状态；在线程数较多的情况下，虽然线程开辟和销毁的额外时间消耗对性能的优化产生了影响，模型的并行性能仍有了很大的提升。流场的模拟结果显示，在进行并行优化后， IB-LBM对流固耦合问题模拟的准确性并没有受到影响。

关键词: 浸入边界法, 格子玻尔兹曼法, 流场, OpenMP, 任务调度, 并行, 加速比

CLC Number:

TP309

Zhixiang LIU, Huichao LIU, Dongmei HUANG, Liping ZHOU, Cheng SU. IB-LBM parallel optimization method mixed with multiple task scheduling modes[J]. Journal of Computer Applications, 2020, 40(2): 386-391.

刘智翔, 刘慧超, 黄冬梅, 周丽萍, 苏诚. 多种任务调度混合的IB-LBM并行优化方法[J]. 《计算机应用》唯一官方网站, 2020, 40(2): 386-391.

Figures/Tables 13

References 19

1	PESKIN C S. Numerical analysis of blood flow in the heart［J］. Journal of Computational Physics， 1977， 25（3）：220-252. 10.1016/0021-9991(77)90100-0
2	FENG Z， MICHAELIDES E E. The immersed boundary-lattice Boltzmann method for solving fluid-particles interaction problems［J］. Journal of Computational Physics， 2004， 195（2）：602-628. 10.1016/j.jcp.2003.10.013
3	MA X， HUANG B， WANG G， et al. Numerical simulation of the red blood cell aggregation and deformation behaviors in ultrasonic field［J］. Ultrasonics Sonochemistry， 2017， 38： 604-613. 10.1016/j.ultsonch.2016.08.021
4	AFRA B， NAZARI M， KAYHANI M H， et al. An immersed boundary-lattice Boltzmann method with a robust lattice spring model for solving flow-structure-interaction problems［J］. Applied Mathematical Modelling， 2018， 55： 502-521. 10.1016/j.apm.2017.10.014
5	GONG C， FANG Z， CHEN G. A lattice Boltzmann-immersed boundary-finite element method for nonlinear fluid-solid interaction simulation with moving objects［J］. International Journal of Computational Methods， 2018， 15（7）： No.1850063. 10.1142/s0219876218500639
6	WANG L， ZHANG L. Lattice Boltzmann method with immersed spring boundaries for flow around deformable porous media［J］. Computers and Fluids， 2017， 155： 161-170. 10.1016/j.compfluid.2016.07.003
7	VALERO-LARA P， PINELLI A， PRIETO-MATIAS M. Accelerating solid-fluid interaction using lattice-Boltzmann and immersed boundary coupled simulations on heterogeneous platforms［J］. Procedia Computer Science， 2014， 29： 50-61. 10.1016/j.procs.2014.05.005
8	LORENZ E， SIVADASAN V， BONN D， et al. Combined lattice-Boltzmann and rigid-body method for simulations of shear-thickening dense suspensions of hard particles［J］. Computers and Fluids， 2018， 172： 474-482. 10.1016/j.compfluid.2018.03.056
9	QIAN Y H， D’HUMIÈRES D， LALLEMAND P. Lattice BGK models for Navier-Stokes equation［J］. Europhysics Letters， 1992， 17（6）：479-484. 10.1209/0295-5075/17/6/001
10	GUO Z， ZHENG C， SHI B. Non-equilibrium extrapolation method for velocity and boundary conditions in the lattice Boltzmann method［J］. Chinese Physics， 2002， 11（4）：366-374. 1009-1963(2002)l:4<366:NEEMFV>2.0.TX;2-W
11	GUO Z， ZHENG C， SHI B. Discrete lattice effects on the forcing term in the lattice Boltzmann method［J］. Physical Review E， 2002， 654 Pt 2B）： No.046308. 10.1103/PhysRevE.65.046308
12	SETA T， UCHIYAMA T， TAKANO N. Smoothed profile-lattice Boltzmann method for non-penetration and wetting boundary conditions in two and three dimensions［J］. Computers and Fluids， 2017， 159：64-80. 10.1016/j.compfluid.2017.09.012
13	HU Y， LI D， SHU S， et al. An efficient smoothed profile-lattice Boltzmann method for the simulation of forced and natural convection flows in complex geometries［J］. International Communications in Heat and Mass Transfer， 2015， 68：188-199. 10.1016/j.icheatmasstransfer.2015.05.030
14	JAFARI S， YAMAMOTO R， RAHNAMA M. Lattice-Boltzmann method combined with smoothed-profile method for particulate suspensions［J］. Physical Review E， 2011， 83（2 Pt 2）： No.026702. 10.1103/physreve.83.026702
15	GRESHO P M， CHAN S T， LEE R L， et al. A modified finite element method for solving the time-dependent， incompressible Navier-Stokes equations. I： theory［J］. International Journal for Numerical Methods in Fluids， 1984， 4（6）： 557-598. 10.1002/fld.1650040608
16	ADEEB E， HAIDER B A， SOHN C H. Influence of rounded corners on flow interference between two tandem cylinders using FVM and IB-LBM［J］. International Journal of Numerical Methods for Heat and Fluid Flow， 2018， 28（7）： 1648-1663. 10.1108/HFF-08-2017-0319
17	LEE K， YANG K S. Flow patterns past two circular cylinders in proximity［J］. Computers and Fluids， 2009， 38（4）：778-788. 10.1016/j.compfluid.2008.07.005
18	SAIKI E M， BIRINGEN S. Numerical simulation of a cylinder in uniform flow： application of a virtual boundary method［J］. Journal of Computational Physics， 1996， 123（2）：450-465. 10.1006/jcph.1996.0036
19	WU J， SHU C. Implicit velocity correction-based immersed boundary-lattice Boltzmann method and its applications［J］. Journal of Computational Physics， 2009， 228（6）： 1963-1979. 10.1016/j.jcp.2008.11.019

演化函数	线程数
演化函数	2	4	8	16
恢复力的计算	s	s	g	g
体积力的计算	d	g	d	g
碰撞和迁移	d	g	d	d
边界处理	d	g	g	d
宏观量的计算	d	d	g	g
计算参考点位置	s	s	g	g

演化函数	线程数
演化函数	2	4	8	16
恢复力的计算	s	s	g	g
体积力的计算	d	g	d	g
碰撞和迁移	d	g	d	d
边界处理	d	g	g	d
宏观量的计算	d	d	g	g
计算参考点位置	s	s	g	g

调度方式	线程数
调度方式	2	4	8	16
理想状态	2.000	4.000	8.000	16.000
多种任务调度	1.944	3.746	7.149	12.416
s调度	1.862	3.695	6.813	10.828
d调度	1.760	3.678	6.795	12.167
g调度	1.696	3.542	6.643	10.560

调度方式	线程数
调度方式	2	4	8	16
理想状态	2.000	4.000	8.000	16.000
多种任务调度	1.944	3.746	7.149	12.416
s调度	1.862	3.695	6.813	10.828
d调度	1.760	3.678	6.795	12.167
g调度	1.696	3.542	6.643	10.560

流场规模	线程数
流场规模	2	4	8	16
理想状态	2.000	4.000	8.000	16.000
10万	1.609	3.157	5.529	8.450
100万	1.824	3.649	7.269	12.522
1 000万	1.916	3.992	7.996	14.854

IB-LBM parallel optimization method mixed with multiple task scheduling modes

多种任务调度混合的IB-LBM并行优化方法

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 13

References 19

Related Articles 15

Recommended Articles

Metrics

Re	对比文献	阻力系数	L	Re	对比文献	阻力系数	L
20	Seta等^［12］	2.045	1.88	40	Seta等^［12］	1.572	4.66
	Hu等^［13］	2.106	1.90		Hu等^［13］	1.569	4.64
	Jafari等^［14］	2.106	1.90		Jafari等^［14］	1.569	4.64
	本文	2.105	1.83		本文	1.505	4.53

Re	对比文献	阻力系数	St	Re	对比文献	阻力系数	St
100	Gresho等^［15］	1.760	0.180	200	Gresho等^［17］	1.760	0.210
	Ehsan等^［16］	1.342	0.166		Saiki等^［18］	1.180	0.197
	Lee等^［17］	1.340	0.165		Wu等^［19］	1.349	0.193
	本文	1.664	0.160		本文	1.633	0.190

[1]	Rui ZHANG, Pengyun ZHANG, Meirong GAO. Self-optimized dual-modal multi-channel non-deep vestibular schwannoma recognition model [J]. Journal of Computer Applications, 2024, 44(9): 2975-2982.
[2]	Runlian ZHANG, Mi ZHANG, Xiaonian WU, Rui SHU. Differential property evaluation method based on GPU for large-state cryptographic S-boxes [J]. Journal of Computer Applications, 2024, 44(9): 2785-2790.
[3]	Shuo SUN, Wei ZHANG, Wendi FENG, Yuwei ZHANG. Automatic foreign function interface generation method based on source code analysis [J]. Journal of Computer Applications, 2024, 44(7): 2151-2159.
[4]	Jun FENG, Jiankang BI, Yiru HUO, Jiakuan LI. PIPNet： lightweight asphalt pavement crack image segmentation network [J]. Journal of Computer Applications, 2024, 44(5): 1520-1526.
[5]	Jian SUN, Baoquan MA, Zhuiwei WU, Xiaohuan YANG, Tao WU, Pan CHEN. Joint optimization of UAV swarm path planning and task allocation balance in earthquake scenarios [J]. Journal of Computer Applications, 2024, 44(10): 3232-3239.
[6]	Shaofa SHANG, Lin JIANG, Yuancheng LI, Yun ZHU. Adaptive partitioning and scheduling method of convolutional neural network inference model on heterogeneous platforms [J]. Journal of Computer Applications, 2023, 43(9): 2828-2835.
[7]	Zhenyu LIU, Chaokun WANG, Gaoyang GUO. Parallel algorithm of betweenness centrality for dynamic networks [J]. Journal of Computer Applications, 2023, 43(7): 1987-1993.
[8]	Heping FANG, Shuguang LIU, Yongyi RAN, Kunhua ZHONG. Integrated scheduling optimization of multiple data centers based on deep reinforcement learning [J]. Journal of Computer Applications, 2023, 43(6): 1884-1892.
[9]	Mengyi LI, Xia FANG, Hongbo ZHENG, Xujia QIN. Oriented line integral convolution algorithm for flow field based on information entropy [J]. Journal of Computer Applications, 2023, 43(4): 1233-1239.
[10]	Mingchao NING, Junbo ZHANG, Ge CHEN. Task scheduling algorithm for service-oriented architecture-based industrial software [J]. Journal of Computer Applications, 2023, 43(3): 885-893.
[11]	Qian LIU, Yangming ZHANG, Dingsheng WAN. Parallel computing algorithm of grid-based distributed Xin’anjiang hydrological model [J]. Journal of Computer Applications, 2023, 43(11): 3327-3333.
[12]	Hu CHEN, Pengling ZHOU. Programming model for domestic high-performance many-core processor [J]. Journal of Computer Applications, 2023, 43(11): 3517-3526.
[13]	WU Renbiao, ZHANG Zhenchi, JIA Yunfei, QIAO Han. Adaptive scheduling strategy based on deadline under cloud platform [J]. Journal of Computer Applications, 2023, 43(1): 176-184.
[14]	JIANG Songyan, LIAO Xiaojuan, CHEN Guangzhu. Optimal task scheduling method based on satisfiability modulo theory for multiple processors with communication delay [J]. Journal of Computer Applications, 2023, 43(1): 185-191.
[15]	Jingwen CAI, Yongzhuang WEI, Zhenghong LIU. GPU-based method for evaluating algebraic properties of cryptographic S-boxes [J]. Journal of Computer Applications, 2022, 42(9): 2750-2756.