Journal of Computer Applications ›› 2019, Vol. 39 ›› Issue (6): 1569-1576.DOI: 10.11772/j.issn.1001-9081.2018122606

• 2018 National Annual Conference on High Performance Computing (HPC China 2018) • Previous Articles     Next Articles

HSWAP: numerical simulation workflow management platform suitable for high performance computing environment

ZHAO Shicao, XIAO Yonghao, DUAN Bowen, LI Yufeng   

  1. Institute of Computer Application, China Academy of Engineering Physics, Mianyang Sichuan 621900, China
  • Received:2018-12-12 Revised:2019-03-01 Online:2019-06-10 Published:2019-06-17
  • Supported by:
    This work is partially supported by the National Key R&D Program of China (2018YFB0703900).

HSWAP:适用于高性能计算环境的数值模拟工作流管理平台

赵士操, 肖永浩, 段博文, 李于锋   

  1. 中国工程物理研究院 计算机应用研究所, 四川 绵阳 621900
  • 通讯作者: 赵士操
  • 作者简介:赵士操(1986-),男,陕西西安人,高级工程师,硕士,CCF会员,主要研究方向:科学工作流、软件架构设计、高性能数值模拟应用;肖永浩(1981-),男,甘肃永靖人,高级工程师,博士,CCF会员,主要研究方向:并行计算、科学工作流;段博文(1990-),男,黑龙江望奎人,工程师,硕士,CCF会员,主要研究方向:高性能计算服务;李于锋(1982-),男,河南光山人,高级工程师,博士研究生,CCF会员,主要研究方向:并行计算、调度算法。
  • 基金资助:
    国家重点研发计划项目(2018YFB0703900)。

Abstract: Concerning the construction of integrated application of "modeling, computation, analysis, optimization" workflow under High Performance Computing (HPC) environment, HPC Simulation Workflow Application Platform (HSWAP) supporting numerical simulation software encapsulation and numerical simulation workflow interaction design was developed. Firstly, based on the modeling of runtime characteristics of numerical simulation activities, the component model was built. Then, the control and data dependency relationships between simulation activities were represented by the workflow, creating a formal numerical simulation workflow model. The formed workflow model was able to be automatically parsed in the platform to adapt to HPC resources. Therefore, HSWAP platform could be used for automatic generation and scheduling of a batch of related numerical simulation tasks, screening technical details of HPC resources from domain users. The platform provided Web Portal services, which supports the push of interactive interfaces of graphical numerical simulation programs. The platform is already deployed and applied at Supercomputing Center and with this platform, the integration of numerical simulation workflows with up to 10 numerical simulation softwares and 20 computing task nodes can be completed in 2 person-month.

Key words: scientific workflow, numerical simulation, software integration, High Performance Computing (HPC), Web service

摘要: 针对高性能计算(HPC)环境中的"建模、计算、分析、优化"一体化应用构建的问题,设计了支持数值模拟软件封装和数值模拟工作流交互设计的数值模拟工作流管理平台——HSWAP。首先,基于对数值模拟活动的运行特征共性建模构建组件模型;然后,利用工作流表达数值模拟活动间的控制、数据依赖关系,建立形式化的数值模拟工作流模型,所形成的工作流模型可在平台中自动解析并适配高性能计算资源,从而实现批量关联数值模拟任务的自动生成与调度,为领域用户屏蔽高性能计算资源的使用细节。平台提供Web Portal服务,支持图形数值模拟程序的交互界面推送。目前该平台已在超算中心实际生产环境得到部署应用,可在2人月内完成包含10个以下数值模拟软件、20个以内计算任务节点的数值模拟工作流的集成。

关键词: 科学工作流, 数值模拟, 软件集成, 高性能计算, Web服务

CLC Number: