期刊文献+

超算环境科学工作流应用平台的引擎设计和资源调度 预览 被引量:3

Engine design and resource scheduling of scientific workflow application platform in supercomputing
在线阅读 下载PDF
分享 导出
摘要 围绕超算资源的易用性和多类软件的集成以及协作需求,开发了超算环境下的科学工作流应用平台,设计了异步并发的流程执行引擎,采取调度算法和调度器、引擎相分离的设计策略,给出了资源调度方案。提出了局部资源池化技术和资源预约算法,并比较分析了五种常用调度算法的性能,给出了算法选择的建议。实际应用表明设计的引擎能够支撑复杂工作流的灵活执行方式,给出的资源调度方案能够满足超算环境下工作流应用的高效执行。 In general,lots of software need to be cooperated together for particular object in scientific experiments and engineering domains.This paper described a new scientific workflow application platform in HPC environment.This platform contained an engine with high concurrency and asynchronous framework to process workflow application.Scheduler,planner and engine were decoupled from each other,which allowed that the three components could develop independently:scheduler for scheduling algorithms implementation,planner for collecting the scheduling information and engine for workflow driver.Scheduler and planner used resource advance reservation and local pooling mechanism to increase the performance of workflow execution.This paper also implemented and compared five scheduling algorithms as to their performance on testing graph set,and got some useful advices of algorithm selection.Real application shows that engine can support various execution strategies and resource scheduling solution can help increase efficiency of workflow execution in supercomputing environment.
作者 李于锋 莫则尧 肖永浩 赵士操 段博文 Li Yufeng;Mo Zeyao;Xiao Yonghao;Zhao Shicao;Duan Bowen(Institute of Computer Application,Chinese Academy of Engineering Physics,Mianyang Sichuan 621900,China;Institute of Applied Physics & Computational Mathematics,Beijing 100094,China)
出处 《计算机应用研究》 CSCD 北大核心 2019年第6期1723-1726,1736共5页 Application Research of Computers
基金 国家重点研发计划资助项目(2016YFB0201504,2018YFB0703903).
关键词 科学工作流 高性能计算 资源调度 工作流引擎 scientific workflow high performance computing resource scheduling workflow engine
作者简介 李于锋(1982-),男,河南光山人,高级工程师,硕士,主要研究方向为科学工作流、高性能计算(liyf@caep.cn);莫则尧(1971-),男,研究员,博士,主要研究方向为高性能计算、应用软件框架研制;通信作者:肖永浩(1981-),男,高级工程师,博士,主要研究方向为连贯性计算;赵士操(1986-),男,工程师,硕士,主要研究方向为集成业务平台软件架构设计;段博文(1990-),男,工程师,硕士,主要研究方向为Web应用开发.
  • 相关文献

参考文献3

二级参考文献83

  • 1韩守鹏,邱晓刚,黄柯棣.动态数据驱动的适应性建模与仿真[J].系统仿真学报,2006(z2):147-151. 被引量:13
  • 2宋琳琳.E—Science发展情况简介[J].图书馆学研究,2005(7):21-23. 被引量:11
  • 3Li Maozhen,MarkBaker.网格计算核心技术[M].王相林,张善卿,王景丽,译.北京:清华大学出版社,2006. 被引量:4
  • 4Jim Blythe, Ewa Deelman, Yolanda Gil.Planning for workflow construction and maintenance on the grid[C].ICAPS 2003 Work- shop on Web Services Composition,2003:8-14. 被引量:1
  • 5Jia Yu,Rajkumar Buyya.A taxonomy of workflow management systems for grid computing [J]. Journal of Grid Computing, 2005,10(3): 1-33. 被引量:1
  • 6Hoheisel A,Der U.An XML-based framework for loosely coup- led applications on grid environments[C].ICCS,2003:245-254. 被引量:1
  • 7DEELMAN E, GANNON D, SHIELDS M,et al. Workflows and e-Science: an overview of workflow system features and capabilities [ J ]. Future Generation Computer Systems,2009,25 ( 5 ) :528- 540. 被引量:1
  • 8Workflow Management Coaltion. The workflow model, WfMC-TC- 1003 [ R]. 1995. 被引量:1
  • 9Workflow Management Coalition. Terminology and glossary, WfMC-TC- 1011 [ R]. 1996. 被引量:1
  • 10Workflow Management Coalition. The workflow reference model, WfMC TC00-1003 [ R.]. 1994. 被引量:1

共引文献12

同被引文献17

引证文献3

投稿分析

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部 意见反馈