Research on Optimization of Docker Scheduling Performance for Simulation Environment of Meteorological Big Data Cloud Platform
CSTR:
Author:
Affiliation:

Clc Number:

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    In order to achieve the goal of independent and controllable key core technologies for Meteo by 2025, the Meteo Big Data Cloud Platform (referred to as Tianqing) establishes a simulation environment based on Hygon X86 CPU and Kylin OS. However, in the operation of simulation platforms, it finds that the docker scheduling performance of data processing and assembly line subsystems based on Kubernetes is poor, which cannot meet the timeliness requirements of user integration algorithms. In response to this issue, this article adopts a comparative analysis method, selecting servers based on three types of CPU and three types of operating systems from the simulation environment and business environment for Tianqing as the research objects. A series of combined comparative test cases are designed. It finds that the kernel is the key factor affecting docker scheduling performance. Further analysis is conducted on the impact of operating system kernel settings on real-time and throughput, as well as the suitable business scenarios. Finally, a method for adjusting the Kylin OS kernel is provided. By adjusting the kernel settings, the docker scheduling performance significantly improves, meeting the timeliness requirements of the data processing system and laying the foundation for achieving self-supporting of the key core technology of Tianqing.

    Reference
    Related
    Cited by
Get Citation

吴鹏,韩同欣,陈士旺,聂元丁,郑晓志.气象大数据云平台仿真环境容器调度性能优化研究[J].气象科技英文版,2024,52(3):340-346.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:June 02,2023
  • Revised:January 12,2024
  • Adopted:
  • Online: June 25,2024
  • Published:
Article QR Code
You are thevisitors     Copyright:    
Organizer:中国气象局气象探测中心,中国气象科学研究院,北京市气象局,国家卫星气象中心,国家气象信息中心
     Address:北京市海淀区中关村南大街46号       E-mail:100081      Telephone :010-68407256      Fax:010-68407256
Supported by:Beijing E-Tiller Technology Development Co., Ltd.