Research on real-time visualization analysis and processing engine technology of meteorological big data

Yongsheng Li; Jinbiao Zhang; Huihua Ruan; Yanping Zheng; Jie Guo

doi:10.1117/12.2641916

10 November 2022 Research on real-time visualization analysis and processing engine technology of meteorological big data

Yongsheng Li, Jinbiao Zhang, Huihua Ruan, Yanping Zheng, Jie Guo

Author Affiliations +

Proceedings Volume 12348, 2nd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2022); 123481T (2022) https://doi.org/10.1117/12.2641916
Event: 2nd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2022), 2022, Zhuhai, China

Abstract

With massive semi-structured meteorological big data as the research object, based on the mathematical model of the research object and the general architecture design of the system, a real-time visualization and analysis processing engine for meteorological big data is constructed; a fast data processing algorithm based on precise location is designed and implemented, and a persistent storage model suitable for the business characteristics of meteorological numerical forecast products is innovatively proposed based on the common NetCDF technology. This paper has built a visualization conversion algorithm for forecast elements and realized real-time analysis and processing of product visualization based on multi-loop visualization product generation and adaptation technology. Now the engine has been applied commercially in the meteorological numerical forecast product processing system of Guangdong Province, generating nearly 300,000 visualized graphic products per day, which plays a positive social benefit in the meteorological decision analysis business and meteorological sensitive social industries.

Citation Download Citation

Yongsheng Li, Jinbiao Zhang, Huihua Ruan, Yanping Zheng, and Jie Guo "Research on real-time visualization analysis and processing engine technology of meteorological big data", Proc. SPIE 12348, 2nd International Conference on Artificial Intelligence, Automation, and High-Performance Computing (AIAHPC 2022), 123481T (10 November 2022); https://doi.org/10.1117/12.2641916

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available