Paper
3 October 2022 Design of EAST diagnostic database based on HDF5
Kun Jiang, Shi Li
Author Affiliations +
Proceedings Volume 12290, International Conference on Computer Network Security and Software Engineering (CNSSE 2022); 1229016 (2022) https://doi.org/10.1117/12.2640728
Event: International Conference on Computer Network Security and Software Engineering (CNSSE 2022), 2022, Zhuhai, China
Abstract
The tokamak plasma experimental device is composed of various subsystems. The data generated by diagnostic systems such as density and electromagnetic measurement are the basis for offline physical analysis to provide data sources for plasma control. The diagnostic data acquisition time varies according to the needs of pulse discharge, and each experiment will generate a large amount of data. With the continuous increase of discharge time, the existing diagnostic database storage system can no longer meet the needs of plasma long-pulse discharge. In order to store long-pulse diagnostic data, it is necessary to design a high-performance diagnostic database storage system with flexible storage mechanism and convenient data retrieval for users. After investigation and comparison, because HDF5's own flexible technology stack can meet the evolving needs of data users, the database uses HDF5 as the data storage format. The overall storage system is based on C/S architecture, and uses TCP/IP technology to collect, transmit, store and display data. The metadata manager is responsible for the mapping of external requests to HDF5 files, and the HDF5 readers and writers are responsible for performing the actual data reading and writing. The storage of the database adopts the time slice method, which realizes fragmented reading, snapshot drawing, and parallel writing. The console interface also records the number of data accesses, and dumps frequently accessed data to a high-speed hard disk. After testing, the system can run stably and has good portability and expansibility.
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Kun Jiang and Shi Li "Design of EAST diagnostic database based on HDF5", Proc. SPIE 12290, International Conference on Computer Network Security and Software Engineering (CNSSE 2022), 1229016 (3 October 2022); https://doi.org/10.1117/12.2640728
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Diagnostics

Data storage

Databases

Data acquisition

Data modeling

Data processing

Back to Top