High Performance Data Processing Pipeline Of Chinese Solar Radio Heliograph
The Chinese Solar Radio Heliograph (CSRH) is a new generation radio heliograph would produce more than 4 terabytes data every day.As a aperture synthesis telescope,CSRH is facing the challenge of processing and storing such a vast data.Pipeline system is the key issue of data automatical processing for CSRH.In this study,to push the development of CSRH,we present a framework of high performance data processing pipeline system for saving and processing rcal-time observation data.The related techniques of pipeline software are presented in detail including raw data acquisition,UVFITS file,data calibration,parallel computing and data publication.The pipeline has been deployed and has played an important role for the development of CSRH.
CSRH data processing HPC
Fan Zhang FengWang Wei Wang Wei Dai Hui Deng Kaifan Ji Yihua Yan
Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Techno National Astronomical Observatory, Chinese Academy of Sciences, Beijing, 100087, China
国际会议
太原
英文
535-538
2013-04-06（万方平台首次上网日期，不代表论文的发表时间）