Researches on Real-time Satellite Data Flow Processing Based on File Buffer
In the field of aerospace, all of real-time data sent by satellites and spaceships need to be stored into a relational database, and it is essential to develop real-time applications in order to implement the storing process automatically. Based on the implementation of a real-time satellite data flow storing application, this paper introduces features of real-time satellite data processing problem, and design architecture of pipeline-filter style as the framework of the application. As the indeterminacy of duration of insert operation in non-real-time database and the limited memory in the server, a method using the file to implement blocking queue for fault-tolerance is designed. With the pipeline/filter architecture design and the file blocking queue buffer method, a detail of implementation and an overall solution of application deployment are provided. In order to verify that the method of the file blocking queue has a better performance than that of the memory blocking queue, a comparative experiment simulating a real environment is designed. Our work proves that it is feasible and rational to use the file buffer in the specific application including non-real-time factors; in addition a nonreal-time database can be used in the field of realtime with the proper mechanism of fault-tolerance.
aerospace data flow real-time data processing pipeline/filter architecture file blocking queue
Zhang Yang YuDan Ma Shilong
School of Computer Science and Engineering Beihang University Beijing 100191, P.R.China
国际会议
2011 Seventh International Conference on Natural Computation(第七届自然计算国际会议 ICNC 2011)
上海
英文
1795-1801
2011-07-26（万方平台首次上网日期，不代表论文的发表时间）