会议专题

Multiple system fusion research Based on Hadoop and ETL

  In recent years,urban road transport vehicle dynamic supervision and management of in-depth,constantly strengthen continuously,but also has a lot of problems and insufficiency.the transportation management office for different business management requirements have different management systems,Most of these systems and database are independent of each other,Each system is unable to share data,so We cant make full use of each system data to complete the dynamic regulation of road transport.Based on Hadoop and ETL technology,through the establishment of big data platform and data exchange sharing platform and data mart to implement the data cleaning and processing business.Data cleaning and processing business priorities to finish the unification of the huge amounts of data storage,management,information sharing and service to provide data resources.And as a support of application system,in view of the different business set up different topics.Establish a perfect architecture for data acquisition,loading,storage,analysis and application show,complete system data fusion,comprehensive dynamic regulation of road transport.

Hadoop ETL Big data data cleaning

Lili Zhang Yunwu Wan Lei Wang Hui Liu

Anhui Sun Create Electronic Co.,LTD,Hefei,Anhui 230088,China Hefei Taihe Optoelectronic Technology Co.,Ltd,Hefei,Anhui,China

国际会议

The 3rd International Conference on Intelligent Energy and Power Systems (IEPS 2017)(第三届智能能源和电力系统国际会议)

杭州

英文

166-171

2017-04-15(万方平台首次上网日期,不代表论文的发表时间)