Multiple system fusion research Based on Hadoop and ETL
In recent years,urban road transport vehicle dynamic supervision and management of in-depth,constantly strengthen continuously,but also has a lot of problems and insufficiency.the transportation management office for different business management requirements have different management systems,Most of these systems and database are independent of each other,Each system is unable to share data,so We cant make full use of each system data to complete the dynamic regulation of road transport.Based on Hadoop and ETL technology,through the establishment of big data platform and data exchange sharing platform and data mart to implement the data cleaning and processing business.Data cleaning and processing business priorities to finish the unification of the huge amounts of data storage,management,information sharing and service to provide data resources.And as a support of application system,in view of the different business set up different topics.Establish a perfect architecture for data acquisition,loading,storage,analysis and application show,complete system data fusion,comprehensive dynamic regulation of road transport.
Hadoop ETL Big data data cleaning
Lili Zhang Yunwu Wan Lei Wang Hui Liu
Anhui Sun Create Electronic Co.,LTD,Hefei,Anhui 230088,China Hefei Taihe Optoelectronic Technology Co.,Ltd,Hefei,Anhui,China
国际会议
杭州
英文
166-171
2017-04-15(万方平台首次上网日期,不代表论文的发表时间)