The Design and Realization of Incremental Data Extraction Method in ETL

摘要：

ETL(extraction,transformation and loading) is the key step of constructing a data warehouse.In order to realize the efficient data updating of data warehouse,this paper studies the strategy applied by incremental data extraction in ETL subsystem and elaborates the method and quality of each strategy.In this paper,a new incremental data extraction method is presented,which integrates multiple incremental data capture modes.This new method could resolve the difference of incremental data in the process of capturing heterogeneous data sources and solve the problem of data loss with assistant table in the procedure of data process.Finally,we introduce the realization of data formation and formation scheduler in the process of ETL.

关键词： ETL data warehouse increnemtnal data

作者: LU Nan LIANG Zhengping Wang Zhe

作者单位: College of Computer Science and Software Engineering,Shenzhen University,Shenzhen,PRC College of Computer Science and Technology.Jilin University,Changchun,PRC

会议类型: 国际会议

会议名称: 2011 3rd International Conference on Computer and Network Technology(ICCNT 2011)(2011第三届IEEE计算机与网络技术国际会议)

会议地点: 太原

会议语种:英文

页码: 282-286

在线出版日期: 2011-02-26（万方平台首次上网日期，不代表论文的发表时间）