Proactive Serving Decreases User Delay Exponentially:The Light-Tailed Service Time Case
In online service systems,the delay experienced by a user from the service request to the service completion is one of the most critical performance metrics.To improve user delay experience,recent industrial practice suggests a modern system design mechanism: proactive serving,where the system predicts future user requests and allocates its capacity to serve these upcoming requests proactively.In this paper,we investigate the fundamentals of proactive serving from a theoretical perspective.In particular,we show that proactive serving decreases average delay exponentially(as a function of the prediction window size).Our results provide theoretical foundations for proactive serving and shed light on its application in practical systems.
Proactive serving Light-tailed service time User delay
Shaoquan Zhang Longbo Huang Minghua Chen Xin Liu
Department of Information Engineering,The Chinese University of Hong Kong Institute of Interdisciplinary Information Sciences,Tsinghua University Department of Computer Science,University of California,Davis
国际会议
河北秦皇岛
英文
21-24
2017-08-21（万方平台首次上网日期，不代表论文的发表时间）