Tencentrec: Real-time stream recommendation in practice | |
Huang, Yanxiang ; Cui, Bin ; Zhang, Wenyu ; Jiang, Jie ; Xu, Ying | |
2015 | |
英文摘要 | With the arrival of the big data era, opportunities as well as challenges arise in both industry and academia. As an important service in most web applications, accurate real-time recommendation in the context of big data is of high demand. Traditional recommender systems that analyze data and update models at regular time intervals cannot satisfy the requirements of modern web applications, calling for real-time recommender systems. In this paper, we tackle the 'big', 'real-time' and 'accurate' challenges in real-time recommendation, and propose a general real-time stream recommender system built on Storm named TencentRec from three aspects, i.e., 'system', 'algorithm', and 'data'. We analyze the large amount of data streams from a wide range of applications leveraging the considerable computation ability of Storm, together with a data access component and a data storage component developed by us. To deal with various application specific demands, we have implemented several classic practical recommendation algorithms in TencentRec, including the item-based collaborative filtering, the content based, and the demographic based algorithms. Specially, we present a practical scalable item-based CF algorithm in detail, with the super characteristics such as robust to the implicit feedback problem, incremental update and real-time pruning. With the enhancement of real-time data collection and processing, we can capture the recommendation changes in real-time. We deploy the TencentRec in a series of production applications, and observe the superiority of TencentRec in providing accurate real-time recommendations for 10 billion user requests everyday. Copyright ? 2015 ACM.; EI; 227-238; 2015-May |
语种 | 英语 |
出处 | ACM SIGMOD International Conference on Management of Data, SIGMOD 2015 |
DOI标识 | 10.1145/2723372.2742785 |
内容类型 | 其他 |
源URL | [http://ir.pku.edu.cn/handle/20.500.11897/436810] |
专题 | 信息科学技术学院 |
推荐引用方式 GB/T 7714 | Huang, Yanxiang,Cui, Bin,Zhang, Wenyu,et al. Tencentrec: Real-time stream recommendation in practice. 2015-01-01. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论