Availability/network-aware mapreduce over the internet | |
Tang, Bing1; Tang, Mingdong1; Fedak, Gilles2; He, Haiwu3 | |
刊名 | Information sciences |
2017-02-10 | |
卷号 | 379页码:94-111 |
关键词 | Mapreduce Volunteer computing Availability prediction Network distance estimation Naive bayes classifier |
ISSN号 | 0020-0255 |
DOI | 10.1016/j.ins.2016.09.030 |
通讯作者 | Tang, bing(b.tang@qq.com) ; He, haiwu(haiwuhe@cstnet.cn) |
英文摘要 | Mapreduce offers an ease-of-use programming paradigm for processing large datasets. in our previous work, we have designed a mapreduce framework called bitdew-mapreduce for desktop grid and volunteer computing environment, that allows nonexpert users to run data-intensive mapreduce jobs on top of volunteer resources over the internet. however, network distance and resource availability have great impact on mapreduce applications running over the internet. to address this, an availability and network-aware mapreduce framework over the internet is proposed. simulation results show that the mapreduce job response time could be decreased by 40.05%, thanks to weighted naive bayes classifier based availability prediction and landmark-based network estimation. the effectiveness of the new mapreduce framework is further proved by performance evaluation in a real distributed environment. (c) 2016 elsevier inc. all rights reserved. |
WOS关键词 | DISTANCE ESTIMATION SERVICE ; LARGE-SCALE ; SYSTEMS ; INFRASTRUCTURES ; MANAGEMENT ; CLUSTERS |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Information Systems |
语种 | 英语 |
出版者 | ELSEVIER SCIENCE INC |
WOS记录号 | WOS:000389105500007 |
内容类型 | 期刊论文 |
URI标识 | http://www.corc.org.cn/handle/1471x/2374197 |
专题 | 计算机网络信息中心 |
通讯作者 | Tang, Bing; He, Haiwu |
作者单位 | 1.Hunan Univ Sci & Technol, Sch Comp Sci & Engn, Xiangtan 411201, Peoples R China 2.Univ Lyon, UCB Lyon 5668, LIP Lab, UMR CNRS,ENS Lyon,INRIA, F-69364 Lyon 07, France 3.Chinese Acad Sci, Comp Network Informat Ctr, Beijing 100190, Peoples R China |
推荐引用方式 GB/T 7714 | Tang, Bing,Tang, Mingdong,Fedak, Gilles,et al. Availability/network-aware mapreduce over the internet[J]. Information sciences,2017,379:94-111. |
APA | Tang, Bing,Tang, Mingdong,Fedak, Gilles,&He, Haiwu.(2017).Availability/network-aware mapreduce over the internet.Information sciences,379,94-111. |
MLA | Tang, Bing,et al."Availability/network-aware mapreduce over the internet".Information sciences 379(2017):94-111. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论