Infrastructures and services for remote sensing data production management across multiple satellite data centers | |
Zhang, Jie1; Yan, Jining1; Ma, Yan1; Xu, Dong1; Li, Pengfei1; Jie, Wei1 | |
刊名 | Cluster Computing |
2016 | |
卷号 | 19期号:3页码:1243-1260 |
关键词 | GIS ARCHITECTURE CLOUD IMAGE CYBERINFRASTRUCTURE ALGORITHMS NETWORK DESIGN |
通讯作者 | Ma, Yan (mayan@radi.ac.cn) |
英文摘要 | With the number of satellite sensors and date centers being increased continuously, it is becoming a trend to manage and process massive remote sensing data from multiple distributed sources. However, the combination of multiple satellite data centers for massive remote sensing (RS) data collaborative processing still faces many challenges. In order to reduce the huge amounts of data migration and improve the efficiency of multi-datacenter collaborative process, this paper presents the infrastructures and services of the data management as well as workflow management for massive remote sensing data production. A dynamic data scheduling strategy was employed to reduce the duplication of data request and data processing. And by combining the remote sensing spatial metadata repositories and Gfarm grid file system, the unified management of the raw data, intermediate products and final products were achieved in the co-processing. In addition, multi-level task order repositories and workflow templates were used to construct the production workflow automatically. With the help of specific heuristic scheduling rules, the production tasks were executed quickly. Ultimately, the Multi-datacenter Collaborative Process System (MDCPS) were implemented for large-scale remote sensing data production based on the effective management of data and workflow. As a consequence, the performance of MDCPS in experiments environment showed that those strategies could significantly enhance the efficiency of co-processing across multiple data centers. © 2016, Springer Science+Business Media New York. |
学科主题 | Computer Science |
类目[WOS] | Computer Science, Information Systems ; Computer Science, Theory & Methods |
收录类别 | SCI ; EI |
语种 | 英语 |
WOS记录号 | WOS:20162402479693 |
内容类型 | 期刊论文 |
源URL | [http://ir.radi.ac.cn/handle/183411/39339] |
专题 | 遥感与数字地球研究所_SCI/EI期刊论文_期刊论文 |
作者单位 | 1. Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, China 2. University of Chinese Academy of Sciences, Beijing, China 3. Institute of Information Sciences and Engineering, Yanshan University, Hebei, China 4. School of Computing and Engineering, University of West London, London, United Kingdom |
推荐引用方式 GB/T 7714 | Zhang, Jie,Yan, Jining,Ma, Yan,et al. Infrastructures and services for remote sensing data production management across multiple satellite data centers[J]. Cluster Computing,2016,19(3):1243-1260. |
APA | Zhang, Jie,Yan, Jining,Ma, Yan,Xu, Dong,Li, Pengfei,&Jie, Wei.(2016).Infrastructures and services for remote sensing data production management across multiple satellite data centers.Cluster Computing,19(3),1243-1260. |
MLA | Zhang, Jie,et al."Infrastructures and services for remote sensing data production management across multiple satellite data centers".Cluster Computing 19.3(2016):1243-1260. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论