Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap

CORC > 云南天文台 > 中国科学院云南天文台 > 其他

	Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap
	Liu YB(刘应波)1,2 ; Dai, HM 1; Wang F(王锋)1,2 ; Dai W(戴伟)1 ; Deng, H 1
	2015
会议名称	IEEE International Conference on Systems, Man, and Cybernetics (SMC)
会议日期	2015-10-09
会议地点	City Univ Hong Kong, Hong Kong, PEOPLES R CHINA
关键词	Word-Aligned Hybrid Bitmap Fastbit Indexing NoSQL
页码	1567-1572
通讯作者	Liu, YB (reprint author), Kunming Univ Sci & Technol, Comp Technol Applicat Key Lab Yunnan Prov, Kunming 650500, Peoples R China.
英文摘要	New Vacuum Solar Telescope (NVST) possesses a world-class solar telescope which observes the sun by high-resolution image instruments and multi-wave spectrometer in visible and near infrared bands. NVST has gathered millions of Flexible Image Transport System(FITS) files since it has been for the routine observation and thousands of files are generated in a day. To search efficiently for a subset of these extremely large and linearly increasing FITS files with low latency and response time goes beyond traditional database systems. In this paper, We present an NVST indexing and querying framework(NIQF) based on an implementation of word-aligned hybrid bitmaps to deal with the issue, and design several simple and useful APIs, which are convenient for integrating with NVST data archiving system and meet the requirements of fast data indexing of massive data processing in NVST. We study the performance of NIQF by comparing with MySQL. The results demonstrate that the performance of NIQF is more efficient than MySQL in a huge amount of solar data set. This study indicates potential performance and feasibility of NIQF for large astronomical data indexing and querying in NVST.
收录类别	CPCI
产权排序	第2完成单位
会议主办者	City Univ Hong Kong
会议网址	http://ieeexplore.ieee.org/document/7379409/
会议录	IEEE International Conference on Systems Man and Cybernetics Conference Proceedings - 2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS
会议录出版者	IEEE COMPUTER SOC
会议录出版地	10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA
学科主题	Computer Science
语种	英语
ISSN号	1062-922X
ISBN号	978-1-4799-8696-5
WOS记录号	WOS:000368940201109
研究领域[WOS]	Computer Science
内容类型	会议论文
源URL	[http://ir.ynao.ac.cn/handle/114a53/9694]
专题	云南天文台_其他
作者单位	1.Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Kunming 650500, China 2.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China
推荐引用方式 GB/T 7714	Liu YB,Dai, HM,Wang F,et al. Efficient Indexing and Querying of Massive Astronomical Data Using Compressed Word-Aligned Hybrid Bitmap[C]. 见:IEEE International Conference on Systems, Man, and Cybernetics (SMC). City Univ Hong Kong, Hong Kong, PEOPLES R CHINA. 2015-10-09.http://ieeexplore.ieee.org/document/7379409/.