CAMHID: Camera Motion Histogram Descriptor and Its Application to Cinematographic Shot Classification

CORC > 自动化研究所 > 中国科学院自动化研究所 > 模式识别国家重点实验室 > 多媒体计算与图形学团队

	CAMHID: Camera Motion Histogram Descriptor and Its Application to Cinematographic Shot Classification
	Hasan, Muhammad Abul 1; Xu, Min 1; He, Xiangjian 1; Xu, Changsheng2
刊名	IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
	2014-10-01
卷号	24 期号:10 页码:1682-1695
关键词	Motion analysis singular value decomposition (SVD) video shot classification
英文摘要	In this paper, we propose a nonparametric camera motion descriptor for video shot classification. In the proposed method, a motion vector field (MVF) is constructed for each consecutive video frame by computing the motion vector (MV) of each macroblock. Then, the MVFs are divided into a number of local region of equal size. Next, the inconsistent/noisy MVs of each local region are eliminated by a motion consistency analysis. The remaining MVs of each local region from a number of consecutive frames are further collected for a compact representation. Initially, a matrix is formed using the MVs. Then, the matrix is decomposed using a singular value decomposition technique to represent the dominant motion. Finally, the angle of the most variance retaining principal component is computed and quantized to represent the motion of a local region by using a histogram. In order to represent the global camera motion, the local histograms are combined. The effectiveness of the proposed motion descriptor for video shot classification is tested by using a support vector machine. First, the proposed camera motion descriptors for video shots classification are computed on a video data set consisting of regular camera motion patterns (e. g., pan, zoom, tilt, static). Then, we apply the camera motion descriptors with an extended set of features to the classification of cinematographic shots. The experimental results show that the proposed shot level camera motion descriptor has a strong discriminative capability to classify different camera motion patterns of different videos effectively. We also show that our approach outperforms state-of-the-art methods.
WOS标题词	Science & Technology ; Technology
类目[WOS]	Engineering, Electrical & Electronic
研究领域[WOS]	Engineering
关键词[WOS]	SCENE CHANGE DETECTION ; REAL-TIME ; VIDEO ; RETRIEVAL ; ANNOTATION ; FRAMEWORK ; MODELS
收录类别	SCI
语种	英语
WOS记录号	WOS:000343316900005
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/2838]
专题	自动化研究所_模式识别国家重点实验室_多媒体计算与图形学团队
作者单位	1.Univ Technol Sydney, Fac Engn & Informat Technol, Ctr Innovat IT Serv & Applicat, Sch Comp & Commun, Sydney, NSW 2007, Australia 2.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Hasan, Muhammad Abul,Xu, Min,He, Xiangjian,et al. CAMHID: Camera Motion Histogram Descriptor and Its Application to Cinematographic Shot Classification[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,2014,24(10):1682-1695.
APA	Hasan, Muhammad Abul,Xu, Min,He, Xiangjian,&Xu, Changsheng.(2014).CAMHID: Camera Motion Histogram Descriptor and Its Application to Cinematographic Shot Classification.IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,24(10),1682-1695.
MLA	Hasan, Muhammad Abul,et al."CAMHID: Camera Motion Histogram Descriptor and Its Application to Cinematographic Shot Classification".IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 24.10(2014):1682-1695.