ActiveAd: A novel framework of linking ad videos to online products

doi:10.1016/j.neucom.2015.12.038

CORC > 自动化研究所 > 中国科学院自动化研究所 > 模式识别国家重点实验室 > 图像与视频分析团队

	ActiveAd: A novel framework of linking ad videos to online products
	Wang, Jinqiao1 ; Xu, Min 2; Lu, Hanqing1 ; Burnett, Ian 2
刊名	NEUROCOMPUTING
	2016-04-12
期号	185 页码:82-92
关键词	Ad Video Analysis Visual Search Tag Aggregation Textual Search
DOI	10.1016/j.neucom.2015.12.038
文献子类	Article
英文摘要	With the wide use of consumer electronics and the rapid development of online shopping, more and more ad videos are developed for IDTV and mobile users. However, a huge amount of time spending on the Internet advertising somehow brings users uncomfortable viewing experience rather than effectively generates high consumption of advertised products. Therefore, it is urgent to find a viewer-friendly and advertiser-beneficial solution to launch ads. This paper is the first attempt to improve the effectiveness of advertising through combining online shopping information with an ad video and directing viewers to proper online shopping places. The proposed ActiveAd framework includes four main components. Firstly, an ad video analysis component detects both syntactic and semantic elements from ad videos, e.g. FMPIs (Frame Marked with Production Information), visual concepts, and textual keywords within the ad videos. Our ad video analysis provides a comprehensive solution to extract meaningful elements from ad videos. Secondly, a visual linking by search component is proposed to collect websites which contain similar images as FMPIs. Features used for the visual search are weighted and fused in order to ensure the uniformity of search results. Thirdly, different kinds of tags and product categories extracted from collected websites are aggregated in order to identify the representative text of the product. Finally, query keywords are selected through calculating cosine similarity from two kinds of keywords, i.e. keywords identified from tag aggregation and keywords obtained through ad video analysis (visual concept detection and textual keyword detection). A query vector is generated by selected keywords and used to retrieve product online. In this paper, a powerful cross-media contextual search including visual search, tag aggregation and textual search is achieved with the help of ad video analysis. Experiments demonstrate that our proposed ActiveAd achieves product recommendation effectively and efficiently. (C) 2016 Elsevier B.V. All rights reserved.
WOS关键词	SHAPE
WOS研究方向	Computer Science
语种	英语
WOS记录号	WOS:000374363900010
资助机构	863 Program(2014AA015104) ; National Natural Science
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/12205]
专题	自动化研究所_模式识别国家重点实验室_图像与视频分析团队
作者单位	1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100864, Peoples R China 2.Univ Technol Sydney, Fac Engn & IT, Sydney, NSW 2007, Australia
推荐引用方式 GB/T 7714	Wang, Jinqiao,Xu, Min,Lu, Hanqing,et al. ActiveAd: A novel framework of linking ad videos to online products[J]. NEUROCOMPUTING,2016(185):82-92.
APA	Wang, Jinqiao,Xu, Min,Lu, Hanqing,&Burnett, Ian.(2016).ActiveAd: A novel framework of linking ad videos to online products.NEUROCOMPUTING(185),82-92.
MLA	Wang, Jinqiao,et al."ActiveAd: A novel framework of linking ad videos to online products".NEUROCOMPUTING .185(2016):82-92.