Large Scale Online Kernel Learning

CORC > 自动化研究所 > 中国科学院自动化研究所 > 复杂系统管理与控制国家重点实验室 > 机器人应用与理论组

	Large Scale Online Kernel Learning
	Lu, Jing 1; Hoi, Steven C. H.1; Wang, Jialei 2; Zhao, Peilin 3; Liu, Zhi-Yong4
刊名	JOURNAL OF MACHINE LEARNING RESEARCH
	2016
卷号	17
关键词	online learning kernel approximation large scale machine learning
英文摘要	In this paper, we present a new framework for large scale online kernel learning, making kernel methods efficient and scalable for large-scale online learning applications. Unlike the regular budget online kernel learning scheme that usually uses some budget maintenance strategies to bound the number of support vectors, our framework explores a completely different approach of kernel functional approximation techniques to make the subsequent online learning task efficient and scalable. Specifically, we present two different online kernel machine learning algorithms: (i) Fourier Online Gradient Descent (FOGD) algorithm that applies the random Fourier features for approximating kernel functions; and (ii) Nystrom Online Gradient Descent (NOGD) algorithm that applies the Nystrom method to approximate large kernel matrices. We explore these two approaches to tackle three online learning tasks: binary classification, multi-class classification, and regression. The encouraging results of our experiments on large-scale datasets validate the effectiveness and efficiency of the proposed algorithms, making them potentially more practical than the family of existing budget online kernel learning approaches.
WOS标题词	Science & Technology ; Technology
类目[WOS]	Automation & Control Systems ; Computer Science, Artificial Intelligence
研究领域[WOS]	Automation & Control Systems ; Computer Science
关键词[WOS]	CLASSIFICATION ; ALGORITHMS ; PERCEPTRON ; LIBRARY ; SVM
收录类别	SCI
语种	英语
WOS记录号	WOS:000391485400001
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/13386]
专题	自动化研究所_复杂系统管理与控制国家重点实验室_机器人应用与理论组
作者单位	1.Singapore Management Univ, Sch Informat Syst, 80 Stamford Rd, Singapore 178902, Singapore 2.Univ Chicago, Dept Comp Sci, 5050 S Lake Shore Dr Apt S2009, Chicago, IL 60637 USA 3.ASTAR, Inst Infocomm Res, 1 Fusionopolis Way,21-01 Connexis, Singapore 138632, Singapore 4.Chinese Acad Sci, State Key Lab Management & Control Complex Syst, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Lu, Jing,Hoi, Steven C. H.,Wang, Jialei,et al. Large Scale Online Kernel Learning[J]. JOURNAL OF MACHINE LEARNING RESEARCH,2016,17.
APA	Lu, Jing,Hoi, Steven C. H.,Wang, Jialei,Zhao, Peilin,&Liu, Zhi-Yong.(2016).Large Scale Online Kernel Learning.JOURNAL OF MACHINE LEARNING RESEARCH,17.
MLA	Lu, Jing,et al."Large Scale Online Kernel Learning".JOURNAL OF MACHINE LEARNING RESEARCH 17(2016).