Boosting and margin theory

CORC > 北京大学 > 信息科学技术学院

	Boosting and margin theory
	Feng Jufu ; Wang Liwei ; Sugiyama Masashi ; Yang Cheng ; Zhou Zhihua ; Zhang Chicheng
刊名	Frontiers of Electrical and Electronic Engineering
	2012
关键词	boosting margin explanation generalization
英文摘要	Many researchers have worked on the explanation of AdaBoost’s good experimental results in theory. Some work give an upper bound of generalization error in terms of the margin distribution function, while Breiman gave a sharper generalization error bound based on minimum margin. He also developed the arcgv algorithm to maximize the minimum margin, then made the minimum margin larger than AdaBoost. However, its empirical results are even worse than AdaBoost. Therefore, is the minimum margin bound not practical? This paper gives a new concept called Equilibrium margin (Emargin) and proves a new generalization error bound using Emargin, which is always better than minimum margin bound. In addition, we show Emargin is a good indicator of generalization. Then, we conduct experiments showing that the Emargin of AdaBoost is larger than arc-gv, but the generalization error of Ada-Boost is usually better.; The National Natural Science Foundation of China,Global COE Program of Tokyo Institute of Technology; 中国科学引文数据库(CSCD); 1; 127-133; 7
语种	英语
内容类型	期刊论文
源URL	[http://ir.pku.edu.cn/handle/20.500.11897/419609]
专题	信息科学技术学院
推荐引用方式 GB/T 7714	Feng Jufu,Wang Liwei,Sugiyama Masashi,et al. Boosting and margin theory[J]. Frontiers of Electrical and Electronic Engineering,2012.
APA	Feng Jufu,Wang Liwei,Sugiyama Masashi,Yang Cheng,Zhou Zhihua,&Zhang Chicheng.(2012).Boosting and margin theory.Frontiers of Electrical and Electronic Engineering.
MLA	Feng Jufu,et al."Boosting and margin theory".Frontiers of Electrical and Electronic Engineering (2012).