A Probabilistic Approach to String Transformation

doi:10.1109/TKDE.2013.11

CORC > 北京大学 > 信息科学技术学院

	A Probabilistic Approach to String Transformation
	Wang, Ziqi ; Xu, Gu ; Li, Hang ; Zhang, Ming
刊名	ieee知识与数据工程汇刊
	2014
关键词	String transformation log linear model spelling error correction query reformulation SEARCH
DOI	10.1109/TKDE.2013.11
英文摘要	Many problems in natural language processing, data mining, information retrieval, and bioinformatics can be formalized as string transformation, which is a task as follows. Given an input string, the system generates the k most likely output strings corresponding to the input string. This paper proposes a novel and probabilistic approach to string transformation, which is both accurate and efficient. The approach includes the use of a log linear model, a method for training the model, and an algorithm for generating the top k candidates, whether there is or is not a predefined dictionary. The log linear model is defined as a conditional probability distribution of an output string and a rule set for the transformation conditioned on an input string. The learning method employs maximum likelihood estimation for parameter estimation. The string generation algorithm based on pruning is guaranteed to generate the optimal top k candidates. The proposed method is applied to correction of spelling errors in queries as well as reformulation of queries in web search. Experimental results on large scale data show that the proposed approach is very accurate and efficient improving upon existing methods in terms of accuracy and efficiency in different settings.; Computer Science, Artificial Intelligence; Computer Science, Information Systems; Engineering, Electrical & Electronic; SCI(E); EI; 0; ARTICLE; wangziqi@pku.edu.cn; guxu@microsoft.com; hangli.hl@huawei.com; mzhang@net.pku.edu.cn; 5; 1063-1075; 26
语种	英语
内容类型	期刊论文
源URL	[http://ir.pku.edu.cn/handle/20.500.11897/212933]
专题	信息科学技术学院
推荐引用方式 GB/T 7714	Wang, Ziqi,Xu, Gu,Li, Hang,et al. A Probabilistic Approach to String Transformation[J]. ieee知识与数据工程汇刊,2014.
APA	Wang, Ziqi,Xu, Gu,Li, Hang,&Zhang, Ming.(2014).A Probabilistic Approach to String Transformation.ieee知识与数据工程汇刊.
MLA	Wang, Ziqi,et al."A Probabilistic Approach to String Transformation".ieee知识与数据工程汇刊 (2014).