robust object tracking is a challenging task in computer vision. since the appearance of the target changes frequently, how to build and update the appearance model is crucial. in this paper, to better represent the object dynamically, we propose a robust object tracker based on diverse templates. first, we construct diverse multiple templates using the determinantal point process algorithm adaptively, which efficiently detects the most diverse subset of a set. second, a patch;matching method is employed to propagate every template density to the next frame, and a voting map for each template is constructed by all matching patches. third, a weighted bayesian filter framework aggregates all voting maps to optimize target state. finally, in order to maintain the diversity of multiple templates, we dynamically add, remove and replace the target from templates. experimental results prove that the proposed method outperforms state;of;the;art tracking algorithms significantly in terms of center position errors and success rates. © 2016 ieee.