This paper aims at developing a novel methodology for unsupervised video tracking by exploring the merits of neighborhood rough sets. A neighborhood rough filter is designed in this process for initial labeling of continuous moving object(s) even in the presence of several variations in different feature spaces. The locations and color models of the object(s) are estimated using their lower-upper approximations in spatio-color neighborhood granular space. Velocity neighborhood granules and acceleration neighborhood granules are then defined over this estimation to predict the object location in the next frame and to speed up the tracking process. A novel concept, namely, intuitionsistic entropy is introduced here, which consists of two new measures: neighborhood rough entropy and neighborhood probabilistic entropy to deal with the ambiguities that arise due to occurrence of overlapping/ occlusion in a video sequence. The unsupervised method of tracking is equally good even when compared with some of the state-of-the art partially supervised methods while showing superior performance during total occlusion. © 1993-2012 IEEE.