We present a novel predictive statistical framework to improve the performance of an EigenTracker. In addition, we use fast and efficient eigenspace updates to learn new views of the object being tracked on the fly. We also incorporate a new Importance Sampling mechanism which increases the robustness of the EigenTracker, and enables it to track non-convex objects better. Our EigenTracker is flexible - it is possible to use it symbiotically with other trackers. We show its successful application in hand gesture analysis; and face and person tracking. ©2004 IEEE.