In this paper, we propose a prediction algorithm that uses adaptive predictor structures for loss less video coding. The proposed encoder finds cross-correlation coefficient between current frame and motion compensated previous frame and classifies the coefficient value into a small number of bins. For general videos, we propose four bins and associate different predictor structures with each of the bins. Similarly for medical videos, numbers of bins are three and each of these bins is associated with different predictor structures. Performance of our method is compared with the fixed predictor structure used in practice and found that the proposed method not only gives better prediction performance but it is computational efficient as compared to fixed predictor structure. © 2012 IEEE.