Unlike image quality, video quality is affected by the temporal factor, in addition to the spatial one. In this paper, we investigate into the impact of both the factors on the overall perceived video quality and combine them into a metric. We use machine learning as a tool to study and analyze the relationship between the factors and the overall perceived video quality. It is shown that apart from their individual contributions, the interaction of the two factors also plays a role in determining the overall video quality. We report the experimental results and the related analysis using videos from two publicly available databases. © 2011 IEEE.