Temporal color correlograms for video retrieval

This paper presents a novel method to retrieve segmented video shots based on their color content. The Temporal Color Correlogram captures the spatio-temporal relationship of colors in a video shot using co-occurrence statistics. The Temporal Color Correlogram extends the HSV Color Correlogram that has been found to be very effective in content-based image retrieval. Temporal Color Correlograms compute the autocorrelation of quantized HSV color values from a set of frame samples taken from a video shot. In this paper, the efficiency of the Temporal Color Correlogram and HSV Color Correlograms are evaluated against other retrieval systems participating the TREC Video track evaluation and against color histograms used commonly in content-based retrieval. We used queries and relevance judgments on the 11 hours of segmented MPEG-1 video provided to track participants. Tests are executed using our Content-Based Multimedia Retrieval System that was specifically developed for multimedia information retrieval applications.