Jonathan Foote, John Boreczky, Andreas Girgensohn, and Lynn Wilcox. An Intelligent Media Browser using Automatic Multimodal Analysis. In MULTIMEDIA '98, Proceedings of the 6th ACM international conference on Multimedia, ACM Press, 1998, pp. 375-380.
Abstract: Many techniques can extract information from an multimedia stream, such as speaker identity or shot boundaries. We present a browser that uses this information to navigate through stored media. Because automatically-derived information is not wholly reliable, it is transformed into a time-dependent "confidence score." When presented graphically, confidence scores enable users to make informed decisions about regions of interest in the media, so that non-interesting areas may be skipped. Additionally, index points may be determined automatically for easy navigation, selection, editing, and annotation and will support analysis types other than the speaker identification and shot detection used here.