Finding Waldo, or focus of attention using local color information

Abstract

We present a method to locate an 驴object驴 in a color image, or more precisely, to select a set of likely locations for the object. The model is assumed to be of known color distribution, which permits the use color-space processing. A new method is presented, which exploits more information than the previous Backprojection Algorithm of Swain and Ballard at a competitive complexity. Precisely, the new algorithm is based on matching local histograms with the model, instead of directly replacing pixels with a confidence that they belong to the object. We prove that a simple version of this algorithm degenerates into Backprojection in the worst case. In addition, we show how to estimate the scale of the model.Results are shown on pictures digitized from the famous 驴Where is Waldo驴 books. Issues concerning the optimal choice of a color space and its quantization are carefully considered and studied in this application. We also propose to use co-occurrence histograms to deal with cases where important color variations can be expected.