Segmentation using multiscale cues

Abstract

Edges at multiple scales provide complementary group- ing cues for image segmentation. These cues are reliable within different ranges. The larger the scale of an edge, the longer range the grouping cues it designates, and the greater impact it has on the final segmentation. A good seg- mentation respects grouping cues at each scale. These intuitions are formulated in a graph-theoretic framework, where multiscale edges define pairwise pixel affinity at multiple grids, each captured in one graph. A novel criterion called average cuts of normalized affin- ity is proposed to evaluate a simultaneous segmenta- tion through all these graphs. Its near-global optima can be solved efficiently. With a sparse yet complete characterization of pairwise pixel affinity, this graph-cuts approach leads to a hierarchy of coarse to fine segmentations that naturally take care of textured regions and weak contours.