Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification

被引:638
作者
Tsai, A
Yezzi, A
Willsky, AS
机构
[1] MIT, Informat & Decis Syst Lab, Cambridge, MA 02139 USA
[2] Georgia Inst Technol, Sch Elect & Comp Engn, Atlanta, GA 30332 USA
关键词
active contours; boundary-value stochastic processes; curve evolution; denoising; image interpolation; image magnification; level sets methods; missing data problems; Mumford-Shah functional; reconstruction; segmentation; snakes;
D O I
10.1109/83.935033
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we first address the problem of simultaneous image segmentation and smoothing by approaching the Mumford-Shah paradigm from a curve evolution perspective. In particular, we let a set of deformable contours define the boundaries between regions in an image where we model the data via piecewise smooth functions and employ a gradient flow to evolve these contours. Each gradient step involves solving an optimal estimation problem for the data within each region, connecting curve evolution and the Mumford-Shah functional with the theory of boundary-value stochastic processes. The resulting active contour model offers a tractable implementation of the original Mumford-Shah model (i.e., without resorting to elliptic approximations which have traditionally been favored for greater ease in implementation) to simultaneously segment and smoothly reconstruct the data within a given image in a coupled manner. Various implementations of this algorithm are introduced to increase its speed of convergence. We also outline a hierarchical implementation of this algorithm to handle important image features such as triple points and other multiple junctions. Next, by generalizing the data fidelity term of the original Mumford-Shah functional to incorporate a spatially varying penalty, we extend our method to problems in which data quality varies across the image and to images in which sets of pixel measurements are missing. This more general model leads us to a novel PDE-based approach for simultaneous image magnification, segmentation, and smoothing, thereby extending the traditional applications of the Mumford-Shah functional which only considers simultaneous segmentation and smoothing.
引用
收藏
页码:1169 / 1186
页数:18
相关论文
共 52 条
  • [1] LINEAR-ESTIMATION OF BOUNDARY-VALUE STOCHASTIC-PROCESSES .1. THE ROLE AND CONSTRUCTION OF COMPLEMENTARY MODELS
    ADAMS, MB
    WILLSKY, AS
    LEVY, BC
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1984, 29 (09) : 803 - 811
  • [2] Allebach J, 1996, INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL III, P707, DOI 10.1109/ICIP.1996.560768
  • [3] AMBROSIO L, 1990, COMMUN PURE APPL MAT, V43
  • [4] [Anonymous], GEOMETRY DRIVEN DIFF
  • [5] [Anonymous], GEOMETRY DRIVEN DIFF
  • [6] [Anonymous], P IEEE C COMP VIS PA
  • [7] BERTALMIO M, 2000, P SIGGRAPH 2000 JUL
  • [8] Blake A., 1987, Visual Reconstruction
  • [9] A GEOMETRIC MODEL FOR ACTIVE CONTOURS IN IMAGE-PROCESSING
    CASELLES, V
    CATTE, F
    COLL, T
    DIBOS, F
    [J]. NUMERISCHE MATHEMATIK, 1993, 66 (01) : 1 - 31
  • [10] CASELLES V, 1998, INT J COMPUT VIS