Structure and texture filling-in of missing image blocks in wireless transmission and compression applications

被引:141
作者
Rane, SD [1 ]
Sapiro, G [1 ]
Bertalmio, M [1 ]
机构
[1] Univ Minnesota, Dept Elect & Comp Engn, Minneapolis, MN 55455 USA
基金
美国国家科学基金会;
关键词
compression; filling-in; inpainting; interpolation; JPEG; restoration; texture synthesis; wireless transmission;
D O I
10.1109/TIP.2002.804264
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An approach for filling-in blocks of missing data in wireless image transmission is presented in this paper. When compression algorithms such as JPEG are used as part of the wireless transmission process, images are first tiled into blocks of 8 x 8 pixels. When such images are transmitted over fading channels, the effects of noise can destroy entire blocks of the image. Instead of using common retransmission query protocols, we aim to reconstruct the lost data using correlation between the lost block and its neighbors. If the lost block contained structure, it is reconstructed using an image inpainting algorithm, while texture synthesis is used for the textured blocks. The switch between the two schemes is done in a fully automatic fashion based on the surrounding available blocks. The performance of this method is tested for various images and combinations of lost blocks. The viability of this method for image compression, in association with lossy JPEG, is also discussed.
引用
收藏
页码:296 / 303
页数:8
相关论文
共 17 条
  • [1] Fast DCT-based spatial domain interpolation of blocks in images
    Alkachouh, Z
    Bellanger, MG
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (04) : 729 - 732
  • [2] BALLESTER C, IN PRESS IEEE T IMAG
  • [3] Image inpainting
    Bertalmio, M
    Sapiro, G
    Caselles, V
    Ballester, C
    [J]. SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, : 417 - 424
  • [4] CHAN T, 2000, MATH MODELS LOCAL DE
  • [5] Chang EY, 1998, LECT NOTES COMPUT SC, V1483, P137, DOI 10.1007/BFb0055312
  • [6] Efros A. A., 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision, P1033, DOI 10.1109/ICCV.1999.790383
  • [7] GORLA G, 2001, GROWING FITTED TEXTU
  • [8] HEEGER DJ, 1995, P 22 ANN C COMP GRAP, P229, DOI DOI 10.1145/218380.218446
  • [9] HEMAMI SS, 1995, P S MULT COMM VID CO
  • [10] Is there any texture in the image?
    Karu, K
    Jain, AK
    Bolle, RM
    [J]. PATTERN RECOGNITION, 1996, 29 (09) : 1437 - 1446