Structure preservation in content-aware image retargeting using multi-operator

被引:6
作者
Garg, Ankit [1 ]
Negi, Ashish [2 ]
机构
[1] UTU, Dept Comp Sci & Engn, Dehra Dun, Uttarakhand, India
[2] GBPEC, Dept Comp Sci & Applicat, Ghurdauri, Pauri, India
关键词
image colour analysis; distortion; image retrieval; image processing; optimisation; structure preservation; content-aware image retargeting; image retargeting technique; multioperators; salient objects; seam carving; cropping; retargeted image; multioperator scheme; seam diversion based image retargeting algorithm; warping operator; different multioperator schemes; image quality; image retargeting operations; optimised image distance function; bidirectional image Euclidean distance; energy-based; seams; user-based subjective analysis;
D O I
10.1049/iet-ipr.2019.1032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The evolution of image retargeting technique demands the exploitation of multi-operators since they are capable of preserving the structure and salient objects of the image. However, these multi-operators are mostly based on seam carving with scaling or cropping operators which lead to significant distortions in the retargeted image. This study proposes a new multi-operator scheme which has improved seam carving, through the proposed seam diversion based image retargeting algorithm, integrated with the cropping and warping operator. A total of six different multi-operator schemes have been proposed out of which the MO6 technique gave remarkable results in terms of image quality, least distortion, and lowest run-time. To simplify image retargeting operations, an optimised image distance function was used. The optimised image distance function was formulated which combines bidirectional image Euclidean distance, dominant colour descriptor, and an energy-based coefficient to bypass seams from the point where seams start clashing and hence the defined threshold violates. By integrating cropping and warping into the proposed algorithm, it preserves the salient features of the retargeted images. Typical results have been presented which demonstrates the effectiveness of the proposed methods. User-based subjective analysis has also been carried out which shows that image retargeted using the MO6 technique has high user preference.
引用
收藏
页码:2965 / 2975
页数:11
相关论文
共 49 条
  • [1] Andreadis I., 2005, P IEEE INSTR MEAS TE, V3, P2028, DOI DOI 10.1109/IMTC.2005.1604529
  • [2] Seam carving for content-aware image resizing
    Avidan, Shai
    Shamir, Ariel
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03):
  • [3] Chang HH, 2019, MULTIMEDIA TOOLS APP, V78, P1
  • [4] Image resizing by reconstruction from deep features
    Danon, Dov
    Arar, Moab
    Cohen-Or, Daniel
    Shamir, Ariel
    [J]. COMPUTATIONAL VISUAL MEDIA, 2021, 7 (04) : 453 - 466
  • [5] Fast Multi-Operator Image Resizing and Evaluation
    Dong, Wei-Ming
    Bao, Guan-Bo
    Zhang, Xiao-Peng
    Paul, Jean-Claude
    [J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2012, 27 (01) : 121 - 134
  • [6] Image Retargeting by Texture-Aware Synthesis
    Dong, Weiming
    Wu, Fuzhang
    Kong, Yan
    Mei, Xing
    Lee, Tong-Yee
    Zhang, Xiaopeng
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2016, 22 (02) : 1088 - 1101
  • [7] Optimized Image Resizing Using Seam Carving and Scaling
    Dong, Weiming
    Zhou, Ning
    Paul, Jean-Claude
    Zhang, Xiaopeng
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (05): : 1 - 10
  • [8] Optimized Multioperator Image Retargeting Based on Perceptual Similarity Measure
    Fang, Yuming
    Fang, Zhijun
    Yuan, Feiniu
    Yang, Yong
    Yang, Shouyuan
    Xiong, Neal N.
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2017, 47 (11): : 2956 - 2966
  • [9] Gal R., 2006, P 17 EUROGRAPHICS C, P297, DOI DOI 10.2312/EGWR/EGSR06/297-303
  • [10] Image Retargeting Using Mesh Parametrization
    Guo, Yanwen
    Liu, Feng
    Shi, Jian
    Zhou, Zhi-Hua
    Gleicher, Michael
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2009, 11 (05) : 856 - 867