共 2 条
HEMS: Hierarchical Exemplar-Based Matching-Synthesis for Object-Aware Image Reconstruction
被引:5
|作者:
Sun, Yipeng
[1
,2
]
Tao, Xiaoming
[1
]
Li, Yang
[3
]
Dong, Linhao
[4
]
Lu, Jianhua
[1
]
机构:
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Alipay Inc, Beijing 100080, Peoples R China
[3] Google Inc, Pittsburgh, PA 15206 USA
[4] Tsinghua Univ, Sch Aerosp Engn, Beijing 100084, Peoples R China
基金:
中国国家自然科学基金;
关键词:
Exemplar;
image coding;
image synthesis;
low bit-rate;
salient object;
visual quality;
VISUAL-ATTENTION;
NEUROBIOLOGICAL MODEL;
COMPRESSION;
REGION;
FOVEATION;
REMOVAL;
SEARCH;
D O I:
10.1109/TMM.2015.2496246
中图分类号:
TP [自动化技术、计算机技术];
学科分类号:
0812 ;
摘要:
Motivated by the attention on salient objects, conventional region-of-interest (ROI)-based image coding approaches attempt to assign more bits to ROIs and fewer bits to other regions. Thus, the perceptual quality of salient object regions is improved by sacrificing the quality of non-ROI regions with unpleasant artifacts. To address this issue, we concentrate on the efficient compression of object-centered images by encoding salient objects and background features separately. To fully recover the object and background, we propose a hierarchical exemplar-based matching-synthesis (HEMS) approach to reconstruct the image from exemplars. In the proposed framework, once the salient object regions are encoded, only the quantized color features and local descriptors of the background are kept, achieving bit-rate reduction. To make it possible and practical to reconstruct background regions, the hierarchical framework is designed in three layers, including relevant image search, patch candidates matching, and distortion optimized image synthesis. In the hierarchical framework, firstly, image search from an external database returns relevant images, limiting the search space to a feasible number of patch candidates. Secondly, patches are matched by color features to select the appropriate candidates. Finally, the distortion optimized image synthesis further makes it possible to automatically choose the most suitable texture sample, and seamlessly reconstruct the image. Compared to the conventional ROI-based image coding schemes, the proposed approach can achieve better visual quality on both ROI and background regions.
引用
收藏
页码:171 / 181
页数:11
相关论文