Bust Portraits Matting Based on Improved U-Net

被引:0
作者
Xie, Honggang [1 ]
Hou, Kaiyuan [1 ]
Jiang, Di [1 ]
Ma, Wanjie [1 ]
机构
[1] Hubei Univ Technol, Sch Elect & Elect Engn, Wuhan 430068, Peoples R China
关键词
image matting; bust portraits; deep learning; driver monitoring;
D O I
10.3390/electronics12061378
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Extracting complete portrait foregrounds from natural images is widely used in image editing and high-definition map generation. When making high-definition maps, it is often necessary to matte passers-by to guarantee their privacy. Current matting methods that do not require additional trimap inputs often suffer from inaccurate global predictions or blurred local details. Portrait matting, as a soft segmentation method, allows the creation of excess areas during segmentation, which inevitably leads to noise in the resulting alpha image as well as excess foreground information, so it is not necessary to keep all the excess areas. To overcome the above problems, this paper designed a contour sharpness refining network (CSRN) that modifies the weight of the alpha values of uncertain regions in the prediction map. It is combined with an end-to-end matting network for bust matting based on the U-Net target detection network containing Residual U-blocks. An end-to-end matting network for bust matting is designed. The network can effectively reduce the image noise without affecting the complete foreground information obtained by the deeper network, thus obtaining a more detailed foreground image with fine edge details. The network structure has been tested on the PPM-100, the RealWorldPortrait-636, and a self-built dataset, showing excellent performance in both edge refinement and global prediction for half-figure portraits.
引用
收藏
页数:12
相关论文
共 29 条
[1]   TransMatting: Enhancing Transparent Objects Matting with Transformers [J].
Cai, Huanqia ;
Xue, Fanglei ;
Xu, Lele ;
Guo, Lili .
COMPUTER VISION, ECCV 2022, PT XXIX, 2022, 13689 :253-269
[2]  
Chuang YY, 2001, PROC CVPR IEEE, P264
[3]   User-Guided Deep Human Image Matting Using Arbitrary Trimaps [J].
Fang, Xiaonan ;
Zhang, Song-Hai ;
Chen, Tao ;
Wu, Xian ;
Shamir, Ariel ;
Hu, Shi-Min .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :2040-2052
[4]   Recent advances in convolutional neural networks [J].
Gu, Jiuxiang ;
Wang, Zhenhua ;
Kuen, Jason ;
Ma, Lianyang ;
Shahroudy, Amir ;
Shuai, Bing ;
Liu, Ting ;
Wang, Xingxing ;
Wang, Gang ;
Cai, Jianfei ;
Chen, Tsuhan .
PATTERN RECOGNITION, 2018, 77 :354-377
[5]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[6]   Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimation [J].
Hou, Qiqi ;
Liu, Feng .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4129-4138
[7]   Revisiting Salient Object Detection: Simultaneous Detection, Ranking, and Subitizing of Multiple Salient Objects [J].
Islam, Md Amirul ;
Kalash, Mahmoud ;
Bruce, Neil D. B. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7142-7150
[8]  
Ke ZH, 2022, AAAI CONF ARTIF INTE, P1140
[9]   Bridging Composite and Real: Towards End-to-End Deep Image Matting [J].
Li, Jizhizi ;
Zhang, Jing ;
Maybank, Stephen J. ;
Tao, Dacheng .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (02) :246-266
[10]   Pyramid Matting: A Resource-Adaptive Multi-Scale Pixel Pair Optimization Framework for Image Matting [J].
Liang Yihui ;
Feng Fujian ;
Cai Zhaoquan .
IEEE ACCESS, 2020, 8 :93487-93498