A fine-grained recognition technique for identifying Chinese food images

被引:4
作者
Feng, Shuo [1 ]
Wang, Yangang [1 ]
Gong, Jianhong [1 ]
Li, Xiang [1 ]
Li, Shangxuan [1 ]
机构
[1] Shandong Univ, Sch Mech Elect & Informat Engn, Weihai 264209, Peoples R China
关键词
Food image processing; Automatic recognition; Fine-grained recognition; Laplacian pyramid; Bilinear pooling;
D O I
10.1016/j.heliyon.2023.e21565
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
As a crucial area of research in the field of computer vision, food recognition technology has become a core technology in many food-related fields, such as unmanned restaurants and food nutrition analysis, which are closely related to our healthy lives. Obtaining accurate classification results is the most important task in food recognition. Food classification is a fine-grained recognition process, which involves extracting features from a group of objects with similar appearances and accurately classifying them into different categories. In a such usage environment, the network is required to not only overview the overall image, but also capture the subtle details within it. In addition, since Chinese food images have unique texture features, the model needs to extract texture information from the image. However, existing CNN methods have not focused on and processed this information. To classify food as accurately as possible, this paper introduces the Laplace pyramid into the convolution layer and proposes a bilinear network that can perceive image texture features and multi-scale features (LMB-Net). The proposed model was evaluated on a public dataset, and the results demonstrate that LMB-Net achieves state-of-the-art classification performance.
引用
收藏
页数:12
相关论文
共 47 条
[11]   Smartphone-based food recognition system using multiple deep CNN models [J].
Fakhrou, Abdulnaser ;
Kunhoth, Jayakanth ;
Al Maadeed, Somaya .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (21-23) :33011-33032
[12]   Machine Learning and SIFT Approach for Indonesian Food Image Recognition [J].
Giovany, Stanley ;
Putra, Andre ;
Hariawan, Agus S. ;
Wulandhari, Lili A. .
DISCOVERY AND INNOVATION OF COMPUTER SCIENCE TECHNOLOGY IN ARTIFICIAL INTELLIGENCE ERA, 2017, 116 :612-620
[13]  
He J., 2023, Research on Fine-grained Image Recognition, V7, P58, DOI [10.23977/acss.2023.070208, DOI 10.23977/ACSS.2023.070208]
[14]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[15]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[16]  
Joutou T, 2009, IEEE IMAGE PROC, P285, DOI 10.1109/ICIP.2009.5413400
[17]   Food Image Recognition with Deep Convolutional Features [J].
Kawano, Yoshiyuki ;
Yanai, Keiji .
PROCEEDINGS OF THE 2014 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING (UBICOMP'14 ADJUNCT), 2014, :589-593
[18]   Food items detection and recognition via multiple deep models [J].
Khan, Sheema ;
Ahmad, Kashif ;
Ahmed, Tahir ;
Ahmed, Nasir .
JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (01)
[19]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[20]   Deep learning-based recognition of Chinese dishes in a waiterless restaurant [J].
Lan, Shanzhen ;
Wan, Chengjuan ;
Chen, Lan ;
Jin, Mingxue ;
Yu, Shaode .
2022 16TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP2022), VOL 1, 2022, :390-394