A Deep Transfer Learning Solution for Food Material Recognition Using Electronic Scales

被引:24
作者
Xiao, Guangyi [1 ]
Wu, Qi [1 ]
Chen, Hao [1 ]
Cao, Da [1 ]
Guo, Jingzhi [2 ]
Gong, Zhiguo [3 ]
机构
[1] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha 410082, Hunan, Peoples R China
[2] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
[3] Univ Macau, Dept Comp & Informat Sci, State Key Lab Internet Things Smart City, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Training data; Adaptation models; Informatics; Procurement; Consumer electronics; Task analysis; Fasteners; CNN network; food material recognition; imbalance; lab-to-reality transition; transfer learning;
D O I
10.1109/TII.2019.2931148
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we present a novel solution to automating the procurement of food materials by using electronic scales, which can automatically identify the food materials along weighing them. Although the CNN model is regarded as one of the most effective solutions to image recognition, the traditional techniques cannot handle the mismatch problem between the lab training data and the real world data. To solve the problem, we propose to embed a partial-and-imbalanced domain adaptation technique (tree adaptation network) in the deep learning model, which can borrow knowledge from sibling classes, to overcome the imbalance problem, and transfer knowledge from the source domain to the target domain, to fight the mismatch problem between the lab training data and the real world data. Experiments show that the proposed approach outperforms state-of-the-art algorithms. Furthermore, the proposed techniques have already been used in practice.
引用
收藏
页码:2290 / 2300
页数:11
相关论文
共 45 条
[1]   Grab, Pay, and Eat: Semantic Food Detection for Smart Restaurants [J].
Aguilar, Eduardo ;
Remeseiro, Bealriz ;
Bolanos, Marc ;
Radeva, Petia .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (12) :3266-3275
[2]  
[Anonymous], 2018, P 2018 C EMP METH
[3]  
[Anonymous], DATASET SHIFT MACHIN
[4]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[5]   Partial Adversarial Domain Adaptation [J].
Cao, Zhangjie ;
Ma, Lijia ;
Long, Mingsheng ;
Wang, Jianmin .
COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 :139-155
[6]   Cross-Modal Retrieval in the Cooking Context: Learning Semantic Text-Image Embeddings [J].
Carvalho, Micael ;
Cadene, Remi ;
Picard, David ;
Soulier, Laure ;
Thome, Nicolas ;
Cord, Matthieu .
ACM/SIGIR PROCEEDINGS 2018, 2018, :35-44
[7]   Fast auto-clean CNN model for online prediction of food materials [J].
Chen, Hao ;
Xu, Jianglong ;
Xiao, Guangyi ;
Wu, Qi ;
Zhang, Shiqin .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2018, 117 :218-227
[8]   Cross-modal Recipe Retrieval with Rich Food Attributes [J].
Chen, Jing-Jing ;
Ngo, Chong-Wah ;
Chua, Tat-Seng .
PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, :1771-1779
[9]   Food Recognition: A New Dataset, Experiments, and Results [J].
Ciocca, Gianluigi ;
Napoletano, Paolo ;
Schettini, Raimondo .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2017, 21 (03) :588-598
[10]  
Collobert R, 2011, J MACH LEARN RES, V12, P2493