FoodChangeLens: CNN-based Food Transformation on HoloLens

被引:6
作者
Naritomi, Shu [1 ]
Tanno, Ryosuke [2 ]
Ege, Takumi [1 ]
Yanai, Keiji [1 ]
机构
[1] Univ Electrocommun, Dept Informat, Tokyo, Japan
[2] NTT Commun Corp, Technol Dev, Tokyo, Japan
来源
2018 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR) | 2018年
关键词
Deep Learning; Convolutional Neural Network; Generative Adversarial Networks; HoloLens; Food Image Transfer;
D O I
10.1109/AIVR.2018.00046
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this demonstration, we implemented food category transformation in mixed reality using both image generation and HoloLens. Our system overlays transformed food images to food objects in the AR space, so that it is possible to convert in consideration of real shape. This system has the potential to make meals more enjoyable. In this work, we use the Conditional CycleGAN trained with a large-scale food image data collected from the Twitter Stream for food category transformation which can transform among ten kinds of foods mutually keeping the shape of a given food. We show the virtual meal experience which is food category transformation among ten kinds of typical Japanese foods: ramen noodle, curry rice, fried rice, beef rice bowl, chilled noodle, spaghetti with meat source, white rice, eel bowl, and fried noodle. Note that additional results including demo videos can be see at https://negi111111.github.io/FoodChangeLensProjectHP/
引用
收藏
页码:197 / 199
页数:3
相关论文
共 5 条
[1]  
[Anonymous], 2012, P IEEE INT C MULT EX
[2]  
[Anonymous], 2018, P IEEE COMP VIS PATT
[3]  
[Anonymous], 2017, P IEEE INT C COMP VI
[4]  
[Anonymous], P INT C MACH LEARN I
[5]  
Ronneberger O., 2015, P ARXIV 1505 04597V1