Smartphone region-wise image indoor localization using deep learning for indoor tourist attraction

被引:0
作者
Higa, Gabriel Toshio Hirokawa [1 ]
Monzani, Rodrigo Stuqui [2 ]
Cecatto, Jorge Fernando da Silva [2 ]
de Souza, Maria Fernanda Balestieri Mariano [3 ]
Weber, Vanessa Aparecida de Moraes [4 ,5 ]
Pistori, Hemerson [1 ,2 ]
Matsubara, Edson Takashi [2 ]
机构
[1] Univ Catolica Dom Bosco, Campo Grande, MS, Brazil
[2] Univ Fed Mato Grosso do Sul, Campo Grande, MS, Brazil
[3] Pantanal Biopk, Campo Grande, MS, Brazil
[4] Univ Estadual Mato Grosso do Sul, Campo Grande, MS, Brazil
[5] Kerow Precis Solut, Campo Grande, MS, Brazil
关键词
D O I
10.1371/journal.pone.0307569
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Smart indoor tourist attractions, such as smart museums and aquariums, require a significant investment in indoor localization devices. The use of Global Positioning Systems on smartphones is unsuitable for scenarios where dense materials such as concrete and metal blocks weaken GPS signals, which is most often the case in indoor tourist attractions. With the help of deep learning, indoor localization can be done region by region using smartphone images. This approach requires no investment in infrastructure and reduces the cost and time needed to turn museums and aquariums into smart museums or smart aquariums. In this paper, we propose using deep learning algorithms to classify locations based on smartphone camera images for indoor tourist attractions. We evaluate our proposal in a real-world scenario in Brazil. We extensively collect images from ten different smartphones to classify biome-themed fish tanks in the Pantanal Biopark, creating a new dataset of 3654 images. We tested seven state-of-the-art neural networks, three of them based on transformers. On average, we achieved a precision of about 90% and a recall and f-score of about 89%. The results show that the proposal is suitable for most indoor tourist attractions.
引用
收藏
页数:18
相关论文
共 50 条
[41]   Deep Learning-Based Multifloor Indoor Tracking Scheme Using Smartphone Sensors [J].
Lin, Chenxiang ;
Shin, Yoan .
IEEE ACCESS, 2022, 10 :63049-63062
[42]   A Study of Multi-Task and Region-Wise Deep Learning for Food Ingredient Recognition [J].
Chen, Jingjing ;
Zhu, Bin ;
Ngo, Chong-Wah ;
Chua, Tat-Seng ;
Jiang, Yu-Gang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) :1514-1526
[43]   An Adaptive Wi-Fi Indoor Localization Scheme using Deep Learning [J].
Hsu, Chih-Shun ;
Chen, Yuh-Shyan ;
Juang, Tong-Ying ;
Wu, Yi-Ting .
PROCEEDINGS OF THE 2018 IEEE 7TH ASIA-PACIFIC CONFERENCE ON ANTENNAS AND PROPAGATION (APCAP), 2018, :132-133
[44]   Indoor Localization and Navigation based on Deep Learning using a Monocular Visual System [J].
Ancona R.E.A. ;
Ramírez L.G.C. ;
Frías O.O.G. .
International Journal of Advanced Computer Science and Applications, 2021, 12 (06) :79-86
[45]   Improving Indoor Localization Using Mobile UWB Sensor and Deep Reinforcement Learning [J].
Nosrati, Leyla ;
Semnani, Samaneh Hoseini ;
Fazel, Mohammad Sadegh ;
Rakhshani, Sajed ;
Ghavami, Mohammad .
IEEE SENSORS JOURNAL, 2024, 24 (20) :32546-32553
[46]   Indoor Localization and Navigation based on Deep Learning using a Monocular Visual System [J].
Arevalo Ancona, Rodrigo Eduardo ;
Corona Ramirez, Leonel German ;
Gutierrez Frias, Oscar Octavio .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (06) :79-86
[47]   Improved Indoor Geomagnetic Field Fingerprinting for Smartwatch Localization Using Deep Learning [J].
Al-homayani, Fahad ;
Mahoor, Mohammad .
2018 NINTH INTERNATIONAL CONFERENCE ON INDOOR POSITIONING AND INDOOR NAVIGATION (IPIN 2018), 2018,
[48]   Indoor Localization using Machine Learning and Beacons [J].
Lee, JaeYong ;
Park, Sang-uk ;
Choi, Myeong-in ;
Yoon, Guwon ;
Park, Sehyun .
2020 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TAIWAN), 2020,
[49]   DeepLocate: Smartphone Based Indoor Localization with a Deep Neural Network Ensemble Classifier [J].
Ashraf, Imran ;
Hur, Soojung ;
Park, Sangjoon ;
Park, Yongwan .
SENSORS, 2020, 20 (01)
[50]   Tourist attraction image recognition and intelligent recommendation based on deep learning [J].
Wei, CongCong .
JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2025, 25 (04) :3066-3079