ViST: A Ubiquitous Model with Multimodal Fusion for Crop Growth Prediction

被引：2

作者：

Li, Junsheng ^{[1
]}

Wang, Ling ^{[1
]}

Liu, Jie ^{[1
]}

Tang, Jinshan ^{[2
]}

机构：

[1] Harbin Inst Technol, Dept Comp Sci & Technol, 92 Xidazhi St, Harbin 150000, Heilongjiang, Peoples R China

[2] George Mason Univ, Coll Publ Hlth, Dept Hlth Adm & Policy, Hlth Informat, Fairfax, VA 22033 USA

来源：

ACM TRANSACTIONS ON SENSOR NETWORKS | 2024年 / 20卷 / 01期

关键词：

Crop growth prediction; ubiquitous model; multimodal learning; transformer module; cross-attention mechanism; NEURAL-NETWORK; VEGETATION INDEXES; GRAIN-YIELD; TRANSFORMER; SYSTEM;

D O I：

10.1145/3627707

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Crop growth prediction can help agricultural workers to make accurate and reasonable decisions on farming activities. Existing crop growth prediction models focus on one crop and train a single model for each crop. In this article, we develop a ubiquitous growth prediction model for multiple crops, aiming at training a single model for multiple crops. A ubiquitous vision and sensor transformer (ViST) model for crop growth prediction with image and sensor data is developed to achieve the goals. In the proposed model, a cross-attention mechanism is proposed to facilitate the fusion of multimodal feature maps to reduce computational costs and balance the interactive effects among features. To train the model, we combine the data from multiple crops to create a single (ViST) model. A sensor network system is established for data collection on the farm where rice, soybean, and maize are cultivated. Experimental results show that the proposed ViST model has an excellent ubiquitous ability for crop growth prediction with multiple crops.

引用

页数：23

共 62 条

[61] Deep learning based multi-temporal crop classification [J].