FLOOD SIMULATION: INTEGRATING UAS IMAGERY AND AI-GENERATED DATA WITH DIFFUSION MODEL

被引:0
作者
Hu, Xiyang [1 ]
Rahnemoonfar, Maryam [1 ]
机构
[1] Lehigh Univ, Comp Sci & Engn, Bethlehem, PA 18015 USA
来源
IGARSS 2024-2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, IGARSS 2024 | 2024年
关键词
Unmanned aircraft system; Diffusion Model; Image-to-Text; Remote Sensing;
D O I
10.1109/IGARSS53475.2024.10640764
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
The primary goal of early disaster impact assessments is to gather georeferenced data about affected areas. Floods, a major natural calamity, pose challenges in data collection and response coordination. The use of Unmanned Aerial Systems (UAS) has significantly improved data acquisition in flood-impacted regions, offering a cost-effective method for obtaining high-quality images. However, issues like accurate image description and data scarcity remain. Addressing these, we propose two novel methods: GPT models for precise image-to-text conversion and diffusion models for flood data simulation. GPT models enhance data quality with accurate descriptions, while diffusion models extend our dataset by simulating diverse flood scenarios, enriching our training resources. Further analysis of this augmented dataset for similarity demonstrates a wide-ranging variety in the data, highlighting a diverse array of elements within images.
引用
收藏
页码:565 / 568
页数:4
相关论文
共 12 条
[1]   Diffusion Models in Vision: A Survey [J].
Croitoru, Florinel-Alin ;
Hondru, Vlad ;
Ionescu, Radu Tudor ;
Shah, Mubarak .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) :10850-10869
[2]  
Kamilaris A., 2018, arXiv
[3]   Multi-Concept Customization of Text-to-Image Diffusion [J].
Kumari, Nupur ;
Zhang, Bingliang ;
Zhang, Richard ;
Shechtman, Eli ;
Zhu, Jun-Yan .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :1931-1941
[4]   SeaDroneSim: Simulation of Aerial Images for Detection of Objects AboveWater [J].
Lin, Xiaomin ;
Liu, Cheng ;
Pattillo, Allen ;
Yu, Miao ;
Aloimonous, Yiannis .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW), 2023, :216-223
[5]   Kalman Filter-Based Large-Scale Wildfire Monitoring With a System of UAVs [J].
Lin, Zhongjie ;
Liu, Hugh H. T. ;
Wotton, Mike .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2019, 66 (01) :606-615
[6]  
OpenAI, 2023, Gpt-4v(ision) system card
[7]   FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understanding [J].
Rahnemoonfar, Maryam ;
Chowdhury, Tashnim ;
Sarkar, Argho ;
Varshney, Debvrat ;
Yari, Masoud ;
Murphy, Robin Roberson .
IEEE ACCESS, 2021, 9 :89644-89654
[8]   High-Resolution Image Synthesis with Latent Diffusion Models [J].
Rombach, Robin ;
Blattmann, Andreas ;
Lorenz, Dominik ;
Esser, Patrick ;
Ommer, Bjoern .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :10674-10685
[9]  
Saharia C., 2022, ACM SIGGRAPH 2022 C, P1
[10]  
Sama Avinash Kaur, 2023, ITM Web of Conferences, DOI 10.1051/itmconf/20235402006