LifeInsight 2.0: An Enhanced Approach for Automated Lifelog Retrieval in LSC'24

被引：0
|
作者：
Gia-Huy Vuong [1 ]
Van-Son Ho [1 ]
Tien-Thanh Nguyen-Dang [1 ]
Xuan-Dang Thai [1 ]
Minh-Triet Tran [1 ]
Thang-Long Nguyen-Ho [2 ]
Minh-Khoi Pham [2 ]
Tu-Khiem Le [2 ]
Van-Tu Ninh [2 ]
Healy, Graham [2 ]
Gurrin, Cathal [2 ]
机构：
[1] Vietnam Natl Univ, Univ Sci, VNU HCM, Ho Chi Minh City, Vietnam
[2] Dublin City Univ, Dublin, Ireland
来源：
PROCEEDINGS OF 2024 ACM WORKSHOP ON THE LIFELOG SEARCH CHALLENGE, LSC 2024 | 2024年
基金：
爱尔兰科学基金会;
关键词：
lifelog; interactive retrieval; automatic retrieval; spatial insights; AI-based assistance;
D O I：
10.1145/3643489.3661112
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We introduce the LifeInsight 2.0 system - an enhanced version of LifeInsight, built specifically for the sixth annual Lifelog Search Challenge (LSC'23). LifeInsight 2.0 leverages the core functionalities of LifeInsight while incorporating significant improvements to address performance bottlenecks. This refined architecture aims to deliver superior search capabilities within the LSC'24. LifeInsight 2.0 employs an ensemble approach combining two powerful foundation models: CLIP (Contrastive Language-Image Pretraining) and BLIP2 (Bootstrapping Language-Image Pretraining) model. In addition, the system incorporates a temporal query mechanism and an automatic query parser. The former enables LifeInsight 2.0 to interpret queries that include time-based information, while the latter specifically handles tasks involving question answering.
引用
收藏
页码：1 / 6
页数：6
相关论文
共 50 条
  • [31] An enhanced opinion retrieval approach via implicit feature identification
    Eldin, Sarah Saad
    Mohammed, Ammar
    Eldin, Ahmed Sharaf
    Hefny, Hesham
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2021, 57 (01) : 101 - 126
  • [32] aGRodet 2.0: An Automated Real-Time Approach for Multiclass Plant Disease Detection
    Mitra A.
    Mohanty S.P.
    Kougianos E.
    SN Computer Science, 4 (5)
  • [33] A COMBINED OPTIMIZATION AND SIMULATION APPROACH FOR DESIGNING AUTOMATED STORAGE-RETRIEVAL SYSTEMS
    ROSENBLATT, MJ
    ROLL, Y
    ZYSER, V
    IIE TRANSACTIONS, 1993, 25 (01) : 40 - 50
  • [34] A Content-Based Visual Information Retrieval Approach for Automated Image Annotation
    Senthil, Karthik
    Arun, Abhi
    Sowmya, Kamath S.
    PROGRESS IN INTELLIGENT COMPUTING TECHNIQUES: THEORY, PRACTICE, AND APPLICATIONS, VOL 1, 2018, 518 : 69 - 80
  • [35] Hybrid query refinement based approach for enhanced biomedical image retrieval
    Yatin Kumar Agarwal
    Dilkeshwar Pandey
    Lokendra Singh Umrao
    Multimedia Tools and Applications, 2024, 83 : 49515 - 49536
  • [36] Hybrid query refinement based approach for enhanced biomedical image retrieval
    Agarwal, Yatin Kumar
    Pandey, Dilkeshwar
    Umrao, Lokendra Singh
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (16) : 49515 - 49536
  • [37] An Enhanced Opinion Retrieval Approach on Arabic Text for Customer Requirements Expansion
    Eldin, Sarah Saad
    Mohammed, Ammar
    Hefny, Hesham
    Ahmed, Ahmed Sharaf Eldin
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2021, 33 (03) : 351 - 363
  • [38] PheValuator 2.0: Methodological improvements for the PheValuator approach to semi-automated phenotype algorithm evaluation
    Swerdel, Joel N.
    Schuemie, Martijn
    Murray, Gayle
    Ryan, Patrick B.
    JOURNAL OF BIOMEDICAL INFORMATICS, 2022, 135
  • [39] An approach toward an automated object retrieval operation with a two-arm flexible manipulator
    Miyabe, T
    Konno, A
    Uchiyama, M
    Yamano, M
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2004, 23 (03): : 275 - 291
  • [40] A multi criteria decision-making approach to evaluate automated storage and retrieval systems
    Tosun O.
    Aktan H.E.
    Tosun, Ömür (omurtosun@akdeniz.edu.tr), 1600, Inderscience Enterprises Ltd., 29, route de Pre-Bois, Case Postale 856, CH-1215 Geneva 15, CH-1215, Switzerland (09): : 182 - 195
12345