LifeInsight 2.0: An Enhanced Approach for Automated Lifelog Retrieval in LSC'24

被引:0
|
作者
Gia-Huy Vuong [1 ]
Van-Son Ho [1 ]
Tien-Thanh Nguyen-Dang [1 ]
Xuan-Dang Thai [1 ]
Minh-Triet Tran [1 ]
Thang-Long Nguyen-Ho [2 ]
Minh-Khoi Pham [2 ]
Tu-Khiem Le [2 ]
Van-Tu Ninh [2 ]
Healy, Graham [2 ]
Gurrin, Cathal [2 ]
机构
[1] Vietnam Natl Univ, Univ Sci, VNU HCM, Ho Chi Minh City, Vietnam
[2] Dublin City Univ, Dublin, Ireland
基金
爱尔兰科学基金会;
关键词
lifelog; interactive retrieval; automatic retrieval; spatial insights; AI-based assistance;
D O I
10.1145/3643489.3661112
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce the LifeInsight 2.0 system - an enhanced version of LifeInsight, built specifically for the sixth annual Lifelog Search Challenge (LSC'23). LifeInsight 2.0 leverages the core functionalities of LifeInsight while incorporating significant improvements to address performance bottlenecks. This refined architecture aims to deliver superior search capabilities within the LSC'24. LifeInsight 2.0 employs an ensemble approach combining two powerful foundation models: CLIP (Contrastive Language-Image Pretraining) and BLIP2 (Bootstrapping Language-Image Pretraining) model. In addition, the system incorporates a temporal query mechanism and an automatic query parser. The former enables LifeInsight 2.0 to interpret queries that include time-based information, while the latter specifically handles tasks involving question answering.
引用
收藏
页码:1 / 6
页数:6
相关论文
共 50 条
  • [41] Technical note: A graphical approach to the analysis of travel times in an automated storage and retrieval system
    Liu, Jingming
    Liao, Haitao
    White, John A.
    NAVAL RESEARCH LOGISTICS, 2022, 69 (06) : 914 - 923
  • [42] Automated Assistance in E-commerce: An Approach Based on Category-Sensitive Retrieval
    Majumder, Anirban
    Pander, Abhay
    Vonteru, Kondalarao
    Gangwar, Abhishek
    Maji, Subhadeep
    Bhatia, Pankaj
    Goyal, Pawan
    ADVANCES IN INFORMATION RETRIEVAL (ECIR 2018), 2018, 10772 : 604 - 610
  • [43] SERNOTATE: An automated approach for business service description annotation for efficient service retrieval and composition
    Chotipant, Supannada
    Hussain, Farookh Khadeer
    Hussain, Omar Khadeer
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2018, 30 (01):
  • [44] A NEW APPROACH TO MIXING TECHNIQUES FOR ENHANCED PERFORMANCE IN AUTOMATED SAMPLE PREPARATION
    QIAN, F
    VERETTE, E
    ELSAYED, A
    JOURNAL OF AUTOMATIC CHEMISTRY, 1995, 17 (05): : 169 - 171
  • [45] Exploring a CLIP-Enhanced Automated Approach for Video Description Generation
    Zhang, Siang-Ling
    Cheng, Huai-Hsun
    Chen, Yen-Hsin
    Yeh, Mei-Chen
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 1506 - 1511
  • [46] An Intelligent Approach to Automated Operating Systems Log Analysis for Enhanced Security
    Johnphill, Obinna
    Sadiq, Ali Safaa
    Kaiwartya, Omprakash
    Aljaidi, Mohammad
    INFORMATION, 2024, 15 (10)
  • [47] An automated and high-throughput approach for enhanced precision of adenoviral titering
    Bottega, Paolo
    Fusciello, Manlio
    Hamdan, Firas
    Chiaro, Jacopo
    Russo, Salvatore
    D'Alessio, Federica
    Cerullo, Vincenzo
    MOLECULAR THERAPY METHODS & CLINICAL DEVELOPMENT, 2025, 33 (01)
  • [48] An LLM-based hybrid approach for enhanced automated essay scoring
    John Atkinson
    Diego Palma
    Scientific Reports, 15 (1)
  • [49] Semantically Enhanced Medical Information Retrieval System: A Tensor Factorization Based Approach
    Wang, Haolin
    Zhang, Qingpeng
    Yuan, Jiahu
    IEEE ACCESS, 2017, 5 : 7584 - 7593
  • [50] NLP-based approach for automated safety requirements information retrieval from project documents
    Wu, Zhijiang
    Ma, Guofeng
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 239