LifeInsight 2.0: An Enhanced Approach for Automated Lifelog Retrieval in LSC'24

被引：0
|
作者：
Gia-Huy Vuong [1 ]
Van-Son Ho [1 ]
Tien-Thanh Nguyen-Dang [1 ]
Xuan-Dang Thai [1 ]
Minh-Triet Tran [1 ]
Thang-Long Nguyen-Ho [2 ]
Minh-Khoi Pham [2 ]
Tu-Khiem Le [2 ]
Van-Tu Ninh [2 ]
Healy, Graham [2 ]
Gurrin, Cathal [2 ]
机构：
[1] Vietnam Natl Univ, Univ Sci, VNU HCM, Ho Chi Minh City, Vietnam
[2] Dublin City Univ, Dublin, Ireland
来源：
PROCEEDINGS OF 2024 ACM WORKSHOP ON THE LIFELOG SEARCH CHALLENGE, LSC 2024 | 2024年
基金：
爱尔兰科学基金会;
关键词：
lifelog; interactive retrieval; automatic retrieval; spatial insights; AI-based assistance;
D O I：
10.1145/3643489.3661112
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We introduce the LifeInsight 2.0 system - an enhanced version of LifeInsight, built specifically for the sixth annual Lifelog Search Challenge (LSC'23). LifeInsight 2.0 leverages the core functionalities of LifeInsight while incorporating significant improvements to address performance bottlenecks. This refined architecture aims to deliver superior search capabilities within the LSC'24. LifeInsight 2.0 employs an ensemble approach combining two powerful foundation models: CLIP (Contrastive Language-Image Pretraining) and BLIP2 (Bootstrapping Language-Image Pretraining) model. In addition, the system incorporates a temporal query mechanism and an automatic query parser. The former enables LifeInsight 2.0 to interpret queries that include time-based information, while the latter specifically handles tasks involving question answering.
引用
收藏
页码：1 / 6
页数：6
相关论文
共 50 条
  • [1] MemoriEase 2.0: A Conversational Lifelog Retrieve System for LSC'24
    Quang-Linh Tran
    Binh Nguyen
    Jones, Gareth J. F.
    Gurrin, Cathal
    PROCEEDINGS OF 2024 ACM WORKSHOP ON THE LIFELOG SEARCH CHALLENGE, LSC 2024, 2024, : 12 - 17
  • [2] Flexible Interactive Retrieval SysTem 2.0 for Visual Lifelog Exploration at LSC 2021
    Hoang-Phuc Trang-Trung
    Thanh-Cong Le
    Mai-Khiem Tran
    Van-Tu Ninh
    Tu-Khiem Le
    Gurrin, Cathal
    Minh-Triet Tran
    LSC '21: PROCEEDINGS OF THE 4TH ANNUAL LIFELOG SEARCH CHALLENGE, 2021, : 81 - 87
  • [3] Mysceal 2.0: A Revised Experimental Interactive Lifelog Retrieval System for LSC′21
    Tran, Ly-Duyen
    Nguyen, Manh-Duy
    Nguyen Thanh Binh
    Lee, Hyowon
    Gurrin, Cathal
    LSC '21: PROCEEDINGS OF THE 4TH ANNUAL LIFELOG SEARCH CHALLENGE, 2021, : 11 - 16
  • [4] Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021
    Heller, Silvan
    Gasser, Ralph
    Parian-Scherb, Mahnaz
    Popovic, Sanja
    Rossetto, Luca
    Sauter, Loris
    Spiess, Florian
    Schuldt, Heiko
    LSC '21: PROCEEDINGS OF THE 4TH ANNUAL LIFELOG SEARCH CHALLENGE, 2021, : 35 - 39
  • [5] SnapSeek: An Interactive Lifelog Acquisition System for LSC'24
    Minh-Quan Ho-Le
    Huy-Hoang Do-Huu
    Duy-Khang Ho
    Nhut-Thanh Le-Hinh
    Hoa-Vien Vo-Hoang
    Van-Tu Ninh
    Minh-Triet Tran
    PROCEEDINGS OF 2024 ACM WORKSHOP ON THE LIFELOG SEARCH CHALLENGE, LSC 2024, 2024, : 24 - 29
  • [6] Introduction to the Seventh Annual Lifelog Search Challenge, LSC'24
    Gurrin, Cathal
    Zhou, Liting
    Healy, Graham
    Bailer, Werner
    Dang-Nguyen, Duc-Tien
    Hodges, Steve
    Jonsson, Bjorn Thornor
    Lokoc, Jakub
    Rossetto, Luca
    Tran, Minh-Triet
    Schoeffmann, Klaus
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 1334 - 1335
  • [7] LifeSeeker 6.0: Leveraging the linguistic aspect of the lifelog system in LSC'24
    Hoang-Bao Le
    Thao-Nhu Nguyen
    Tu-Khiem Le
    Minh-Triet Tran
    Thanh-Binh Nguyen
    Van-Tu Ninh
    Zhou, Liting
    Gurrin, Cathal
    PROCEEDINGS OF 2024 ACM WORKSHOP ON THE LIFELOG SEARCH CHALLENGE, LSC 2024, 2024, : 53 - 57
  • [8] General Purpose Multimedia Retrieval with vitrivr at LSC'24
    Sauter, Loris
    Gasser, Ralph
    Rettig, Laura
    Schuldt, Heiko
    Rossetto, Luca
    PROCEEDINGS OF 2024 ACM WORKSHOP ON THE LIFELOG SEARCH CHALLENGE, LSC 2024, 2024, : 47 - 52
  • [9] An Interactive Watershed-based Approach for Lifelog Moment Retrieval
    Trong-Dat Phan
    Minh-Son Dao
    Zettsu, Koji
    2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 282 - 286
  • [10] LifeLens 2.0: Improving Efficiency and Usability in Lifelog Retrieval Systems through UX/UI Design
    Hordvik, Maria Tysse
    Ostby, Julie Sophie Teilstad
    Duc-Tien Dang-Nguyen
    Kesavulu, Manoj
    Thao-Nhu Nguyen
    Tu-Khiem Le
    Gurrin, Cathal
    Minh-Triet Tran
    PROCEEDINGS OF 2024 ACM WORKSHOP ON THE LIFELOG SEARCH CHALLENGE, LSC 2024, 2024, : 41 - 46
12345