Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures (Extended Abstract)

被引:0
|
作者
Bernardi, Raffaella [1 ]
Cakici, Ruket [2 ]
Elliott, Desmond [3 ]
Erdem, Aykut [4 ]
Erdem, Erkut [4 ]
Ikizler-Cinbis, Nazli [4 ]
Keller, Frank [5 ]
Muscat, Adrian [6 ]
Plank, Barbara [7 ]
机构
[1] Univ Trento, Trento, Italy
[2] Middle East Tech Univ, Ankara, Turkey
[3] Univ Amsterdam, Amsterdam, Netherlands
[4] Hacettepe Univ, Ankara, Turkey
[5] Univ Edinburgh, Edinburgh, Midlothian, Scotland
[6] Univ Malta, Msida, Malta
[7] Univ Groningen, Groningen, Netherlands
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic image description generation is a challenging problem that has recently received a large amount of interest from the computer vision and natural language processing communities. In this survey, we classify the known approaches based on how they conceptualise this problem and provide a review of existing models, highlighting their advantages and disadvantages. Moreover, we give an overview of the benchmark image-text datasets and the evaluation measures that have been developed to assess the quality of machine-generated descriptions. Finally we explore future directions in the area of automatic image description.
引用
收藏
页码:4970 / 4974
页数:5
相关论文
共 50 条
  • [1] Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures
    Bernardi, Raffaella
    Cakici, Ruket
    Elliott, Desmond
    Erdem, Aykut
    Erdem, Erkut
    Ikizler-Cinbis, Nazli
    Keller, Frank
    Muscat, Adrian
    Plank, Barbara
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2016, 55 : 409 - 442
  • [3] TasvirEt: A Benchmark Dataset for Automatic Turkish Description Generation from Images
    Unal, Mesut Erhan
    Citamak, Begum
    Yagcioglu, Semih
    Erdem, Aykut
    Erdem, Erkut
    Cinbis, Nazli Ikizler
    Cakici, Ruket
    2016 24TH SIGNAL PROCESSING AND COMMUNICATION APPLICATION CONFERENCE (SIU), 2016, : 1977 - 1980
  • [4] Comparing Automatic Evaluation Measures for Image Description
    Elliott, Desmond
    Keller, Frank
    PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2, 2014, : 452 - 457
  • [5] Abstraction and reformulation in the generation of constraint models - (Extended abstract)
    Frisch, Alan M.
    ABSTRACTION, REFORMULATION, AND APPROXIMATION, PROCEEDINGS, 2007, 4612 : 2 - 3
  • [6] Video Description: A Survey of Methods, Datasets, and Evaluation Metrics
    Aafaq, Nayyer
    Mian, Ajmal
    Liu, Wei
    Gilani, Syed Zulqarnain
    Shah, Mubarak
    ACM COMPUTING SURVEYS, 2020, 52 (06)
  • [7] A Systematic Survey of Automatic Image Description Generation Systems
    Sreela, S. R.
    Idicula, Sumam Mary
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2024,
  • [8] A Survey on Deep Learning and Explainability for Automatic Report Generation from Medical Images
    Messina, Pablo
    Pino, Pablo
    Parra, Denis
    Soto, Alvaro
    Besa, Cecilia
    Uribe, Sergio
    Andia, Marcelo
    Tejos, Cristian
    Prieto, Claudia
    Capurro, Daniel
    ACM COMPUTING SURVEYS, 2022, 54 (10S)
  • [9] Automatic Generation of Description for Images Using Recurrent Neural Network
    Veena, G. S.
    Patil, Savitri
    Kumar, T. N. R.
    COMPUTING AND NETWORK SUSTAINABILITY, 2019, 75
  • [10] Automatic generation of workflow-extended domain models
    Brambilla, Marco
    Cabot, Jordi
    Comai, Sara
    MODEL DRIVEN ENGINEERING LANGUAGES AND SYSTEMS, PROCEEDINGS, 2007, 4735 : 375 - +