Session search modeling by partially observable Markov decision process

被引:8
作者
Yang, Grace Hui [1 ]
Dong, Xuchu [1 ,2 ]
Luo, Jiyun [1 ]
Zhang, Sicong [1 ]
机构
[1] Georgetown Univ, Dept Comp Sci, Washington, DC 20057 USA
[2] Jilin Univ, Coll Comp Sci & Technol, Changchun, Jilin, Peoples R China
来源
INFORMATION RETRIEVAL JOURNAL | 2018年 / 21卷 / 01期
关键词
Session search; Dynamic IR modeling; POMDP;
D O I
10.1007/s10791-017-9316-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Session search, the task of document retrieval for a series of queries in a session, has been receiving increasing attention from the information retrieval research community. Session search exhibits the properties of rich user-system interactions and temporal dependency. These properties lead to our proposal of using partially observable Markov decision process to model session search. On the basis of a design choice schema for states, actions and rewards, we evaluate different combinations of these choices over the TREC 2012 and 2013 session track datasets. According to the experimental results, practical design recommendations for using PODMP in session search are discussed.
引用
收藏
页码:56 / 80
页数:25
相关论文
共 50 条
[41]   Solving Partially Observable Environments with Universal Search Using Dataflow Graph-Based Programming Model [J].
Paul, Swarna Kamal ;
Bhaumik, Parama .
IETE JOURNAL OF RESEARCH, 2023, 69 (09) :6137-6151
[42]   Optimal control of infinite horizon partially observable decision processes modelled as generators of probabilistic regular languages [J].
Chattopadhyay, Ishanu ;
Ray, Asok .
INTERNATIONAL JOURNAL OF CONTROL, 2010, 83 (03) :457-483
[43]   Simplified Risk-aware Decision Making with Belief-dependent Rewards in Partially Observable Domains [J].
Zhitnikov, Andrey ;
Indelman, Vadim .
ARTIFICIAL INTELLIGENCE, 2022, 312
[44]   Enhancing User Behavior Sequence Modeling by Generative Tasks for Session Search [J].
Chen, Haonan ;
Dou, Zhicheng ;
Zhu, Yutao ;
Cao, Zhao ;
Cheng, Xiaohua ;
Wen, Ji-Rong .
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, :180-190
[45]   Improving Session Search by Modeling Multi-Granularity Historical Query Change [J].
Zuo, Xiaochen ;
Dou, Zhicheng ;
Wen, Ji-Rong .
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, :1534-1542
[46]   A partially observable multi-ship collision avoidance decision-making model based on deep reinforcement learning [J].
Zheng, Kangjie ;
Zhang, Xinyu ;
Wang, Chengbo ;
Zhang, Mingyang ;
Cui, Hao .
OCEAN & COASTAL MANAGEMENT, 2023, 242
[47]   Engineering the Decision-Making Process Using Multiple Markov Theories and DEMO [J].
Guerreiro, Sergio .
ADVANCES IN ENTERPRISE ENGINEERING IX, 2015, 211 :19-33
[48]   Visual Search as a Probabilistic Sequential Decision Process in Software Autonomous System [J].
Ghosh, Aritra ;
Huang, Shihong .
IEEE SOUTHEASTCON 2018, 2018,
[49]   Risk-Aware Markov Decision Process Contingency Management Autonomy for Uncrewed Aircraft Systems [J].
Sharma, Prashin ;
Kraske, Benjamin ;
Kim, Joseph ;
Laouar, Zakariya ;
Sunberg, Zachary ;
Atkins, Ella .
JOURNAL OF AEROSPACE INFORMATION SYSTEMS, 2024, 21 (03) :234-248
[50]   Industrial 5G Service Quality Assurance via Markov Decision Process Mapping [J].
Kattepur, Ajay ;
Nair, Anil Ramachandran ;
Saimler, Merve ;
Donmez, Yunus .
2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,