TY - GEN
T1 - Empirical evidence for search effectiveness models
AU - Wicaksono, Alfan Farizki
AU - Moffat, Alistair
N1 - Publisher Copyright:
© 2018 Copyright held by the owner/author(s).
PY - 2018/10/17
Y1 - 2018/10/17
N2 - Given a SERP in response to a user-originated query, Moffat et al. (CIKM 2013; TOIS 2017) suggest that C(i), the conditional continuation probability of the user examining the (i + 1) st element presented in the SERP, given that they are known to have examined the i th one, is positively correlated with both i and with the user's initial estimate of the volume of answer pages they are looking for, and negatively correlated with the extent to which suitable answer pages have been identified in the SERP at positions 1 through i. Here we first describe a methodology for specifying how C(i) should be defined in practical (as against ideal) settings, and then evaluate the applicability of the approach using three large search interaction logs from two different sources.
AB - Given a SERP in response to a user-originated query, Moffat et al. (CIKM 2013; TOIS 2017) suggest that C(i), the conditional continuation probability of the user examining the (i + 1) st element presented in the SERP, given that they are known to have examined the i th one, is positively correlated with both i and with the user's initial estimate of the volume of answer pages they are looking for, and negatively correlated with the extent to which suitable answer pages have been identified in the SERP at positions 1 through i. Here we first describe a methodology for specifying how C(i) should be defined in practical (as against ideal) settings, and then evaluate the applicability of the approach using three large search interaction logs from two different sources.
KW - Adaptive metric
KW - Average precision
KW - Evaluation
KW - User model
UR - http://www.scopus.com/inward/record.url?scp=85058047707&partnerID=8YFLogxK
U2 - 10.1145/3269206.3269242
DO - 10.1145/3269206.3269242
M3 - Conference contribution
AN - SCOPUS:85058047707
T3 - International Conference on Information and Knowledge Management, Proceedings
SP - 1571
EP - 1574
BT - CIKM 2018 - Proceedings of the 27th ACM International Conference on Information and Knowledge Management
A2 - Paton, Norman
A2 - Candan, Selcuk
A2 - Wang, Haixun
A2 - Allan, James
A2 - Agrawal, Rakesh
A2 - Labrinidis, Alexandros
A2 - Cuzzocrea, Alfredo
A2 - Zaki, Mohammed
A2 - Srivastava, Divesh
A2 - Broder, Andrei
A2 - Schuster, Assaf
PB - Association for Computing Machinery
T2 - 27th ACM International Conference on Information and Knowledge Management, CIKM 2018
Y2 - 22 October 2018 through 26 October 2018
ER -