A Meta-Analysis of the Effects of Search Experience on Search Performance in Terms of the Recall Measure in Controlled IR User Experiments

Ying-Hsang Liu

Research output: Book chapter/Published conference paperConference paper

1 Citation (Scopus)

Abstract

This paper reports a meta-analysis of the effects of search experience on search performance in terms of the recall measure in controlled IR user experiments. More specifically, this study was designed to answer the research question: how large is the average effect size in the set of studies included in the meta-analysis? Search experience, a manifestation of users' search skills accumulated through their interactions with IR systems over time, has been identified as an important research variable in user search behaviours. The participants included in primary studies were end-users or intermediaries recruited for IR user experiments. The results of the meta-analysis (N = 8) using a fixed-effects model showed that search experience has an overall positive effect on the recall measure (weighted mean correlation coefficient r = 0.04, 95% confidence interval was -0.01 to 0.09). Our findings may provide implications for designing adaptive or personalized IR systems that take into account the contextual information at the user and interactional levels.
Original languageEnglish
Title of host publicationADCS 2010
Place of PublicationMelbourne
PublisherSchool of Computer Science and IT, RMIT University
Pages1-6
Number of pages6
ISBN (Electronic)9781921426803
Publication statusPublished - 2010
EventAustralasian Document Computing Symposium - Melbourne, Australia
Duration: 10 Dec 2010 → …

Conference

ConferenceAustralasian Document Computing Symposium
CountryAustralia
Period10/12/10 → …

Fingerprint Dive into the research topics of 'A Meta-Analysis of the Effects of Search Experience on Search Performance in Terms of the Recall Measure in Controlled IR User Experiments'. Together they form a unique fingerprint.

  • Cite this

    Liu, Y-H. (2010). A Meta-Analysis of the Effects of Search Experience on Search Performance in Terms of the Recall Measure in Controlled IR User Experiments. In ADCS 2010 (pp. 1-6). School of Computer Science and IT, RMIT University.