The effects of relevance feedback quality and quantity in interactive relevance feedback: A simulation based on user modeling

Tutkimustuotos: KonferenssiartikkeliScientificvertaisarvioitu

12 Sitaatiot (Scopus)

Abstrakti

Experiments on the effectiveness of relevance feedback with real users are time-consuming and expensive. This makes simulation for rapid testing desirable. We define a user model, which helps to quantify some interaction decisions involved in simulated relevance feedback. First, the relevance criterion defines the relevance threshold of the user to accept documents as relevant to his/her needs. Second, the browsing effort refers to the patience of the user to browse through the initial list of retrieved documents in order to give feedback. Third, the feedback effort refers to the effort and ability of the user to collect feedback documents. We use the model to construct several simulated relevance feedback scenarios in a laboratory setting. Using TREC data providing graded relevance assessments, we study the effect of the quality and quantity of the feedback documents on the effectiveness of the relevance feedback and compare this to the pseudo-relevance feedback. Our results indicate that one can compensate large amounts of relevant but low quality feedback by small amounts of highly relevant feedback.

AlkuperäiskieliEnglanti
OtsikkoAdvances in Information Retrieval
Alaotsikko28th European Conference on IR Research, ECIR 2006, Proceedings
KustantajaSpringer
Sivut191-204
Sivumäärä14
ISBN (painettu)9783540333470
DOI - pysyväislinkit
TilaJulkaistu - 2006
Julkaistu ulkoisestiKyllä
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
Tapahtuma28th European Conference on Information Retrieval Research, ECIR 2006 - London, Iso-Britannia
Kesto: 10 huhtik. 200612 huhtik. 2006

Julkaisusarja

NimiLecture Notes in Computer Science
Vuosikerta3936 LNCS
ISSN (painettu)0302-9743
ISSN (elektroninen)1611-3349

Conference

Conference28th European Conference on Information Retrieval Research, ECIR 2006
Maa/AlueIso-Britannia
KaupunkiLondon
Ajanjakso10/04/0612/04/06

!!ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Sormenjälki

Sukella tutkimusaiheisiin 'The effects of relevance feedback quality and quantity in interactive relevance feedback: A simulation based on user modeling'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä