Towards information retrieval evaluation with reduced and only positive judgements

Diego Mollá, David Martinez, Iman Amini

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contribution

2 Citations (Scopus)

Abstract

This paper proposes a document distance-based approach to automatically expand the number of available relevance judgements when those are limited and reduced to only positive judgements. This may happen, for example, when the only available judgements are extracted from a list of references in a published clinical systematic review. We show that evaluations based on these expanded relevance judgements are more reliable than those using only the initially available judgements. We also show the impact of such an evaluation approach as the number of initial judgements decreases.

Original languageEnglish
Title of host publicationProceedings of the 18th Australasian Document Computing Symposium, ADCS 2013
EditorsLaurianne Sitbon
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Pages109-112
Number of pages4
ISBN (Print)9781450325240
Publication statusPublished - 2013
Event18th Australasian Document Computing Symposium, ADCS 2013 - Brisbane, QLD, Australia
Duration: 5 Dec 20136 Dec 2013

Other

Other18th Australasian Document Computing Symposium, ADCS 2013
CountryAustralia
CityBrisbane, QLD
Period5/12/136/12/13

Fingerprint Dive into the research topics of 'Towards information retrieval evaluation with reduced and only positive judgements'. Together they form a unique fingerprint.

Cite this