We report on an active learning experiment for named entity recognition in the astronomy domain. Active learning has been shown to reduce the amount of labelled data required to train a supervised learner by selectively sampling more informative data points for human annotation. We inspect double annotation data from the same domain and quantify potential problems concerning annotators' performance. For data selectively sampled according to different selection metrics, we find lower inter-annotator agreement and higher per token annotation times. However, overall results confirm the utility of active learning.
|Title of host publication||CoNLL 2005 - Proceedings of the Ninth Conference on Computational Natural Language Learning|
|Number of pages||8|
|Publication status||Published - 2005|
|Event||9th Conference on Computational Natural Language Learning, CoNLL - 2005 - Ann Arbor, United States|
Duration: 29 Jun 2005 → 30 Jun 2005
|Other||9th Conference on Computational Natural Language Learning, CoNLL - 2005|
|Period||29/06/05 → 30/06/05|