Active learning for deep semantic parsing

Long Duong, Hadi Afshar, Dominique Estival, Glen Pink, Philip Cohen, Mark Johnson

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionResearchpeer-review

Abstract

Semantic parsing requires training data that is expensive and slow to collect. We apply active learning to both traditional and “overnight” data collection approaches. We show that it is possible to obtain good training hyperparameters from seed data which is only a small fraction of the full dataset. We show that uncertainty sampling based on least confidence score is competitive in traditional data collection but not applicable for overnight collection. We evaluate several active learning strategies for overnight data collection and show that different example selection strategies per domain perform best.

LanguageEnglish
Title of host publicationACL 2018 The 56th Annual Meeting of the Association for Computational Linguistics
Subtitle of host publicationProceedings of the Conference, Vol. 2 (Short Papers)
EditorsIryna Gurevych, Yusuke Miyao
PublisherAssociation for Computational Linguistics (ACL)
Pages43-48
Number of pages6
Volume2
ISBN (Electronic)9781948087346
Publication statusPublished - 1 Jan 2018
Externally publishedYes
Event56th Annual Meeting of the Association for Computational Linguistics, ACL 2018 - Melbourne, Australia
Duration: 15 Jul 201820 Jul 2018

Conference

Conference56th Annual Meeting of the Association for Computational Linguistics, ACL 2018
CountryAustralia
CityMelbourne
Period15/07/1820/07/18

Fingerprint

Semantics
Seed
Sampling
Problem-Based Learning
Uncertainty

Cite this

Duong, L., Afshar, H., Estival, D., Pink, G., Cohen, P., & Johnson, M. (2018). Active learning for deep semantic parsing. In I. Gurevych, & Y. Miyao (Eds.), ACL 2018 The 56th Annual Meeting of the Association for Computational Linguistics: Proceedings of the Conference, Vol. 2 (Short Papers) (Vol. 2, pp. 43-48). [P18-2008] Association for Computational Linguistics (ACL).
Duong, Long ; Afshar, Hadi ; Estival, Dominique ; Pink, Glen ; Cohen, Philip ; Johnson, Mark. / Active learning for deep semantic parsing. ACL 2018 The 56th Annual Meeting of the Association for Computational Linguistics: Proceedings of the Conference, Vol. 2 (Short Papers). editor / Iryna Gurevych ; Yusuke Miyao. Vol. 2 Association for Computational Linguistics (ACL), 2018. pp. 43-48
@inproceedings{d6143b5c36984851a249b12865f8ccd3,
title = "Active learning for deep semantic parsing",
abstract = "Semantic parsing requires training data that is expensive and slow to collect. We apply active learning to both traditional and “overnight” data collection approaches. We show that it is possible to obtain good training hyperparameters from seed data which is only a small fraction of the full dataset. We show that uncertainty sampling based on least confidence score is competitive in traditional data collection but not applicable for overnight collection. We evaluate several active learning strategies for overnight data collection and show that different example selection strategies per domain perform best.",
author = "Long Duong and Hadi Afshar and Dominique Estival and Glen Pink and Philip Cohen and Mark Johnson",
year = "2018",
month = "1",
day = "1",
language = "English",
volume = "2",
pages = "43--48",
editor = "Iryna Gurevych and Yusuke Miyao",
booktitle = "ACL 2018 The 56th Annual Meeting of the Association for Computational Linguistics",
publisher = "Association for Computational Linguistics (ACL)",

}

Duong, L, Afshar, H, Estival, D, Pink, G, Cohen, P & Johnson, M 2018, Active learning for deep semantic parsing. in I Gurevych & Y Miyao (eds), ACL 2018 The 56th Annual Meeting of the Association for Computational Linguistics: Proceedings of the Conference, Vol. 2 (Short Papers). vol. 2, P18-2008, Association for Computational Linguistics (ACL), pp. 43-48, 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, 15/07/18.

Active learning for deep semantic parsing. / Duong, Long; Afshar, Hadi; Estival, Dominique; Pink, Glen; Cohen, Philip; Johnson, Mark.

ACL 2018 The 56th Annual Meeting of the Association for Computational Linguistics: Proceedings of the Conference, Vol. 2 (Short Papers). ed. / Iryna Gurevych; Yusuke Miyao. Vol. 2 Association for Computational Linguistics (ACL), 2018. p. 43-48 P18-2008.

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionResearchpeer-review

TY - GEN

T1 - Active learning for deep semantic parsing

AU - Duong,Long

AU - Afshar,Hadi

AU - Estival,Dominique

AU - Pink,Glen

AU - Cohen,Philip

AU - Johnson,Mark

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Semantic parsing requires training data that is expensive and slow to collect. We apply active learning to both traditional and “overnight” data collection approaches. We show that it is possible to obtain good training hyperparameters from seed data which is only a small fraction of the full dataset. We show that uncertainty sampling based on least confidence score is competitive in traditional data collection but not applicable for overnight collection. We evaluate several active learning strategies for overnight data collection and show that different example selection strategies per domain perform best.

AB - Semantic parsing requires training data that is expensive and slow to collect. We apply active learning to both traditional and “overnight” data collection approaches. We show that it is possible to obtain good training hyperparameters from seed data which is only a small fraction of the full dataset. We show that uncertainty sampling based on least confidence score is competitive in traditional data collection but not applicable for overnight collection. We evaluate several active learning strategies for overnight data collection and show that different example selection strategies per domain perform best.

UR - http://www.scopus.com/inward/record.url?scp=85063133784&partnerID=8YFLogxK

M3 - Conference proceeding contribution

VL - 2

SP - 43

EP - 48

BT - ACL 2018 The 56th Annual Meeting of the Association for Computational Linguistics

PB - Association for Computational Linguistics (ACL)

ER -

Duong L, Afshar H, Estival D, Pink G, Cohen P, Johnson M. Active learning for deep semantic parsing. In Gurevych I, Miyao Y, editors, ACL 2018 The 56th Annual Meeting of the Association for Computational Linguistics: Proceedings of the Conference, Vol. 2 (Short Papers). Vol. 2. Association for Computational Linguistics (ACL). 2018. p. 43-48. P18-2008