There has been considerable work on syntactic language models and they have advanced greatly over the last decade. Most of them have used a probabilistic contextfree grammar (PCFG) or a dependency grammar (DG). In particular, DG has attracted more and more interest in the past years since dependency parsing has achieved great success. While much work has evaluated the effects of different dependency representations in the context of parsing, there has been relatively little investigation into them on a syntactic language model. In this work, we conduct the first assessment of three dependency representations on a transition-based dependency parsing language model. We show that the choice of dependency representation has an impact on overall performance from the perspective of language modelling.
|Title of host publication||Proceedings of the Australasian Language Technology Association Workshop 2014|
|Editors||Gabriela Ferraro, Stephen Wan|
|Place of Publication||Brisbane, Australia|
|Publisher||Australasian Language Technology Association|
|Number of pages||10|
|Publication status||Published - 2014|
|Event||Australasian Language Technology Association Workshop (12th : 2014) - Melbourne, Australia|
Duration: 26 Nov 2014 → 28 Nov 2014
|Name||Australasian Language Technology Association Workshop|
|Workshop||Australasian Language Technology Association Workshop (12th : 2014)|
|Period||26/11/14 → 28/11/14|
Bibliographical noteCopyright the Publisher 2014. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.
Kim, S. M., Pate, J. K., & Johnson, M. (2014). The effect of dependency representation scheme on syntactic language modelling. In G. Ferraro, & S. Wan (Eds.), Proceedings of the Australasian Language Technology Association Workshop 2014 (pp. 4-13). (Australasian Language Technology Association Workshop; Vol. 12). Brisbane, Australia: Australasian Language Technology Association.