Exploiting social information in grounded language learning via grammatical reductions

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionResearchpeer-review

Abstract

This paper uses an unsupervised model of grounded language acquisition to study the role that social cues play in language acquisition. The input to the model consists of (orthographically transcribed) child-directed utterances accompanied by the set of objects present in the non-linguistic context. Each object is annotated by social cues, indicating e.g., whether the caregiver is looking at or touching the object. We show how to model the task of inferring which objects are being talked about (and which words refer to which objects) as standard grammatical inference, and describe PCFG-based unigram models and adaptor grammar-based collocation models for the task. Exploiting social cues improves the performance of all models. Our models learn the relative importance of each social cue jointly with word-object mappings and collocation structure, consistent with the idea that children could discover the importance of particular social information sources during word learning.

LanguageEnglish
Title of host publicationProceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL 2012
Place of PublicationStroudsburg, PA
PublisherAssociation for Computational Linguistics (ACL)
Pages883-891
Number of pages9
Volume1
ISBN (Print)9781937284244
Publication statusPublished - 2012
Event50th Annual Meeting of the Association for Computational Linguistics, ACL - 2012 - Jeju Island, Korea, Republic of
Duration: 8 Jul 201214 Jul 2012

Other

Other50th Annual Meeting of the Association for Computational Linguistics, ACL - 2012
CountryKorea, Republic of
CityJeju Island
Period8/07/1214/07/12

Cite this

Johnson, M., Demuth, K., & Frank, M. (2012). Exploiting social information in grounded language learning via grammatical reductions. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL 2012 (Vol. 1, pp. 883-891). Stroudsburg, PA: Association for Computational Linguistics (ACL).
Johnson, Mark ; Demuth, Katherine ; Frank, Michael. / Exploiting social information in grounded language learning via grammatical reductions. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL 2012. Vol. 1 Stroudsburg, PA : Association for Computational Linguistics (ACL), 2012. pp. 883-891
@inproceedings{fab485dffbd343e3bba9daf9d47d3246,
title = "Exploiting social information in grounded language learning via grammatical reductions",
abstract = "This paper uses an unsupervised model of grounded language acquisition to study the role that social cues play in language acquisition. The input to the model consists of (orthographically transcribed) child-directed utterances accompanied by the set of objects present in the non-linguistic context. Each object is annotated by social cues, indicating e.g., whether the caregiver is looking at or touching the object. We show how to model the task of inferring which objects are being talked about (and which words refer to which objects) as standard grammatical inference, and describe PCFG-based unigram models and adaptor grammar-based collocation models for the task. Exploiting social cues improves the performance of all models. Our models learn the relative importance of each social cue jointly with word-object mappings and collocation structure, consistent with the idea that children could discover the importance of particular social information sources during word learning.",
author = "Mark Johnson and Katherine Demuth and Michael Frank",
year = "2012",
language = "English",
isbn = "9781937284244",
volume = "1",
pages = "883--891",
booktitle = "Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL 2012",
publisher = "Association for Computational Linguistics (ACL)",

}

Johnson, M, Demuth, K & Frank, M 2012, Exploiting social information in grounded language learning via grammatical reductions. in Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL 2012. vol. 1, Association for Computational Linguistics (ACL), Stroudsburg, PA, pp. 883-891, 50th Annual Meeting of the Association for Computational Linguistics, ACL - 2012, Jeju Island, Korea, Republic of, 8/07/12.

Exploiting social information in grounded language learning via grammatical reductions. / Johnson, Mark; Demuth, Katherine; Frank, Michael.

Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL 2012. Vol. 1 Stroudsburg, PA : Association for Computational Linguistics (ACL), 2012. p. 883-891.

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionResearchpeer-review

TY - GEN

T1 - Exploiting social information in grounded language learning via grammatical reductions

AU - Johnson, Mark

AU - Demuth, Katherine

AU - Frank, Michael

PY - 2012

Y1 - 2012

N2 - This paper uses an unsupervised model of grounded language acquisition to study the role that social cues play in language acquisition. The input to the model consists of (orthographically transcribed) child-directed utterances accompanied by the set of objects present in the non-linguistic context. Each object is annotated by social cues, indicating e.g., whether the caregiver is looking at or touching the object. We show how to model the task of inferring which objects are being talked about (and which words refer to which objects) as standard grammatical inference, and describe PCFG-based unigram models and adaptor grammar-based collocation models for the task. Exploiting social cues improves the performance of all models. Our models learn the relative importance of each social cue jointly with word-object mappings and collocation structure, consistent with the idea that children could discover the importance of particular social information sources during word learning.

AB - This paper uses an unsupervised model of grounded language acquisition to study the role that social cues play in language acquisition. The input to the model consists of (orthographically transcribed) child-directed utterances accompanied by the set of objects present in the non-linguistic context. Each object is annotated by social cues, indicating e.g., whether the caregiver is looking at or touching the object. We show how to model the task of inferring which objects are being talked about (and which words refer to which objects) as standard grammatical inference, and describe PCFG-based unigram models and adaptor grammar-based collocation models for the task. Exploiting social cues improves the performance of all models. Our models learn the relative importance of each social cue jointly with word-object mappings and collocation structure, consistent with the idea that children could discover the importance of particular social information sources during word learning.

UR - http://www.scopus.com/inward/record.url?scp=84878213416&partnerID=8YFLogxK

M3 - Conference proceeding contribution

SN - 9781937284244

VL - 1

SP - 883

EP - 891

BT - Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL 2012

PB - Association for Computational Linguistics (ACL)

CY - Stroudsburg, PA

ER -

Johnson M, Demuth K, Frank M. Exploiting social information in grounded language learning via grammatical reductions. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL 2012. Vol. 1. Stroudsburg, PA: Association for Computational Linguistics (ACL). 2012. p. 883-891