Student translations of natural language into logic: the grade grinder corpus release 1.0

Dave Barker-Plummer*, Richard Cox, Robert Dale

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

6 Citations (Scopus)

Abstract

Students find logic hard. In particular, they seem to find it hard to translate natural language sentences into their corresponding representations in logic. As an enabling step towards determining why this is the case, this paper presents the public release of a corpus of over 4.5 million translations of natural language (nl) sentences into first-order logic (fol), provided by 55,000 students from almost 50 countries over a period of 10 years. The translations, provided by the students as fol renderings of a collection of 275 nl sentences, were automatically graded by an online assessment tool, the Grade Grinder. More than 604,000 are in error, exemplifying a wide range of misunderstandings and confusions that students struggle with. The corpus thus provides a rich source of data for discovering how students learn logical concepts and for correlating error patterns with linguistic features. We describe the structure and content of the corpus in some detail, and discuss a range of potentially fruitful lines of enquiry. Our hope is that educational data mining of the corpus will lead to improved logic curricula and teaching practice.

Original languageEnglish
Title of host publicationEDM 2011 - Proceedings of the 4th International Conference on Educational Data Mining
EditorsMykola Pechenizkiy, Toon Calders, Cristina Conati, Sebastián Ventura, Cristóbal Romero, John C. Stamper
Place of PublicationEindhoven, The Netherlands
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages51-60
Number of pages10
ISBN (Print)9789038625379
Publication statusPublished - 2011
Event4th International Conference on Educational Data Mining, EDM 2011 - Eindhoven, Netherlands
Duration: 6 Jul 20118 Jul 2011

Other

Other4th International Conference on Educational Data Mining, EDM 2011
CountryNetherlands
CityEindhoven
Period6/07/118/07/11

Fingerprint

Dive into the research topics of 'Student translations of natural language into logic: the grade grinder corpus release 1.0'. Together they form a unique fingerprint.

Cite this