NLI shared task 2013: MQ submission

Shervin Malmasi, Sze-Meng Jojo Wong, Mark Dras

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review


Our submission for this NLI shared task used for the most part standard features found in recent work. Our focus was instead on two other aspects of our system: at a high level, on possible ways of constructing ensembles of multiple classifiers; and at a low level, on the granularity of part-of-speech tags used as features. We found that the choice of ensemble combination method did not lead to much difference in results, although exploiting the varying behaviours of linear versus logistic regression SVM classifiers could be promising in future work; but part-of-speech tagsets showed noticeable differences. We also note that the overall architecture, with its feature set and ensemble approach, had an accuracy of 83.1% on the test set when trained on both the training data and development data supplied, close to the best result of the task. This suggests that basically throwing together all the features of previous work will achieve roughly the state of the art.
Original languageEnglish
Title of host publicationProceedings of the eighth workshop on innovative use of NLP for building educational applications (BEA-8)
Place of PublicationRochester, N.Y.
PublisherDepartment of Computer Science, University of Rochester
Number of pages10
Publication statusPublished - 2013
EventWorkshop on innovative use of NLP for building educational applications (8th : 2013) - Atlanta, Georgia, USA
Duration: 13 Jun 201313 Jun 2013


WorkshopWorkshop on innovative use of NLP for building educational applications (8th : 2013)
CityAtlanta, Georgia, USA


Dive into the research topics of 'NLI shared task 2013: MQ submission'. Together they form a unique fingerprint.

Cite this