Show simple item record

dc.contributor.advisorNg, Vincent
dc.creatorPersing, Isaac Thomas
dc.date.accessioned2018-05-31T17:54:49Z
dc.date.available2018-05-31T17:54:49Z
dc.date.created2017-05
dc.date.issued2017-05
dc.date.submittedMay 2017
dc.identifier.urihttp://hdl.handle.net/10735.1/5781
dc.description.abstractAutomated essay analysis is one of the most important educational applications of natural language processing. The practical value of automated essay analysis systems is that they can perform essay analysis tasks faster, more cheaply, and more consistently than a human can, and can be made available for student use at any time. For example, a human teacher may spend hours grading a class's essay assignments, and due to issues like fatigue may not grade the last essay with as much care as the first. An automated essay analysis system, by contrast, can grade a stack of essays in seconds, and can be guaranteed to grade the last essay as carefully as the first. Unfortunately, automated essay analysis is complicated by the fact that essay analysis tasks often require a deep understanding of essay text, so designing accurate automated essay analysis systems is not a trivial task. For example, we can't judge how well an essay is organized from just the words it contains. Instead, we must often develop task-specific features in order to help a computer make sense of it. This dissertation focuses on advancing the state-of-the-art in automated essay analysis. Specifically, we define and present new computational approaches to seven different essay analysis tasks, namely 1) scoring how well an essay is organized, 2) scoring the clarity of its thesis, 3) detecting which errors it makes that hinder its thesis's clarity, 4) scoring how well it adheres to the prompt it was written in response to, 5) scoring its argument's quality, 6) detecting the stance its author takes on a given topic, and 7) detecting the structure of the argument it makes. For each of these tasks, our approach significantly outperforms competing approaches in an evaluation on student essays annotated for the task. To stimulate future work on automated essay analysis, we make the annotations we produced for these tasks publicly available.
dc.format.mimetypeapplication/pdf
dc.language.isoen
dc.rights©2017 The Author. Digital access to this material is made possible by the Eugene McDermott Library. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author.
dc.subjectNatural language processing (Computer science)
dc.subjectEssay
dc.subjectGrading and marking (Students)
dc.titleAutomated Essay Analysis
dc.typeDissertation
dc.date.updated2018-05-31T17:54:49Z
dc.type.materialtext
dc.contributor.ORCID0000-0001-8706-6237 (Persing, IT)
thesis.degree.grantorThe University of Texas at Dallas
thesis.degree.departmentComputer Science
thesis.degree.levelDoctoral
thesis.degree.namePHD


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record