Skip to main navigation Skip to search Skip to main content

RATAS: a GenAI approach for explainable and scalable automated answer grading

Masoud Safilian*, Amin Beheshti*, Stephen Elbourn

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

Automated answer grading is a critical challenge in educational technology, with the potential to streamline assessment processes, ensure grading consistency, and provide timely feedback to students. However, existing approaches are often constrained to specific exam formats, lack interpretability in score assignment, and struggle with real-world applicability across diverse subjects and assessment types. To address these limitations, we introduce RATAS (Rubric Automated Tree-based Answer Scoring), a novel framework that leverages state-of-the-art generative AI models for rubric-based grading of textual responses. RATAS is designed to support a wide range of grading rubrics, enable subject-agnostic evaluation, and generate structured, explainable rationales for assigned scores. We formalize the automatic grading task through a mathematical framework tailored to rubric-based assessment and present an architecture capable of handling complex, real-world exam structures. To rigorously evaluate our approach, we construct a unique, contextualized dataset derived from real-world project-based courses, encompassing diverse response formats and varying levels of complexity. Empirical results demonstrate that RATAS achieves high reliability and accuracy in automated grading while providing interpretable feedback that enhances transparency for both students and instructors. To advance research in this domain, we publicly release all code on https://github.com/datalab912/RATASv1.

Original languageEnglish
Title of host publicationThe 17th International Conference on Education Technology and Computers (ICETC 2025)
Place of PublicationPiscataway, NJ
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages377-382
Number of pages6
ISBN (Electronic)9798331597917, 9798331597900
ISBN (Print)9798331597924
DOIs
Publication statusPublished - 2025
Event2025 17th International Conference on Education Technology and Computers, ICETC 2025 - Barcelona, Spain
Duration: 18 Sept 202521 Sept 2025

Conference

Conference2025 17th International Conference on Education Technology and Computers, ICETC 2025
Country/TerritorySpain
CityBarcelona
Period18/09/2521/09/25

Fingerprint

Dive into the research topics of 'RATAS: a GenAI approach for explainable and scalable automated answer grading'. Together they form a unique fingerprint.

Cite this