IRMA-International.org: Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

Can ChatGPT Grade Non-Native Academic English Writing?

Can ChatGPT Grade Non-Native Academic English Writing?
View Sample PDF
Author(s): Veronika Makarova (University of Saskatchewan, Canada), Zhi Li (University of Saskatchewan, Canada)and Zhengxiang Wang (Stony Brook University, USA)
Copyright: 2024
Pages: 20
Source title: AI Approaches to Literacy in Higher Education
Source Author(s)/Editor(s): Oscar Oliver Eybers (University of Pretoria, South Africa)and Alan Muller (University of Pretoria, South Africa)
DOI: 10.4018/979-8-3693-1054-0.ch005

Purchase

View Can ChatGPT Grade Non-Native Academic English Writing? on the publisher's website for pricing and purchasing information.

Abstract

This chapter reports the results of a pilot study investigating the potential of ChatGPT to assess (or grade) texts produced by international graduate students whose mother tongue is other than English (IGS). The chapter overviews some suggested applications of ChatGPT to academic writing (AW) and particularly, for English as an additional language (EAL) contexts. Most works up to date consider ChatGPT applications for literacy and writing skills development. The authors compare evaluations of texts by ChatGPT vis-à-vis human experts. The texts employed for the study are short literature reviews written by IGS in Canadian universities. The results demonstrate some potential of ChatGPT for assessment. However, while ChatGPT provides mostly relevant scores and comments related to the assessment rubrics provided, the comments are not diversified and individualized enough. ChatGPT queries for assessment should be modified and the tool trained in diversifying comments to achieve better results.

Related Content

Frederic Andres. © 2027. 14 pages.
Kalsoom Safdar, Khairul Najmy Abdul Rani, Mohd Aminudin Jamlos, Siti Julia Rosli, Muhammad Usman Younus, Zanab Safdar. © 2027. 27 pages.
Bani Adam, Binastya Anggara Sekti, Muhammad Adi Zacky Zahran. © 2027. 24 pages.
Swetha Margaret T. A., Renuka Devi D.. © 2027. 31 pages.
Maurice Saluschke, Michael Schulz. © 2027. 30 pages.
Mirjam Sepesy Maučec, Gregor Donaj. © 2027. 16 pages.
Jorge A. Ruiz-Vanoye, Ocotlan Diaz-Parra, Ricardo A. Barrera-Cámara, Alejandro Fuentes-Penna, Francisco R. Trejo-Macotela, Jaime Aguilar-Ortiz, Eric Simancas-Acevedo. © 2027. 21 pages.
Body Bottom