Reasonable Doubt About Readiness: Lessons from Using MarkGPT (a custom GPT) to Grade and Provide Feedback on Law Assessments

Sneddon, S. (2026) Reasonable Doubt About Readiness: Lessons from Using MarkGPT (a custom GPT) to Grade and Provide Feedback on Law Assessments. The Law Teacher. 0306-9400.

Texts
Information

[A][B][+][-]

21171:66360

[A][B][+][-]

21171:66360

[thumbnail of Sneddon_2026_Reasonable_Doubt_About_Readiness_Lessons_from_Using_MarkGPT_(a_custom_GPT)_to_Grade_and_Provide_Feedback_on_Law_Assessments]

Sneddon_2026_Reasonable_Doubt_About_Readiness_Lessons_from_Using_MarkGPT_(a_custom_GPT)_to_Grade_and_Provide_Feedback_on_Law_Assessments
Sneddon_2026_Reasonable_Doubt_About_Readiness_Lessons_from_Using_MarkGPT_a_custom_GPT_to_Grade_and_Provide_Feedback_on_Law_Assessments.pdf - Published Version
Available under License Creative Commons Attribution.

Information

Abstract:

The emergence of Open AI’s ChatGPT in late 2022 triggered considerable debate among academics both within Law Schools and more widely across Higher Education. Initially, debate focused on students’ use of ChatGPT, and later iterations of Generative AI (GenAI), in creating their academic work. Fears of cheating were rife and, to some extent, have proven well-grounded. However, part of the discussion moved to academic use of GenAI, and one element of this was its use to grade student work and provide feedback. For some, Generative AI has potential to be quicker and unbiased, and for others, GenAI marking is part of the insidious creep of the technology, risking academic redundancies. This article emerges from the MarkGPT project, which used ChatGPT to grade and feedback on student work which had been completed the previous year. The project compared the GenAI marking and feedback with the moderated grades from the module teams, and independent third markers. The project concludes that, as of Summer 2025, ChatGPT lacks the capacity for consistency (with itself, and with human markers), and accuracy in grading, but that a thematic analysis of the feedback showed significant similarities with the human markers. ChatGPT then, is not quite there. Yet.

Additional Information:

Full ethical approval was obtained for both phases of this project from the University of Northampton Ethics Committee. Phase 1 (ETH2425-0109) on 1 January 2025, and Phase 2 (ETH2425-0135) on 24 April 2025.

Uncontrolled Keywords:

ChatGPT, Artificial intelligence, feedback, marking

Creators:

Sneddon, S.

Faculties, Divisions and Institutes:

Faculties > Faculty of Business & Law > Law

Date:

29 July 2026

Date Type:

Publication

Journal or Publication Title:

The Law Teacher

Number of Pages:

Language:

English

ISSN:

0306-9400

Status:

Published / Disseminated

Refereed:

Yes