← Back to blog

2026-02-05 • Research • Eu En

Why AI marking still needs human oversight

The promise and the failure modes

Modern language models evaluate student writing with remarkable speed. But accuracy on clean benchmark datasets does not translate directly to classroom reliability. Even top-tier models occasionally hallucinate: they will confidently tell a student that an answer is wrong when the student's reasoning was completely sound.

Because automated grading can fail in subtle ways, Ren is built on a non-negotiable principle: teachers review, edit, and approve every suggested mark and comment before a student ever sees it.

Common failure modes in automated grading

After analyzing thousands of student scripts, we found three recurring issues in unsupervised model outputs:

Context blindness

A language model has no memory of what happened in class on Tuesday. If a student uses idiosyncratic terminology that the teacher introduced during a lecture, a raw model will often penalise the phrasing even though the underlying scientific concept is correct.

Criteria drift

Without explicit grounding in an uploaded rubric, models fall back on generic training data conventions. In subjects like English Literature or History, where different examination boards demand completely different analytical structures, ungrounded models routinely dock marks for stylistic choices that the specific exam board actually encourages.

Uncalibrated confidence

Models rarely admit uncertainty. A language model outputs an incorrect grade in the exact same assertive, authoritative tone as a correct one. That surface fluency is dangerous for busy teachers scanning dozens of papers in a hurry.

Designing for teacher oversight

Ren positions AI as an assistive drafting engine rather than an autonomous grading authority:

  • Drafts by default. Every suggested mark, comment, and tag appears as an editable draft.
  • Granular control. Teachers can approve, rewrite, or dismiss individual comments with a single keystroke.
  • Transparent rubric grounding. For structured questions, Ren highlights the exact line of the answer scheme that justified each point deduction.
The goal is not to automate away teacher judgment, but to eliminate the blank-page fatigue of grading thirty essays from scratch.

Does reviewing feedback add more work?

Teachers often ask a valid question: if every suggestion requires manual review, does AI actually save time, or does it just move the bottleneck around?

The software engineering industry faced the exact same question with AI coding tools. Anthropic's research on developer productivity found substantial time savings on writing code and documentation, while noting that the human effort shifted toward review, verification, and debugging.

Software tools did not eliminate the need for engineering judgment. They changed the developer's role from writing boilerplate to curating and testing solutions.

The same transition in education

When a teacher marks thirty long-form essays by hand, most of their evening goes toward mechanical labor: reading handwriting, searching the mark scheme for matching keywords, and writing "explain how this evidence links to your thesis" for the tenth time. The high-value work, like spotting class-wide misconceptions, tailoring guidance for struggling students, and planning follow-up lessons, gets crammed into whatever mental energy remains.

AI drafting flips that dynamic. Ren generates a structured, rubric-aligned first draft in seconds. The teacher's time shifts entirely to curation, refinement, and pedagogical follow-up.

Measuring the time difference

We tested this workflow with a partner school. One teacher divided 30 student essays into two equivalent batches of 15:

  • With Ren. The engine generated drafts in 9 minutes and 32 seconds. The teacher then reviewed and finalized each script in 2 minutes and 52 seconds on average. Total time was 52 minutes and 32 seconds.
  • Without Ren. The teacher marked from scratch at an average of 10 minutes and 23 seconds per script. Total time was 155 minutes and 45 seconds.

The review workflow cut total grading time by more than 65%, while ensuring every single comment received human verification.

Building better verification tools

We are continuing to invest in three core engineering priorities: improving calibration on subjective rubrics, hardening answer-scheme extraction, and building explainability features that show teachers exactly why the model suggested a mark.


If you want to see our review interface in action, reach out to schedule a live demo.