Where Does Fairness Come From in Assessment? A Moderator's Notes

Work in external moderation long enough and you develop an almost severe sensitivity to the word "fairness." A national examination ends up as a single mark in each child's file, one chance at further study. Before that mark falls, someone must stand guard over the standard — that is the moderator's job.

You audit the standard, not the answer

The core of external moderation is not to re-mark the teacher's scripts but to test whether the standard is being applied consistently. Does the same rubric, in different markers' hands, across different schools and provinces, drift? Does everyone read the full-mark line the same way? The question moderation answers is "does this assessment treat every candidate alike," not "how many marks should this student get."

Fairness is not a feeling. It is a procedure that can be re-checked, questioned and recorded.

Three tensions

• Standard vs. context. A rubric must be uniform enough to guarantee consistency, yet leave room for legitimate variety in good answers. Too rigid and it kills strong responses; too loose and the standard collapses.
• Reliability vs. validity. What is easy to measure reliably is not always the ability that matters; the ability that matters is often the hardest to measure stably. Assessment design forever trades between the two.
• Outcome vs. procedure. A mark that "looks reasonable" is, in fairness terms, fragile if the procedure that produced it is opaque and un-auditable.

Why it is worth the pedantry

Assessment deserves this pedantry because it does something very heavy on society's behalf: it allocates opportunity. A country's educational fairness settles, in large part, into these unglamorous rubrics, re-checks and records. Moderators mostly go unnamed — but it is exactly this dull work of standing guard over fairness that lets a transcript deserve the effort a student poured into it.