andallthat.co.uk
  • Blog
  • GCSE / A Level Topics
    • America 1789-1900
    • Antisemitism
    • British Radicalism 1789-1900
    • Crusades
    • Elizabeth I
    • Germany 1919-45
    • Historical Interpretations
    • Historic Environment
    • International Relations 1900-2000
    • Italian Renaissance
    • Medicine
    • Medieval Kings
    • Russia 1855-1921
    • Soviet Russia
    • Politics Files
  • KS3 Topics
    • Interpretations
    • Stand-Alone Lessons
    • NEW KS3 File Store
    • OLD KS3 File Store
    • Student Resources
  • Advice
    • GCSE Options
    • A Level Options
    • Personal Studies
    • University Applications >
      • Choosing Courses
      • General Advice
      • Personal Statements
      • Predicted Grades
  • Teachers
    • YHEP Teach Meet
    • Stand-Alone Lessons >
      • Ancient World
      • Medieval World
      • Early Modern
      • Industrial Revolution
      • Modern World
      • Post-Modern World
    • KS3 Teaching Resources
  • MeetTheHistorians
  • Trips
  • About
    • SubBlog
  • Contact

The World's Worst Speculators - Why exam appeals are not about striking gold

2/14/2014

1 Comment

 
Picture
For a brief moment, I genuinely thought that I might get through this week without reading anything too upsetting about education in the news. A few days ago, Mr Gove seemed to switch his attention to private schools, attacking them as 'islands of privilege'. Whilst yesterday the Secretary of State for Education was forced to back down on his plans to reform school teachers pay and conditions. The STRB enacted a full sweep of humiliating defeats against Mr Gove's plans to change everything from the school day to forced extra-curricular activities. 

Of course, this couldn't last too long. This morning I awoke to news which nearly had me choking on my cornflakes. The exams regulator Ofqual has apparently decided that the fact so many schools are sending exam scripts for re-marking is because we are all busy manipulating our A*-C pass rate. To quote the review paper specifically, Ofqual stated that “A high volume of enquiries about results are, we believe, motivated by a speculative attempt to improve results...” 

Now, I am going to leave aside the speculative nature of Ofqual's own interpretation of the exam re-marking figures here. I will also ignore Glenys Stacey's erroneous statement that schools have nothing to lose from re-marking but an "awful lot to gain" (I presume she is aware that marks can and do go down on a re-mark). What I am concerned about, is the fact that Ofqual are not looking closer to home to find the root cause of the increased numbers of re-marks being requested by schools. Stacey conjures up an image of schools carefully choosing how they might 'strike it rich' through a careful process of re-marking. Speculating on striking a seam of exam-success gold. What she ignores is that there is seldom any gold to be found. Ofqual's failure to regulate exam boards and exam marking properly means that these teacher-speculators are more likely to have the gold mine collapse on their heads than get rich quick. If teachers are speculating on exam re-marks, then we are probably the worst speculators in history. For the most part, this is not what teachers are hoping to find - exam appeals are about solid investment. Teachers want to know that the boards they have chosen are marking their students' work properly year on year. Without this basic trust, the whole system falls down. Ofqual need to recognise this and act.

So let's examine the evidence. Ofqual argues that the exam system was designed in a "more innocent era" and that schools today are deliberately trying to shift their students over those all-important grade boundaries. Grades they noted were changed on 54,380 GCSE and A Level papers last year after 301,267 enquiries. Now I am sure that in some cases, schools have been playing games with the system, and I know the accountability culture of modern education has made this ever more prevalent. But if you gave me unlimited money, I would put every single GCSE and A Level paper in for a second marking. Why? Because experience tells me that of all the papers I have put in for re-marking over the years, around 45% (yes, you read that correctly) of them have been wrongly marked. I simply don't trust the system. On average, the papers I have put in have seen a rise of around 5.5 marks in total - somewhere around 3/4 of a grade. If that was applied across the board, my A*-C passes would have had me running round in circles on the ceiling, cheering and drinking champagne!! If I focus only on the ones which were moved up, then the the average increase is around 10 marks, or well over a grade per student. In the most extreme cases, such as 2013, when I sent in a sample of 10 scripts, all ten went up by a minimum of 11 marks and some went up by 24. The paper total was 80! This is the scale of the problem we are dealing with. Had I not sent those papers in, a whole GCSE cohort would have received marks which were up to 3 grades below their real results. This represents a fundamental failure of Ofqual to properly regulate the marking of exam boards.
Picture
But this is not a problem limited to single years or single cohorts. Year after year, results fluctuate, despite a stable team of teachers and vast experience in a particular exam. This was particularly noticeable in my previous post as we taught 2 GCSE and 2 A Level courses, meaning that we had comparable results with a different content area. Students were taught the same exam technique with different content and the results were astronomically different. Many of these issues were of course rectified by sending in scripts to be re-marked. However, a happy ending has not always been the result of my enquiries. One year, in the dying days of the OCR History Pilot, a number of our brightest (now Oxbridge) students failed to attain even B or C grade passes on their externally assessed units for reasons which I cannot fathom even to this day. 

Similar issues have occurred in the past at A Level, where re-marked papers were sent back with increases of 10-15%. The problem here is of a very different nature however. As so few students are willing to risk their A Level grades, I was never been able to secure a whole cohort re-mark, despite the increases being well over the board's own 5% threshold.This highlights another aspect of the system which Ofqual needs to address urgently. Namely, the appeals process in itself is flawed. For starters, my own anecdotal evidence suggests that markers given the task of dealing with enquiries about results are briefed not to move papers up unless it is absolutely necessary. This is made even worse by the fact that exam marking pay is linked essentially to how many papers you can mark in an hour. The best markers take their time to learn the content before they mark, but I am sure that doesn't happen in all situations. Exam boards seem to spend a great deal of time and money covering their own mistakes by pressuring their already poorly paid markers into rubber stamping previous decisions. This is made easier by the fact that markers are given access to the original mark, so the easiest thing for them to do is agree with the original decision, something which the HMC have been campaigning on for a while. At the most extreme end of this, exam boards are not even providing a second marker at all. In a sample of re-marks sent in for the GCSE OCR History Pilot, the original marker of my scripts was also the reviewing marker. Unsurprisingly he agreed with his original judgments. Why has Ofqual allowed this to go unchallenged?

Picture
The final aspect of this issue comes down to pure cost. Exam boards now charge upwards of £40 to have a script re-marked. Although this is refunded if the script is marked incorrectly, the prohibitively high price means that students, especially those from poorer backgrounds, are put off having a paper re-marked, and teachers are put in a very difficult situation of having to recommend a re-mark or otherwise. Even if the school decides to pay the bill, this still favours more affluent schools who have the money to spend on this service, notably independent schools.The exam boards certainly do not pay their markers £40 per script for a re-mark, so this begs the question of where this money goes. 

Any appeal beyond this point goes into serious money, and very little chance of success. I am not sure I know of anyone who has managed to successfully challenge the outcome of an appeals process. Indeed, the whole process after EAR is completely opaque and it would take an incredibly supportive head to launch a full scale challenge against exam marking when the weight of evidence seems to rest on the side of the board. Teachers are therefore forced to conclude that they must have made mistakes. Conveniently, the boards also run a fairly lucrative sideline in advising schools on how to improve their performance through courses and training sessions. The access these give to exam board 'secrets' is another blog in itself, but just as a start, schools are often paying upwards of £300 for courses to tell them how teach exams which they may have been teaching correctly in the first instance.

These are all issues which Ofqual could and should investigate. At the moment however, it seems content to shift the blame onto schools for 'abusing' a system which is beyond broken. I have so little faith left in the examinations system in the UK that I feel each year becomes an increasing gamble. Every August is spent analysing student performance and looking for evidence of incompetence or poor quality control at the major exam boards. This has to stop! Until Ofqual deal with the exam boards directly and act to restore faith in the setting and marking of exams, schools will quite rightly attempt to get as many scripts as they can re-marked. This is the only way we can ensure we have some level of quality control in our marking. For my money, I will keep plugging away in support of the Queensland Assessment System, and hope that we really revolutionise examinations int the UK before they lose any of the credibility they once had.

1 Comment
Heather F
2/14/2014 01:38:03 pm

I am so angry at the way Ofqual have chosen to dismiss concerns over an exam system which is rotten. I have only read some sections of the report so far but am pretty disgusted.
As a teacher of history and politics I share all the concerns expressed in this blog. Especially in politics our papers have become totally unpredictable in their outcomes. I would LOVE to see ofqual publish a by subject breakdown of variation in grades for the same candidate between papers for the same subject.
I am an experienced examiner, so is my huband and my brother in law is high up in one exam board. I also know plenty of examiners. My experience as an examiner chimes exactly with mine as a teacher. I am so angry that ofqual blithely dismiss the view of an 'overwhelming' number of examiners that marking is weaker because of the loss of face to face standardisation. They feel that this view can be dismissed because of a few studies (for example conducted by AQA) when they admit themselves that there is very little research. They then suggest a survey that asked markers a question that could be interpreted as meaning something entirely different suggests that overwhelming number of examiners didn't really know their own mind. They then top it off by suggesting that that overwhelming view of teachers can be dismissed because any opinions expressed would be unreliable anyway. One wonders why they ever bothered to ask the examiners in the first place!
Apologies for typos - it is really difficult to edit this comment, it isn't just my anger!

Reply



Leave a Reply.

    Tweets by @AndAllThatWeb

    Archives

    March 2019
    February 2019
    January 2019
    August 2018
    July 2018
    January 2018
    December 2017
    June 2017
    May 2017
    February 2017
    January 2017
    November 2016
    October 2016
    September 2016
    July 2016
    June 2016
    May 2016
    April 2016
    March 2016
    February 2016
    January 2016
    November 2015
    October 2015
    August 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    January 2015
    November 2014
    October 2014
    June 2014
    May 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    July 2013
    June 2013
    April 2013
    February 2013
    December 2012
    October 2012
    September 2012
    July 2012
    June 2012
    April 2012
    March 2012
    March 2011
    February 2011
    June 2000

    Categories

    All
    2014 KS3 Curriculum
    Book Review
    BUSK Reading
    Christmas
    Comment
    History Ancient
    History C19th
    History C20th
    History Early Modern
    History Medieval
    History Thematic
    PGCE
    Rant
    Teachers Assessment
    Teachers Case Study
    Teachers Classroom Management
    Teachers Concepts
    Teachers Conference Notes
    Teachers Curriculum
    Teachers Exams
    Teachers Frideas
    Teachers Government
    Teachers Leadership
    Teachers Misc
    Teachers NQT
    Teachers Pedagogy
    Teachers Planning
    Teachers Progression
    Teachers Purpose
    Teachers Stand Alone Lessons
    Teachers Technology
    Teachers Training
    Teachers Trips
    Teaching Personnel
    Tvfilm Reviews79f7bb4075

    RSS Feed

Powered by Create your own unique website with customizable templates.