ANA mathematics results over three years. Note that experts say year-to-year results are not comparable.
29 September 2015
South Africa’s major teacher unions and the Department of Basic Education agree: standardized testing can be a useful tool to measure the progress and gaps in a country’s education. But they don’t agree on the current format of the tests.
Launched in 2011, the annual national assessments (ANAs) were designed to measure and track the literacy and numeracy skills of learners in grades 1 to 9—with the intention to diagnose areas of weakness and provide the Department of Basic Education (DBE) and teachers with insights that can be used to craft remedial interventions.
But the teacher unions say the ANAs are not achieving their intended purpose: measuring the health of the education system and assessing whether there’s an improvement from year-to-year.
This is why five teacher unions have vowed not to administer the tests this year, scheduled for 1 to 4 December— a date set by the DBE without consulting teacher unions. The DBE, on the other hand, maintains that the tests will go ahead as planned.
GroundUp asked two academic experts and a leader of a teacher union to share their views on how they think the ANAs could be remodeled.
Dr Nick Taylor, Research Fellow at JET Education Services, is one of South Africa’s foremost education experts. Taylor argues that for the ANAs to be an effective mechanism to track progress in the country’s education system, they need to be administered independently. The ANAs currently face a legitimacy problem: they are set, marked and reported on by the DBE.
Taylor suggests that an independent agency — working with the DBE — could help design, administer and report on the results. This would lessen the administration burden on the teachers to conduct the tests, and would also help promote the integrity and independence of the testing process.
“Not only will this provide for a more reliable measure of how the system is doing, but will also increase public confidence in the results. The last two ANA reports stated that scores are not comparable from year to year, but nevertheless claim to have achieved major gains,” says Taylor. “These contradictions seriously undermine the integrity of the results in the eyes of the expert community and the public in general.”
Taylor is also convinced that not all learners in the country, from grades 1 to 9, need to take the tests. He suggests a national sample of schools—that is representative—that will help to drastically reduce the costs of the tests.
Based at Rhodes University, Professor Mellony Graven chairs the South African Numeracy Project, a research initiative aimed at improving mathematics education in the country.
While the DBE reported an improvement in the national average mathematics results in 2014 for grades 1 to 5, it was the grade 9 results that were a shocker. In 2014, the national average for grade 9 mathematics results registered 11% — the lowest since the tests were first introduced.
*Note: Results for grades 7 and 8 were excluded from the DBE’s report
In its report on the 2014 ANA results, the DBE acknowledged that the performance in mathematics at grade 9 level had dropped in almost all districts in the country.
Graven says that the ANAs in their current form are not detailed enough to help teachers and the department craft remedial interventions that will help learners struggling with mathematics.
“A national average of 11% for grade 9 mathematics is not helpful to teachers or learners. The ANAs should be designed to point out the level at which teachers need to begin remediation work with learners. The current ANAs only assess at the particular grade level focusing on curriculum coverage at that grade level whereas I think they would be more useful as a diagnostic assessment indicating the levels (from previous grades) that learners are operating at,” said Graven.
Basil Manuel is president of the National Professional Teachers Association of South Africa (NAPTOSA), one of the five unions that have come out strongly against the current format of the tests.
Manuel suggests that the tests could be written at the exit points of the various phases in South Africa’s education system — grades 3, 6 and 9 — as opposed to grades 1 to 9.
One of the limitations of the ANAs currently, according to Manuel, is that they don’t track the progress of the learners over time. Learners move from one grade to another, writing the tests each year, without their cumulative knowledge being assessed properly.
“You cannot measure progress of the education system if the learner’s progress is not tracked over time,” says Manuel.
Manuel gives the following example:
“If you’re testing a 10-year old in Maths, who is in grade 3 this year, you would ask her to do a long-division with a 3-digit sum for his year’s test. The following year, when she is in grade 4, you would then proceed to ask her to do a long-division sum with 4-digits to track her grasp of the concept with an added layer of complexity. This will help indicate whether she’s progressed or not over the past year.”
See also Minister wants meeting to break ANA deadlock.
Correction: The article originally stated that Nick Taylor is the CEO of NEEDU. This was a previous occupation. The article now correctly states his occupation.