The first in a two-part series on AERO and evidence. Tomorrow: Evidence is important, but what is the problem?
The Federal Government has now ordered an independent performance evaluation of AERO, conducted by KPMG. You can provide feedback here.
There have been debates about whether teaching is an “evidence-based” profession, or whether it should be.
The discourse around evidence-based teaching and learning has been dominated by “effectiveness research”. That’s driven by a neoliberal obsession with metrics, the most convenient metrics being standardised test scores like NAPLAN and PISA.
Declining scores on these tests is most often attributed to poor teaching. Specifically, the blame is attributed to the quality of teachers graduating from university initial teacher education (ITE) programs. Part of the Australian Government’s solution to this perceived problem is to increase oversight of ITE programs in universities. This has led to the introduction of highly prescriptive “Core Content” for ITE programs from the Strong Beginnings report, and further surveillance of ITE through a new Quality Assurance Board (to regulate the regulators).
The Core Content mandates teaching strategies and approaches that are “shown by research” or “proven” to be effective.
The evidence for these assertions comes from the Australian Educational Research Organisation (AERO). AERO was established as part of the Gonski 2.0 reforms, as a national evidence body. It was intended to “conduct research and share knowledge to promote better educational outcomes for Australian children and young people”. AERO publishes a range of resources, including “Explainers”, intended to provide advice to teachers about evidence-based practice. But is this evidence-based practice, or a new avenue for governments to further intrude into the classroom?
Should teachers trust AERO to interpret the evidence for them?
As Nicole Mockler and Meghan Stacey explain, it’s hard to argue against ‘evidence-based practice’ but the devil is in the detail. Evidence-based practice as it is understood in medicine, is a far cry from evidence-based practice as it’s currently understood in teaching. Evidence-based medicine was conceived as a reflective practice grounded in individual judgement by the medical practitioner, considering systematic research evidence, their own expertise and the patient’s needs. It emerged from the medical professions in the 1990s and was pioneered by David Sackett, It has since evolved beyond Sackett’s original vision, extended to balance the patient’s values and preferences, the clinical context, the practitioner’s expertise and research evidence.
Evidence-based teaching has been driven by policy mechanisms, promoting models of evidence use that emphasise generalisability and scalability. It reduces teaching to a set of formulaic strategies. The evidence and resources presented by AERO appear to position teachers as incapable of understanding and interpreting research, then making professional judgments based on their students and the school content. AEROpresents the research as if it was black and white– “proven”, incontestable facts. The evidence is presented as an instruction manual, with no space for professional judgments or critique.
Education researchers know this is very rarely the case. Let’s look atAERO’s explainer on Managing cognitive load. Drawing primarily on Sweller’s cognitive load theory, the explainer proposes that explicit or direct instruction helps to avoid students experiencing cognitive overload. This can occur when too much new information is presented at once. It can also occur when previously taught knowledge is not regularly revisited.
Arguments and counter-arguments
There is significant evidence to support the educational psychology of cognitive load theory. But there are also counter-arguments. Sweller argues that unguided learning “does not work”. But others provide evidence that problem-based and inquiry learning can be effective, and that contextual factors must inform pedagogical choices. When we consider these perspectives on the research, we begin to see the selective approach to research on which AERO has built its “evidence base”.
This is not just a concern for practising teachers. It is a concern for the entire educational enterprise. Critical thinking is identified as a crucial skill for the 21st Century. It drives innovation and preparing students for a world we can’t yet imagine.
The Australian Government promotes the importance of critical thinking. But at the same time, AERO recommends strengthening evidence-based practice through highly prescriptive approaches to teaching. It mirrors the same top-down, narrow interpretation of ‘what works’ that characterises AERO’s materials.
The government asks no questions of AERO’s research
The Australian government appears to be not engaging in any critical thinking, taking AERO’s research explainers at their word. An example of this is the full acceptance of the Strong Beginnings recommendations, including the swift implementation of the Core Content for ITE programs.
Content from the Managing cognitive load explainer dominates Core Content areas 1 and 2 from Strong Beginnings, with all ITE programs expected to teach their students:
1.2.3 The most effective teaching practices to reduce cognitive overload, including explicit instruction, scaffolding, and clearly structured content that connects new information to prior learning.
2.2.3 The importance of presenting all information required to complete these chunked tasks in one place and at one time, excluding information not directly related to the task, to reduce cognitive overload.
2.2.6 Why independent problem-solving is only effective once a student approaches proficiency (i.e. after ample opportunities to practise progressively challenging tasks) and why independent problem-solving should not represent a large proportion of teaching and learning time.
(Australian Institute for Teaching and School Leadership, 2023)
There is no nuance in this policy language. It tells teachers what is effective and what is not. AERO presented the research as black and white, and now the policy does the same.
Evidenced based teaching is only as good as the evidence itself
Under the present evidence-based regime in education we have lost any consensus on what evidence-based practice even means. Some suggest that evidence-based practice is oppressive, that it is in opposition to good education, leading to pre-determining of teaching practices with no regard for local context.
Others suggest that the problem is narrow definitions of what counts as evidence, and that evidence-informed policy and practice are vital to the profession. The version of evidence-based practice promoted by AERO reduces evidence to prescription, positioning teachers as technicians. This is not what David Sackett envisaged when he first articulated evidence-based medicine: that professionals make decisions in uncertain, complex, and relational contexts by drawing on research,experience, and the needs of those they serve.
Can teachers trust AERO’s evidence?
So, can teachers trust AERO’s evidence? Maybe they could if trust meant more than compliance. But perhaps the bigger question is why doesn’t AERO trust teachers? What if AERO treated teachers not as technicians, but as thinking professionals in relationship with their students. Maybe AERO needs an “explainer”?
Rachael Dwyer is a lecturer in curriculum and pedagogy at the University of the Sunshine Coast. Her scholarship is focused on creating social change, through decolonizing, arts-based approaches to teaching, advocacy and research. James Humberstone is a senior lecturer in music education at the Sydney Conservatorium of Music, The University of Sydney. He specialises in teaching music pedagogies, technology in music education, and musical creativities. Brad Fuller is an educator and researcher with over 35 years of experience in music education and curriculum innovation. He is associate lecturer in music education at the Sydney Conservatorium of Music, University of Sydney.
This article was originally published on EduResearch Matters. Read the original article.
