What can we learn from John Hattie?

Ask not what works; instead ask: what works best?

 Image

‘Perhaps education’s equivalent to the search for the holy grail…’ (TES)

 

“It is my ambition to say in ten sentences what others say in a whole book.”

Friedrich Nietzsche, 1885

A casual glance through John Hattie’s CV shows just how prolific an educationalist he is. By 2007, he was on 8 editorial boards, including the British Journal of Educational Psychology, had written 12 books, supervised 168 PhD theses, published 546 papers, given over 700 public talks plus innumerable professional development sessions since 1989, and run workshops for thousands of teachers in thousands of schools.

Hattie has also collated the largest ever collection of evidence-based research in the educational world. In Visible Learning (2009), he drew on 800 meta-analyses, capturing 52,637 studies and providing 146,142 effect sizes about influence of education practices on academic achievement in school, encompassing about 236 million students in total (15). He includes a 54-page appendix on meta-analyses alone.

His next book, Maximising Impact on Learning (2012), the biggest ever research project on teaching, took the numbers to over 900 meta-analyses over 18 years. Hattie’s studies included a quarter of a billion children in his search for an evidence-based answer to the question: how do we maximise achievement in our schools? So, what does visible learning mean, and how do we put it into practice in the classroom?

One of the problems with Visible Learning is that to the extent that it serves up a massive slice of the vast evidence base, it correspondingly becomes less appetising and digestible, a bit like having far too much food on your plate. Ironically for an author whose main message is finding what works best, his books seem almost completely unworkable. At 378 and 286 pages long, which teacher has the time to slog through 660 pages of text?

To distil the evidence base, I take Nietzsche’s advice: to say in ten sentences what others have taken entire books to say. So I summarise John Hattie’s ideas in a few sets of ten sentences: in his own words; in ten of his most helpful checklist points for teachers; and then ten of the most useful classroom insights he calls ‘signposts’.

 Image

“Now you see it…”: the magic of direct instruction and feedback.

Ten sentences in his own words:

1. Would it not be wonderful if we could create a single continuum of achievement effects, and locate all possible influences of achievement on this continuum? (6)

2. Almost everything works. Ninety percent of all effect sizes in education are positive… setting the bar at zero is absurd. (15)

3. The major message is that we need a barometer of what works best, and such a barometer can also establish guidelines as to what is excellent. (ix)

4. A major purpose of this book is to generate a model of successful teaching and learning based on the many thousands of studies… it could be claimed that this is the epitome of evidence-based decision-making; but it is the story that is meant to be the most compelling contribution – it is my lens on the evidence. (237)

5. The major part of this story relates to the power of directed teaching, enhancing what happens next through feedback to inform the teacher of the success or failure of their teaching.

6. Visible teaching and learning is where the teacher and student both seek to ascertain whether and to what degree the challenging learning goal is attained, when there is deliberate practice aimed at the attaining mastery of the goal, when there is feedback given and sought. (22)

7. The story is about the power of passionate, accomplished teachers who focus on students’ cognitive engagement with the content of what it is they are teaching… monitoring, assessing and evaluating the progress in this task is what then leads to the power of feedback to students and from students.

8. Effective teaching occurs when the teacher decides the learning intentions and success criteria, makes them transparent to the students, demonstrates them by modelling, evaluates if they understand what they have been told by checking for understanding, and re-telling them what they have been told tying it all together with closure. (236)

9. Too often direct teaching is portrayed as bad, while constructivist teaching is considered to be good… This is almost directly opposite to the successful recipe for teaching and learning. (26)

10. These results show that guided instruction is much more effective than unguided, facilitative instruction… the rejection of direct instruction is a classic case of an immature profession, one that lacks a solid scientific base and has less respect for evidence than for opinion and ideology. (258)

Ten checklist points:

Effective teachers…

  • Use CPD to enhance their deeper understanding of their subject.
  • Use CPD to understand how to provide effective feedback.
  • Use backwards design from success criteria to learning intentions then activities and resources.
  • Provide multiple opportunities for practice.
  • Teach students how to practise deliberately and how to concentrate.
  • Teach students how to ask for, understand and use feedback.
  • Recognise the power of peer feedback, and deliberately teach students to give each other appropriate feedback.
  • Monitor the progress of students regularly throughout the year.
  • Use this for planning and evaluating.
  • Evaluate the impact of their teaching based on evidence of student progress, and strive continually to maximise their impact.

Takeaways for classroom instruction:

The most useful signposts are that teachers need to:

  • be directive.
  • clarify the learning intentions and success criteria of their lessons until they are explicitly understood by all students.
  • understand that students’ effort, not their interest level in the activity that is important.
  • be aware of what each student is thinking and knowing.
  • realise the amount and quality of feedback is vital to the learning process.
  • develop proficient knowledge and understanding of their content to provide meaningful feedback.
  • know how well they are attaining these criteria for all students.
  • know where to go next in light of the gap between students current knowledge and understanding and the success criteria.
  • take on board the major message of the research: know thy impact!

Image

“Why is a raven like a writing desk…?” The Mad Hatter’s riddle

Admittedly, capturing decades of research across millions of students in a blog post of a thousand words is far more subjective than objective. In any case, as Hattie points out, ‘evidence is never neutral’.  As Andrew Old remarks, ‘the trouble with Hattie is that, while his methodology is a bit dubious, nobody’s got a better one.’

 Image

Nevertheless, there are lessons to be learned from educationalists’ quest for the Holy Grail of what works best for academic achievement. One of the most sobering is this: in Hattie’s words, ‘the closer an innovation gets to the core of schooling, the less likely it is that it will influence teaching and learning on a large scale.’ In other words, despite Hattie’s best efforts, why aren’t we applying the success of direct instruction in teaching and teacher training? In education, just as the Holy Grail symbolises elusivity, success eludes visibility.

About these ads

About Joe Kirby

English teacher, education blogger
This entry was posted in System. Bookmark the permalink.

19 Responses to What can we learn from John Hattie?

  1. Pingback: Update: Diigo in Education group (weekly) | ChalkTech

  2. Your point about the difficulty in digesting Hattie is well made. Your selection of of quotes is artful and of course doesn’t tell the complete story. If you haven’t already, I’d heartily recommend his follow up, Visible Learning for Teachers. This one does a much better job of being useful for your average teacher and is, I think, more nuanced.

    And the reason we aren’t all using direct instruction? Because, I suspect, it doesn’t FEEL right. Wiliam has made a very good point in saying that if you attempt to force teachers to teach in a particular way, you end up de-skilling them. I’d be very careful of prescribing DI regardless. In the words of the late Sir John Gielgud, “You must find your own lights.”

  3. Pingback: Becoming a Better Teacher by ‘Deliberate Practice’ | huntingenglish

  4. Pingback: How does OFSTED help failing schools? | Tabula Rasa

  5. Pingback: How does OFSTED help failing schools?

  6. I agree, pretty much entirely. But it’s not only John Hattie, there is also Robert Marzano> But the best way is to combine the two any buy a copy of Geoff Petty’s ‘Evidence-based teaching’ There is a clue in the title I feel. But the subtitle is ‘a practical approach. And so it is. Not everything but it seems to me to be the best we have for guidance of education – and this applies to HE/FE (from where I’m coming) too. But few people in HE seem to have heard of this. ‘Nuff said for the moment.

  7. Pingback: What can we learn from Dylan Wiliam & AfL? | Pragmatic Education

  8. Pingback: What makes great teaching? | Pragmatic Education

  9. Pingback: Edssential » What can we learn from Dylan Wiliam and AFL

  10. Pingback: A guide to this blog | Pragmatic Education

  11. Pingback: Part 1(of 2) Great Learning: 3 qualities that separate the best from the rest.. | From the Sandpit....

  12. EC says:

    An clear and coherent summary, but I think we should be more skeptical of Hattie’s work than you seem to be. I read Visible Learning last year, and while I was initially excited, I ended up thinking that Hattie was basically incompetent. I wrote about the competence issues here:
    http://literacyinleafstrewn.blogspot.com/2012/12/can-we-trust-educational-research_20.html
    and the direct instruction issue here:
    http://literacyinleafstrewn.blogspot.com/2012/12/rappelling-and-reading-when-is-direct.html

  13. Pingback: #WorldSTE2013 Conference – Day 2: Peer instruction (E. Mazur) and Visible Learning (J.Hattie( « Learning Matters

  14. Pingback: A summary of ideas on this blog | Pragmatic Education

  15. Pingback: What happens when cognitive science meets visible learning? | Pragmatic Education

  16. Pingback: Why we shouldn’t close down the skills-knowledge debate | Pragmatic Education

  17. Pingback: How best to teach: knowledge-led or skills-led lessons? | Pragmatic Education

  18. Pingback: Books, bloggers & metablogs: The Blogosphere in 2013 | Pragmatic Education

  19. Pingback: The research-practice paradox | Pragmatic Education

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s