Discovering better ways to solve social problems

FSG Blogs

see all

Education & Youth Blog RSS

See more posts from the Education & Youth blog

The Case for Classroom Observations

Posted by: Alex Doty on 2/15/2012

A recent longitudinal study by economists at Harvard University and Columbia University shows strong teachers create outcomes extending beyond the classroom and into adulthood. Students with effective teachers are less likely to become pregnant as teenagers, are more likely to attend college, and earn more money as adults.

How does one identify an effective teacher? Many evaluations use student test scores and a predictive algorithm, attributing scores higher or lower than predicted to a specific teacher. While such “value-added” measures are a useful baseline, they are limited in their ability to identify why a teacher is effective or ineffective. Value-added measures are also controversial; many attributed last year’s scandal in Atlanta, where teachers and administrators changed student answers on standardized tests, to the district’s use of test data in teacher retention decisions.

A better approach
to identifying effective teachers has been found by the Measures of Effective Teaching (MET) Project, funded by the Bill and Melinda Gates Foundation. The MET Project has demonstrated a fairly intuitive result: a metric combining a teacher’s value-added data with classroom observations and student surveys is a more accurate indicator of teacher effectiveness than value-added data alone.

Classroom observations enhance evaluation accuracy, but also create logistical challenges. As the MET Project points out, observations need to be calibrated across schools and districts to ensure consistency. Observations informing human capital decisions need to be conducted over multiple days. Finally, budget pressures have led many schools and districts to reduce assistant principal positions and central office staff, limiting the number of administrators available to conduct classroom observations.

Despite the time and resources they require, classroom observations are a worthwhile investment. As demonstrated by the MET Project, observations enhance the completeness and accuracy of an evaluation. More importantly, they enable teachers to identify their strengths and areas for improvement while receiving real-time feedback from evaluators. Such real time feedback is correlated with strong school performance. Even as resources continue to become increasingly scarce, schools and districts should prioritize classroom observations because of their value in developing and evaluating teachers.

What problems do you see with classroom observations or teacher evaluation more broadly?

Teachers and administrators: have you experienced challenges related to classroom observations? If so, how did you overcome them?



Syndicate  
Rate:
Views: 458
Your Rating: 0.0   Average Rating: 4.5   Ratings: 1
Carol Meyer
Reply | Report
0 Points
The biggest challenge of classroom observations was highlighted in the MET report on page 27, "The task of developing conceptual understanding is complex, and these results suggest that as the teaching tasks grew in complexity, it grew rare."

Ultimately, conceptual understanding should be our desired goal. It seems then, that in addition to value-added measure, observations, and student data, we should add an instructional design component. There needs to be two elements of effective design - information exchange and meaning making opportunities for students. Instructional design that focuses on both (with the assessment component including both) gives teachers a road map for interactions in the classroom.
    ►
Alex Doty
Reply | Report
0 Points
Carol,

Thanks for reading and for your comment.

I agree – instructional design is a critical component of effective teaching. Incorporating lesson and unit planning, effective use of interim assessments, and other elements of instructional design would make the MET Project’s metric more robust. I suspect instructional design was omitted from the MET Project’s metric for the sake of simplicity and repeatability.

The MET Project has created a great starting point for teacher evaluations. Schools and systems should adapt and build upon the MET Project’s work to develop evaluation systems reflecting their context and values.

Best,
Alex
Carol Meyer
Reply | Report
0 Points
Alex,
Your thinking makes sense about the omission of instructional design in the MET project, particularly in light of reliability issues. But alas, herein lies the rub, no?
If we are to create evaluation systems that are context sensitive, how are we going to think about the measurement of those systems? Is reliability important?

I would argue that reliable measures can be useful (the value-added data are certainly compelling) but that we are using them in the wrong ways, which is what gets us into trouble on the reliability front. We are using some of them as a measure of what counts as a good teacher rather than as evidence of what good teaching produces.

Kind regards,
Carol
    ►
Alex Doty
Reply | Report
0 Points
Carol,

One of the key messages of the MET Project’s work is that a metric encompassing the teaching process (as measured by observations and student surveys) and student outcomes (as measured by testing data) better represents a teacher’s true effectiveness than the test data alone. In essence, this shows that reliability increases, rather than decreases, when we go beyond value-added data in an evaluation.

You’re right in pointing out that subjective metrics have the potential to be applied inconsistently and may be influenced by biases that do not exist with value-added measures. Trained, experienced, and unbiased administrators and evaluators are necessary to generate accurate and reliable observation data.

Best,
Alex
       1       
Post Your Comment  
Comments are moderated and will be displayed after
approval.
 
* Name  
 (Your name will appear with your post.)
* Email  
 (Your email is required, but it will not be posted.)
* Comments:
* Enter the code shown above:

Follow Us:

Facebook Twitter YouTube LinkedIn RSS