Educator effectiveness

Educator effectiveness is a United States K-12 school system education policy initiative that measures the quality of an educator performance in terms of improving student learning. It describes a variety of methods, such as observations, student assessments, student work samples and examples of teacher work, that education leaders use to determine the effectiveness of a K-12 educator.

The drive for educator effectiveness programs stem from the Race to the Top program, where states were awarded points for meeting educational policies based on the teacher's effectiveness. This policy was the basis of the emergence of statewide educator effectiveness programs.

Educator effectiveness programs vary from state to state. Typically, an educator effectiveness program describes a cycle of observations and assessments that apply to different groups of teachers during an academic year. New teachers are evaluated more frequently, and veteran teachers are evaluated across multiple year cycles. Evaluated teachers have multiple scheduled classroom observations and conferences with the evaluator in addition to unannounced classroom observations. A controversial aspect of The purpose of evaluations is to help educators determine what is effective in their practices and provides them a medium to reflect upon and change their practice to help teachers become more effective.

Educator effectiveness is a method used in the K-12 school system that uses multiple measures of assessments including classroom observations, student work samples, assessment scores and teacher artifacts, to determine the impact a particular teacher has on student's learning outcomes. While schools have used teacher evaluation practices and policies for many years, the emergence of educator effectiveness policies combines these existing practices with rubrics and test scores to provide more robust perspectives on the work of teachers. Educator effectiveness initiatives often use descriptions of effective teaching practices, such as Charlotte Danielson's "Framework for Teaching", to organize teaching separate domains for assessment. Danielson's domains include: Planning and Preparation, Classroom Environment, Professional Responsibilities, and Instruction.

Teacher evaluations have changed over time and have had different standards across the United States. Evaluation systems often have been comprised an administrator observing a teacher a couple times per year. In some locations, teacher observations were only done on a three-year or longer cycle. In the past, a Widget Effect, as described by The New Teacher Project has been established that has developed a culture where all teachers feel as though they deserve the highest marks on evaluations. Schools used to see their job as filling positions and thought that any teacher who was given a license was high quality, and thus scored them according to that thought process. Therefore, all teachers were getting scores that were good or great and no variation was able to be determined between any two teachers.

Today, federal and state policies have encouraged school systems to design more comprehensive evaluation systems that rely on multiple measures of how a teacher performs by looking at items such as student performance gains, classroom observations, teacher reflections, content specific knowledge and student reflections. Some policy makers and researchers encourage the design of systems to identify and sort good and bad teachers; others are designed to provide meaningful feedback and professional development to teachers in order to enhance their skills.

Overall, the purpose of educator effectiveness is to build the capacity for teachers to enhance their skills. The effective teachers have an effect on student's ability to have a higher level of conceptual understanding of a topic and have displayed the ability to think more abstractly than peers taught by less effective teachers. Quality teaching also has been identified as a key influence for positive learning outcomes for the diverse body of students in the classroom.

As of 2013, US schools United States had very little cohesiveness in their teacher effectiveness requirements and implementations. In 2013, 25 states required that student achievement is a big or the biggest part of teacher evaluations. Twenty-seven states required teacher evaluations be based on a variety of student assessments and work samples and 44 states required classroom observations to be put into teacher evaluations. Overall, 11 states require a statewide teacher evaluation system; 10 states gave a statewide evaluation model that districts can either do or decide to do a similar model. To date only a small handful of states have adopted policies connecting the performance of students to their teachers and the colleges where the teachers were trained.^[1]

Many countries have national policies that decide what teacher evaluation systems that schools will have to follow. Some countries such as Denmark, Finland, Iceland, Norway and Sweden provide annual feedback on teaching practices. Other countries, such as Norway and Iceland, leave the decision about how the teacher evaluations systems will be done to be determined at a local level. The quality of teaching in these countries is compared to the curriculum they follow and with the school instructional plan. Finland does not use any standardized testing as a measure of teacher effectiveness. Singapore is another country that does not use test scores but rather focuses on how teachers work together as a main part of their evaluation system. Singapore also focuses heavily on professional development around evaluation, coaching, mentoring and collaborating with other educators with an overall goal of getting a high-quality teaching staff.^[2]

There is significant debate in the U.S. about how to reward teachers for performance as measured by educator effectiveness policies. Some schools rewards teachers by paying them more based upon their student's test scores, which is linked to the Race to the Top funding in the United States.^[3] However, other reward systems are being created based on the idea that improving a teacher's capacity to learn and improve upon their practice will have a direct impact on student achievement. These schools increase pay for teachers who have a National Board Certification using National Board for Professional Teaching Standards, advanced degrees, engaging in professional development, mentor new colleagues and paying more for these qualified teachers in hard to staff schools ^[4]

The connection of teacher effectiveness and merit pay varies in different countries. In Finland and Canada, they do not to use merit-pay approaches but encourage conversations between the evaluator and teacher about student progress and success. In contrast, Chinese and Singaporean teachers, get financial bonuses and promotions for high performance. High-performing countries have a strong system of professional and school-level accountability but look at success on things such as school improvement goals, professional contributions, and indicators of student well-being.^[5]

Most educator effectiveness programs rely two kinds of data: observations of teaching practices and student outcomes data. There are four main sources of observational data collected by schools:

1. Classroom observations happen when someone comes into a teacher's classroom to observe their teaching practice, typically done by a school administrator. The methods of commenting on teaching practice within classroom observations varies from district created to purchased evaluation forms.^[6]
2. Some schools use Self-Evaluation as a reflective tool for teachers to look at their current practice and change what they are doing to have a greater educational impact on students. Teachers often use a variety of tools to reflect and change their practice including self-monitoring, recording their own practice, and student's feedback through survey's and questionnaires.^[7]
3. Teacher Portfolios are used to compile a variety of evidence of teacher practices for the purpose of showing development of teaching over time. It is often used in conjunction with self-reflection or peer-reviewing of teaching practices.^[8]
4. Peer-Review of Teaching is a method for teaching to discuss their practice with another teacher or group of teachers that gives feedback about teaching and learning. Often an evaluation of the teaching materials is done with the purpose of providing feedback to change teaching practices.^[9]

The new part of educator effectiveness policies is the integration of outcome data into the evaluation process. The biggest component of the outcome data is growth of student learning as measured by standardized tests. Most educator effectiveness programs rely on some form of value-added measures to determine student growth. Value-added measure use longitudinal measures of student achievement to estimate the growth in student learning that can be attributed to individual teachers. If the students of a specific teacher demonstrate growth in learning better than predicated on standardized tests, the teacher is said to be effective; if the students score below the predicted scores, the teacher is said to be ineffective.^[10] Parent and student surveys are another method of collecting data on teachers and their educational practices.^[11]

Many argue that it is difficult to measure the effect that teachers have on student learning. Many teachers who are in the K-12 system, teach subjects that are not assessed on state mandated testing. In order to effectively implement an educator effectiveness system, some argue that states need to create different evaluation systems for the teachers who teach students in non-tested areas such as submitted portfolios of student work, lesson logs, video clips of them teaching and reflective commentaries on lessons.^[12]

Others argue about the methodology as some districts are using value added models to determine the effectiveness to teachers. They state that it is an unreliable measurement tool because the makeup of classes differ greatly from teacher to teacher and from year to year. Some say that it ends up penalizing teachers who traditionally do not score well on standardized assessments such as students who receive free and reduced lunch and students with disabilities. They state that this may cause the highly effective teachers to work at schools with a low disability rate and a middle to high socioeconomic status.^[13] There are different ways to calculate the value-added effect of teachers that changes depending on how they define value-added and what they use to calculate it. It typically does not account for the expectations put on students who go into a classroom reading below grade level and are expected to have a much higher growth rate than their peers. Through many research studies, it has shown that the estimates of teacher effectiveness were not through the same throughout different years or content areas such as reading and math and may be difficult to compare gains from tests from year to year when they don't measure the same content ^[14]

Some have commented that evaluators in states with teacher evaluation systems do not have through enough training. Furthermore, these evaluators often do not have to prove themselves as effective teachers themselves. As of 2013, only 13 states require a certification for their evaluators that require evaluators are effective teachers. Furthermore, often the same evaluator is observing students every time. In order to have high quality teacher feedback, some would argue that multiple perspectives by highly effective educators would create the dialogue and feedback that would help teachers to grow.^[15]

• Value-added modeling
• Teacher quality assessment
• Race to the Top
• New Teacher Center

• Alton-Lee, A. (2003). Quality teaching for diverse students in schooling: Best evidence synthesis. Wellington: Ministry of Education.
• Center for Teaching. (2015) Teaching Portfolios from http://cft.vanderbilt.edu/guides-sub-pages/teaching-portfolios/
• Darling-Hammond. (2012). Creating a comprehensive system for evaluating and supporting effective teaching. Stanford, CA. Stanford Center for Opportunity Policy in Education.
• Doherty, K.M & Jacobs, S. (2013). State of the States 2013: Connect the Dots – Using evaluations of teacher effectiveness to inform policy and practice. Washington, D.C. The National Council on Teacher Quality.
• Goe, L. & Croft, A. (2008). Methods of Evaluating Teacher Effectiveness. Research-to-Practice Brief. National Comprehensive Center for Teacher Quality.
• Gordon, R, Kane, T.J., & Staiger, D.O. (2006). Identifying Effective Teachers Using Performance on the Job. The Brookings Institution. http://www.brookings.edu/views/papers/200604hamilton_1.pdf
• Hattie, J. (2003, October). Teachers make a difference: What is the research evidence? Paper presented at the Australian Council for Educational Research Annual Conference on Building Teacher Quality, Melbourne.
• Hinchey, P.H., (2010). Getting Teacher Assessment Right: What Policymakers Can Learn From Research. National Education Policy Center
• Mihaly, K., McCaffrey, D., Staiger, D., & Lockwood, J. (2013). A Composite Estimator of Effective Teaching. Rand Corporation. http://metproject.org/downloads/MET_Composite_Estimator_of_Effective_Teaching_Research_Paper.pdf Archived 2015-03-14 at the Wayback Machine
• Schwartz, M. (2015). Self-Evaluation of Teaching. Ryerson University: The Learning and Teaching Office.
• Steinberg, M.P. & Sartain, L. (2015). Does Better Observation Make Better Teachers? Education Next. 16. http://educationnext.org/better-observation-make-better-teachers/
• Stewart, V. (2010). Raising Teacher Quality Around the World. Educational Leadership, 68(4), 16-20.
• Teaching and Learning Center (2015). General Education Improvement. University of the Science from http://www.usciences.edu/teaching/tips/improvement.shtml
• Toch, T. & Rothman, R. (2008). Rush to Judgment: Teacher Evaluation in Public Education. Education Sector. https://web.archive.org/web/20110722003358/http://www.educationsector.org/usr_doc/RushToJudgment_ES_Jan08.pdf
• Walker, T. (2013, March 25). How Do High-Performing Nations Evaluate Teachers? - NEA Today. Retrieved April 22, 2015, from http://neatoday.org/2013/03/25/how-do-high-performing-nations-evaluate-teachers/ Archived 2015-05-04 at the Wayback Machine
• Weisberg, D., Sexton, S., Mulhern, J., & Keeling, D. (2009). The Widget Effect: Our National Failure to Acknowledge and Act on Differences in Teacher Effectiveness. http://tntp.org/assets/documents/TheWidgetEffect_2nd_ed.pdf^{[permanent dead link]}