TY - JOUR
T1 - Putting performance pay to the test
T2 - Effects of denver procomp on the teacher workforce and student outcomes
AU - ATTEBERRY, ALLISON
AU - LACOUR, SARAH E.
N1 - Publisher Copyright:
© 2020 Teachers College, Columbia University. All rights reserved.
PY - 2020
Y1 - 2020
N2 - Context: In 2005-06, Denver became one of the first U.S. districts to implement a pay-forperformance (PFP) compensation system, and Denver's ProComp is now the longest-running PFP policy in the country. The national proliferation of PFP systems in education has been controversial, with mixed evidence and competing narratives about its impacts. During Denver's 2019 strike, disagreements arose about whether 13 years of ProComp have helped or harmed efforts to retain effective teachers to improve student outcomes. This article addresses this policy debate. Research Questions: We use a 16-year panel to analyze the effects of ProComp on both student and teacher outcomes. We focus on the onset of the second version of the policy, ProComp 2.0, in 2008. Intervention: The ProComp policy is a pay-for-performance teacher compensation system, which includes ten distinct financial incentives, some of which are awarded schoolwide. Annual payouts represented 12% of base-pay, on average, among full-time teachers. Research Design: We use comparative interrupted time series (CITS) to examine pre/post ProComp trends in outcomes in DPS relative to similar districts across the same period. When CITS is not possible, we conduct interrupted time series (ITS) analysis in DPS using a panel up to five years pre-PC1 and up to ten years post-onset. Results: ProComp may have had a positive effect on ELA, math, and writing achievement that was not evident in comparable districts with similar achievement trends prior to 2005- 06. We also find descriptive evidence that more effective teachers were recruited to DPS once ProComp began and that the overall decline in teacher retention across districts in this time period was less precipitous among DPS' highly effective teachers during ProComp. Conclusions: Our results can help reflect on which of the hypothesized mechanisms undergirding PFP policies find empirical support in the field. The onset of ProComp shifted the composition of the DPS teacher workforce through recruitment and retention of certain kinds of teachers. These results at first appear to contradict teacher perceptions that the program coincided with a dramatic decline in teacher retention and was thus ineffective. However, retention did, in fact, decline throughout the period. Yet DPS retention patterns were not that different from other comparable Colorado districts during this period. Thus, while teachers' perceptions of reduced teacher retention were accurate, it would be very difficult to see from within DPS that retention rates were not necessarily distinct from secular trends outside DPS.
AB - Context: In 2005-06, Denver became one of the first U.S. districts to implement a pay-forperformance (PFP) compensation system, and Denver's ProComp is now the longest-running PFP policy in the country. The national proliferation of PFP systems in education has been controversial, with mixed evidence and competing narratives about its impacts. During Denver's 2019 strike, disagreements arose about whether 13 years of ProComp have helped or harmed efforts to retain effective teachers to improve student outcomes. This article addresses this policy debate. Research Questions: We use a 16-year panel to analyze the effects of ProComp on both student and teacher outcomes. We focus on the onset of the second version of the policy, ProComp 2.0, in 2008. Intervention: The ProComp policy is a pay-for-performance teacher compensation system, which includes ten distinct financial incentives, some of which are awarded schoolwide. Annual payouts represented 12% of base-pay, on average, among full-time teachers. Research Design: We use comparative interrupted time series (CITS) to examine pre/post ProComp trends in outcomes in DPS relative to similar districts across the same period. When CITS is not possible, we conduct interrupted time series (ITS) analysis in DPS using a panel up to five years pre-PC1 and up to ten years post-onset. Results: ProComp may have had a positive effect on ELA, math, and writing achievement that was not evident in comparable districts with similar achievement trends prior to 2005- 06. We also find descriptive evidence that more effective teachers were recruited to DPS once ProComp began and that the overall decline in teacher retention across districts in this time period was less precipitous among DPS' highly effective teachers during ProComp. Conclusions: Our results can help reflect on which of the hypothesized mechanisms undergirding PFP policies find empirical support in the field. The onset of ProComp shifted the composition of the DPS teacher workforce through recruitment and retention of certain kinds of teachers. These results at first appear to contradict teacher perceptions that the program coincided with a dramatic decline in teacher retention and was thus ineffective. However, retention did, in fact, decline throughout the period. Yet DPS retention patterns were not that different from other comparable Colorado districts during this period. Thus, while teachers' perceptions of reduced teacher retention were accurate, it would be very difficult to see from within DPS that retention rates were not necessarily distinct from secular trends outside DPS.
UR - http://www.scopus.com/inward/record.url?scp=85106253470&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85106253470&partnerID=8YFLogxK
M3 - Article
AN - SCOPUS:85106253470
SN - 0161-4681
VL - 122
JO - Teachers College Record
JF - Teachers College Record
IS - 12
M1 - 120308
ER -