Author Archives: Cara Jackson

Teacher Residencies Can Translate Into a More Diverse Workforce, But Who Will Bear the Expenses?

A growing number of studies have documented the benefits of teacher diversity, as my colleagues have previously discussed (see here and here). And research drawing on data from the Measures of Effective Teaching project found that all students preferred teachers of color. Yet despite the value of diversifying the teaching workforce, Black teachers remain underrepresented. They made up around 7 to 8 percent of all teachers between school years 1999-2000 and 2015-2016, while Black students accounted for between 16 to 17 percent of all students in the same time period. The proportion of Hispanic public elementary and secondary school teachers appeared to be increasing slightly, but not nearly as fast as the proportion of Hispanic students, as seen in the figure below.

Proportion of Hispanic students and teachers over time

As my colleague Katrina has noted, a number of barriers to diversifying the teacher workforce exist, including the considerable cost to become a teacher. Traditional preparation programs have high out-of-pocket and opportunity costs (i.e., limited income while enrolled in a program). As Ashley LiBetti and Justin Trinidad describe in their recent report, these costs limit the pool of teacher candidates:  

In the traditional model, candidates must invest more than $24,000 and 1,500 hours to become a teacher…This upfront financial and opportunity cost limits the pool of candidates to those who can afford the risk, effectively cutting out nontraditional candidates, low- and lower-middle-income candidates, and career-changers.

Given well-documented racial disparities in wealth, the high cost of becoming a teacher is likely to have a disproportionate impact on the career decisions of people of color. Alternate routes to teaching may be an attractive option for prospective teachers who are sensitive to costs. As seen below, teachers from alternate routes tend to be more racially diverse than teachers from traditional teacher preparation programs. 

Racial/ethnic diversity for tradition route and alternate route teachers

Yet alternate routes have proven controversial, even when evidence suggests that alternatively certified teachers are equally or more effective at increasing student achievement on standardized tests, relative to their counterparts. In Houston, for example, school district trustees recently voted to end the district’s contract with Teach For America, citing concerns about teacher turnover. 

Teacher residency programs have emerged as perhaps a more politically viable alternative certification route than “fast-track” programs, by emphasizing on-the-job training prior to becoming a teacher of record. Because residents are typically paid a stipend during their apprenticeship period, entering teaching through a residency tends to cost less than entering through a traditional route. However, residencies typically pay a stipend that is less than what a teacher of record would earn. As a result, the cost of entering the profession through a residency program is higher than the cost of entering through a fast-track alternative certification program.  Continue reading

Correlation is Not Causation and Other Boring but Important Cautions for Interpreting Education Research

Journalists, as a general rule, use accessible language. Researchers, as a general rule, do not. So journalists who write about academic research and scholarship, like the reporters at Chalkbeat who cover school spending studies, can help disseminate research to education leaders since they write more plainly.

But the danger is that it’s easy for research to get lost in translation. Researchers may use language that appears to imply some practice or policy causes an outcome. Journalists can be misled when terms like “effect size” are used to describe the strength of the association even though they are not always causal effects.

To help journalists make sense of research findings, the Education Writers Association recently put together several excellent resources for journalists exploring education research, including 12 questions to ask about studies. For journalists (as well as practitioners) reading studies that imply that some program or policy causes the outcomes described, I would add one important consideration (a variation on question 3 from this post): if a study compares two groups, how were people assigned to the groups? This question gets at the heart of what makes it possible to say whether a program or policy caused the outcomes examined, as opposed to simply being correlated with those outcomes.

Randomly assigning people creates a strong research design for examining whether a policy or program causes certain outcomes. Random assignment minimizes pre-existing differences among the groups, so that differences in the outcomes can be attributed to the treatment (program or policy) instead of different characteristics of the people in the groups. In the image below, random assignment results in having similar-looking treatment and control groups. Continue reading

Why Some Educators Are Skeptical of Engaging in Rigorous Research — And What Can Be Done About It

In my previous post, I talked about the importance of rigorous research and the need for researchers to engage directly with education stakeholders. Yet some educators remain skeptical about the value of partnering with researchers, even if the research is relevant and rigorous. Why might education agencies fail to see the value of conducting rigorous research in their own settings?

For one thing, letting a researcher into the nitty gritty of your outcomes or practices might reveal that something isn’t working. And since it’s rare that educators/practitioners and researchers are even in the same room, education agency staff may be concerned about how findings will be framed once publicized. If they don’t even know one another, how can we expect researchers and educators to overcome their lack of trust and work together effectively?

Furthermore, engaging with researchers takes time and a shift in focus for staff in educational agencies, who are often stretched to capacity with compliance and accountability work. Additionally, education stakeholders may have strong preferences for certain programs or policies, and thus fail to see the importance of assessing whether these are truly yielding measurable improvements in outcomes. Finally, staff at educational agencies may need to devote time to help researchers translate findings, since researchers are not accustomed to creating summaries of research that are accessible to a broad audience.

Given all this, why am I still optimistic about connecting research, practice, and policy? Continue reading

Why Is There a Disconnect Between Research and Practice and What Can Be Done About It?

What characteristics of teacher candidates predict whether they’ll do well in the classroom? Do elementary school students benefit from accelerated math coursework? What does educational research tell us about the effects of homework?

three interconnected cogs, one says policy, one says practice, one says research

These are questions that I’ve heard over the past few years from educators who are interested in using research to inform practice, such as the attendees of researchED conferences. These questions suggest a demand for evidence-based policies and practice among educators. And yet, while the past twenty years have witnessed an explosion in federally funded education research and research products, data indicate that many educators are not aware of federal research resources intended to support evidence use in education, such as the Regional Education Laboratories or What Works Clearinghouse.

Despite a considerable federal investment in both education research and structures to support educators’ use of evidence, educators may be unaware of evidence that could be used to improve policy and practice. What might be behind this disconnect, and what can be done about it? While the recently released Institute of Education Sciences (IES) priorities focus on increasing research dissemination and use, their focus is mainly on producing and disseminating: the supply side of research. Continue reading

Which Aspects of the Work Environment Matter Most for New Teachers?

As a member of Bellwether’s evaluation practice, there’s nothing I love more than connecting research with policy and practice. Fortunately, I’m not alone: The National Center for Analysis of Longitudinal Data in Education Research (CALDER) has launched several initiatives to succinctly describe empirical research on contemporary topics in education and encourage evidence-based policymaking.

At CALDER’s recent 12th annual conference, I had the opportunity to serve as a discussant in a session on the career trajectories of teachers. The papers in this session illustrated the potential for research to inform policy and practice, but also left me wondering about the challenges policymakers often face in doing so.

Taking their First Steps: The Distribution of New Teachers into School and Classroom Contexts and Implications for Teacher Effectiveness and Growth” by Paul Bruno, Sarah Rabovsky, and Katharine Strunk uses data from Los Angeles Unified School District to explore how classroom and school contexts, such as professional interactions, are related to teacher quality and teacher retention. Their work builds on prior research that suggests school contexts are associated with the growth and retention of new teachers. As my Bellwether colleagues have noted, to ensure quality teaching at scale, we need to consider how to restructure initial employment to support new teachers in becoming effective.

In “Taking their First Steps,” the researchers developed four separate measures to understand the context in which new teachers were operating.  The measure of “instructional load” combined twelve factors, including students’ prior-year performance, prior-year absences, prior-year suspensions, class size, and the proportion of students eligible for free or reduced-price lunch, eligible for special education services, or classified as English learners. “Homophily” was measured by a teacher’s similarity to students, colleagues, and administrators in terms of race and gender. “Collegial qualifications” consisted of attributes such as years of experience, National Board certification, and evaluation measures. “Professional culture” was a composite of survey responses regarding the frequency and quality of professional interactions at teachers’ school sites.

Which of these factors had impact on teachers’ observation ratings and teacher attendance? As seen in the figures below, instructional load had a significant negative relationship with teachers’ observation ratings, meaning teachers with higher instructional loads (such as students with lower prior performance, more prior absences and suspensions, or larger class sizes) received lower ratings. On the other hand, professional culture had a significant positive impact on observation ratings, meaning that in schools where teachers had more and higher-quality professional interactions, new teachers received higher observation ratings. Instructional load also had a strong negative relationship with attendance rates, meaning teachers with higher instructional loads took more personal days or used more sick leave.

Figure based on Katharine Strunk’s presentation from January 31, 2019.

Continue reading