This second in a series of reports about the evaluation of the New York City Mayor’s Action Plan for Neighborhood Safety (MAP). This Evaluation Update: summarizes the goals and methods used to evaluate the Mayor’s Action Plan; describes the quasi-experimental design used to test the outcomes and impacts of MAP as well as the data sources assembled by the research team and how they are used; and portrays a logical framework the research team used initially to identify causal pathways through which various elements of MAP were intended to achieve their desired effect.
To evaluate the New York City Mayor’s Action Plan for Neighborhood Safety (MAP), an initiative to improve the safety of public housing developments, researchers estimated the counterfactual (no intervention) by selecting a set of comparison housing developments not involved in the initiative. The study relied on the statistical method known as propensity score analysis (PSA) to select the comparison group.
Policymakers and practitioners in the justice sector should consider evaluation research as a portfolio of strategic investments in knowledge development. Randomized controlled trials are merely one asset in a broader investment strategy.
Jeffrey A. Butts and Vincent Schiraldi Recidivism is not a robust measure of effectiveness for community corrections agencies. When used as the sole measure of effectiveness, recidivism misleads policymakers and the public, encourages inappropriate comparisons of dissimilar populations, and focuses policy on negative rather than positive outcomes. Policymakers who focus on recidivism as evidence of justice effectiveness are confusing a complex, bureaucratic indicator of system decision-making with a simple measure of individual behavior and rehabilitation. Recidivism is at least in part a gauge of police activity and enforcement emphasis and, because of differential policing practices in minority communities, using recidivism…
This report reviews a number of prominent frameworks that are available to help youth justice systems rely on positive outcomes rather than recidivism to measure their effectiveness. These include the Developmental Assets model, the 5Cs model, the Youth Program Quality Assessment model, the Positive Youth Justice model, and the Youth Thrive framework. Each model or framework aligns with the key principles of positive youth development as well as the large body of research on desistance from crime, which is also presented in this report.
Young men who express more confidence in law enforcement are less likely to support the use of personal violence to settle disputes and resolve personal conflicts.
Promising evidence that the public health approach to violence reduction championed by Cure Violence may be capable of creating safe and healthy communities.
New York City neighborhoods operating Cure Violence programs show stronger declines in violence-endorsing attitudes than do areas without Cure Violence programs.
Community-based services provided by Youth Advocate Programs, Inc. may generate considerable savings by reducing the need for commitment and out-of-home placement among court-involved youth.
While one of the strengths of OJJDP’s CBVP model was its emphasis on adaptation to local context and needs, the variation across program sites posed serious challenges for the evaluation and made it impossible to assess and compare outcomes in each city.
This study suggests that the National Forum on Youth Violence Prevention provides meaningful assistance to cities. The organizational networks involved in the National Forum appear to be moving in positive directions and the individuals involved in those networks report high levels of confidence that they are making a difference.
Jeffrey A. Butts October 18, 2015 Researching the effectiveness of social policies is like pointing a flashlight inside a dark room. You can can only see what passes through the beam of light. Depending on the size of the room and the power of the beam, you may learn relatively little about the entire room. And, whoever holds the flashlight controls what you can learn. Research evidence does not emerge from a pristine and impartial search for truth. The evidence we have today is the fruit of previous research investments made by policymakers and funding bodies with goals, beliefs,…