This second in a series of reports about the evaluation of the New York City Mayor’s Action Plan for Neighborhood Safety (MAP). This Evaluation Update: summarizes the goals and methods used to evaluate the Mayor’s Action Plan; describes the quasi-experimental design used to test the outcomes and impacts of MAP as well as the data sources assembled by the research team and how they are used; and portrays a logical framework the research team used initially to identify causal pathways through which various elements of MAP were intended to achieve their desired effect.
To evaluate the New York City Mayor's Action Plan for Neighborhood Safety (MAP), an initiative to improve the safety of public housing developments, researchers estimated the counterfactual (no intervention) by selecting a set of comparison housing developments not involved in the initiative. The study relied on the statistical method known as propensity score analysis (PSA) to select the comparison group.
Policymakers and practitioners in the justice sector should consider evaluation research as a portfolio of strategic investments in knowledge development. Randomized controlled trials are merely one asset in a broader investment strategy.
Relationships between incarcerated parents and their children are difficult to maintain, but they are important to the relief of incarceration-induced trauma.
Commentary Counting failure is no way to encourage success Jeffrey A. Butts and Vincent Schiraldi Any discussion of criminal justice policy inevitably includes the word “recidivism.” Usually more than once. Recidivism is the reoccurrence of crime among people known to have committed crimes before. At all levels of justice, from local probation offices to the [...]
Jeffrey A. Butts and Vincent Schiraldi Recidivism is not a robust measure of effectiveness for community corrections agencies. When used as the sole measure of effectiveness, recidivism misleads policymakers and the public, encourages inappropriate comparisons of dissimilar populations, and focuses policy on negative rather than positive outcomes. Policymakers who focus on recidivism as evidence of [...]
This report reviews a number of prominent frameworks that are available to help youth justice systems rely on positive outcomes rather than recidivism to measure their effectiveness. These include the Developmental Assets model, the 5Cs model, the Youth Program Quality Assessment model, the Positive Youth Justice model, and the Youth Thrive framework. Each model or framework aligns with the key principles of positive youth development as well as the large body of research on desistance from crime, which is also presented in this report.
The John Jay Research and Evaluation Center hosts a conference on October 26, 2017 about the Cure Violence approach to community safety.
NY1 News reports on JohnJayREC's recent study about the effects of Cure Violence. Includes a short comment from Jeffrey Butts.
Young men who express more confidence in law enforcement are less likely to support the use of personal violence to settle disputes and resolve personal conflicts.
This chapter describes tools for researchers to address the tasks of problem definition, measurement, causal processes, and generalization. We begin with an extended example of developing practice-based evidence in community-based youth justice organizations in New York City.
Data infrastructures for tracking youth violence in the United States do not provide a clear view of neighborhood-level change, but the most effective strategies for dealing with youth violence inevitably focus on small areas like neighborhoods. This makes it essential to measure the effects of violence prevention efforts at the neighborhood level as well.
In 2010 and 2011, OJJDP sought applications to fund community-based violence prevention initiatives.
The Brooklyn program area and comparison area experienced similar crime patterns during the study.
Violence generally increased from 2010 to 2015 and the increases were larger in CBVP areas.
The outcome evaluation failed to detect measurable effects of CBVP at the community level.
Violent crime trends in CBVP areas failed to demonstrate positive effects of the initiative.
Violence was declining and the decrease may have been more pronounced among youth in CBVP areas.
Violence in Newark may have simply followed a pattern common to other large cities in New Jersey.
The CBVP program may have improved communities, but the study could not identify consistent effects.
With funding provided by the City of New York through its Administration for Children's Services (ACS), the Research and Evaluation Center reviewed and compiled recent research and practice innovations focused on adolescent development and the youth justice system. Researchers considered the appropriate role of youth justice in enhancing essential assets for adolescents, including prosocial relationships [...]
Butts, Jeffrey A. and Sheyla Delgado (2014). Evaluating the Effectiveness of the Cure Violence Model in New York City. New York, NY: Research & Evaluation Center, John Jay College of Criminal Justice. With funding from the Robert Wood Johnson Foundation (RWJF) and the City Council of New York City, the Research and Evaluation Center is [...]
The Juvenile Justice Information Exchange (JJIE.org) hosted a Google Hangout (online live chat) between the director of the Research & Evaluation Center, Jeffrey Butts, and Cynthia Lum from the Center for Evidence-Based Crime Policy at George Mason University. The conversation covered a number of topics, including the nature of evidence-based practices, how programs or practices become [...]
Butts, Jeffrey A. (2012). What's the Evidence for Evidence-Based Practice? Research and Evaluation Data Bits [2012-10]. New York, NY: Research and Evaluation Center, John Jay College of Criminal Justice, City University of New York. Research evidence does not emerge from a pristine and impartial search for the most effective practices. The evidence we have today is the [...]
The Pinkerton Fellowship Initiative, one of two graduate fellowships housed at the Research and Evaluation Center, was a collaboration between The Pinkerton Foundation and the John Jay College of Criminal Justice. The goal of the initiative was to contribute to the development and evidence orientation of the youth justice community in New York City. The program supported [...]