SAMHSA Criteria
States, tribes, and jurisdictions receiving Strategic Prevention Framework State/Tribal Incentive Grants and Partnerships for Success grants are required to implement evidence-based interventions. SAMHSA/CSAP defines as evidence-based those interventions that are included in one or more of the three categories below:
· Category #1. The intervention is included in Federal registries of evidence-based interventions; OR
· Category #2. The intervention is reported (with positive effects on the primary targeted outcome) in peer-reviewed journals; OR
· Category #3. The intervention has documented evidence of effectiveness, based on guidelines developed by SAMHSA/CSAP and/or the state, tribe or jurisdiction. Documented evidence should be implemented in accordance with four recommended guidelines, all of which should be followed. These guidelines include the following:
Guideline 1: The intervention is based on a theory of change that is documented in a clear logic or conceptual mode; AND
Guideline 2: The intervention is similar in content and structure to interventions that appear in registries and/or the peer-reviewed literature; AND
Guideline 3: The intervention is supported by documentation that it has been effectively implemented in the past, and multiple times, in a manner attentive to scientific standards of evidence and with results that show a consistent pattern of credible and positive effects; AND
Guideline 4: The intervention is reviewed and deemed appropriate by a panel of informed prevention experts that includes: well-qualified prevention researchers who are experienced in evaluating prevention interventions similar to those under review; local prevention practitioners; and key community leaders as appropriate, e.g., officials from law enforcement and education sectors or elders within indigenous cultures.
Experts in the field agree that the nature of evidence is continuous. The strength of evidence, or “evidence status,” of tested approaches will fall somewhere along a continuum from weak to strong. Strong evidence means that the approach “works”—that it generates a pattern of positive outcomes attributed to the approach itself, and that it reliably produces the same pattern of positive outcomes for certain populations under certain conditions.
Experts also agree that evidence becomes “stronger” with replication and field testing in various circumstances. However, experts do not agree on a specific minimum threshold of evidence or cutoff point below which evidence should be considered insufficient. Nor do they agree whether little evidence is equivalent to no evidence at all. Even evidence from multiple studies may be judged insufficient to resolve all doubts about the likely effectiveness of an approach designed for a different population or situation.
When deciding between two approaches, experts suggest choosing the one for which there is stronger evidence of effectiveness if the approach is similar, equivalent, and equally well-matched to the community’s unique circumstances.
From: Center for Substance Abuse Prevention. Identifying and Selecting Evidence-Based Interventions Revised Guidance Document for the Strategic Prevention Framework State Incentive Grant Program. HHS Pub. No. (SMA)09-
