KEEP SAFE

2  — Supported by Research Evidence
High
2  — Supported by Research Evidence
High
3  — Promising Research Evidence
High

About This Program

Target Population: Caregivers of youth 10 to 18 years of age in foster or kinship care placements and the youth themselves

For children/adolescents ages: 10 – 18

For parents/caregivers of children ages: 10 – 18

Program Overview

The objective of KEEP SAFE is to give parents effective tools for dealing with their child's externalizing and other behavioral and emotional problems including trauma and to support them in the implementation of those tools. Curriculum topics include framing the foster/kin parents' role as that of key agents of change with opportunities to alter the life course trajectories of the children placed with them. Foster/kin parents are taught methods for creating a safe environment, encouraging child cooperation, using behavioral contingencies and effective limit setting, and balancing encouragement and limits. There are also sessions on dealing with difficult problem behaviors including covert behaviors, promoting school success, encouraging positive peer relationships, and strategies for managing stress brought on by providing foster care. There is an emphasis on active learning methods; illustrations of primary concepts are presented via role-plays and videotapes. There is also a component of the model that involves having the youth meet weekly with a skills coach. The emphasis is on developing and maintaining positive peer relationships, increasing skills to deal responsibly and safely to avoid drug use and participation in health-risking sexual behavior, and to help these youth problem solve difficulties and stresses in social relationships with adults and at school. KEEP SAFE is also rated in the Placement Stabilization Programs topic area. Please click here to go to that entry.

Program Goals

The goals of KEEP SAFE are:

  • Decrease placement disruptions from foster care
  • Increase reinforcement from foster parent to child/adolescent
  • Decrease child/adolescent emotional and behavioral problems
  • Decrease foster/kin parent stress

Logic Model

The program representative did not provide information about a Logic Model for KEEP SAFE.

Essential Components

The essential components of KEEP SAFE include:

  • Foster/kinship family attends weekly parent support and training group sessions.
  • Foster/kinship family groups are conducted by a trained facilitator and co-facilitator.
  • Foster/kinship family receives supervision in behavior management methods.
  • Foster/kinship family group sessions are structured so that the curriculum content is integrated into group discussions.
  • Foster/kinship family receives weekly Parent Daily Report Checklist calls by either the facilitator or co-facilitator to trouble shoot problems the foster parent was having in implementing the assignment, and to collect data on the child's problem behaviors during the past day.
  • If foster/kinship family misses a parent-training session, the material from the missed session is delivered during a home visit at a time convenient for the foster parent.
  • Youth are provided with a skills coach to help them practice prosocial skills in the community.

Program Delivery

Child/Adolescent Services

KEEP SAFE directly provides services to children/adolescents and addresses the following:

  • Externalizing problems, trauma mental health problems, drug use, high-risk sexual behavior, and problems in school and with peer group

Parent/Caregiver Services

KEEP SAFE directly provides services to parents/caregivers and addresses the following:

  • Caregiver of a child with externalizing problems, trauma, mental health problems, drug use, high-risk sexual behavior, and problems in school and with peer group

Recommended Intensity:

One 90-minute meeting and one 10-minute telephone call per week for foster/kin parents plus one 60-minute skills coaching session weekly for youth

Recommended Duration:

16 weeks

Delivery Settings

This program is typically conducted in a(n):

  • Community-based Agency / Organization / Provider
  • Public Child Welfare Agency (Dept. of Social Services, etc.)

Homework

KEEP SAFE includes a homework component:

Home practice assignments help parents implement behavior management methods discussed and practiced in the groups. Home practices are also given to youth by their skills coach.

Languages

KEEP SAFE has materials available in a language other than English:

Spanish

For information on which materials are available in this language, please check on the program's website or contact the program representative (contact information is listed at the bottom of this page).

Resources Needed to Run Program

The typical resources for implementing the program are:

  • Ability to video tape the group using digital format video
  • Group room
  • Video setup for the group (instructional tapes are used in some sessions)

Manuals and Training

Prerequisite/Minimum Provider Qualifications

The intervention can be delivered by bachelor-level staff who are well-trained and supervised weekly. In many child welfare settings, the intervention is delivered by case workers. All sessions are video recorded and recordings are reviewed prior to the supervision. Paraprofessionals with a Bachelor's degree and good interpersonal skills are qualified. Supervisors are Master's level clinicians. Graduate students or Bachelor's level staff members deliver the skills coaching sessions.

Manual Information

There is a manual that describes how to deliver this program.

Training Information

There is training available for this program.

Training Contacts:
Training Type/Location:

Year-long training and consultation

Number of days/hours:

Initial training takes 5 days and then involves weekly telephone supervision for 12 months. Skills coach training takes 3 days plus monthly consultation calls for 6 months. In total there are 1.5 to 2 years of consultation, including training the trainers so the site can train new staff.

Implementation Information

Pre-Implementation Materials

There are pre-implementation materials to measure organizational or provider readiness for KEEP SAFE as listed below:

Initial–discovery telephone calls are conducted to learn about site needs, priorities, and goals.

There is a readiness questionnaire that is reviewed with all prospective KEEP SAFE programs. This is completed during telephone interviews between the developers and the prospective sites. For more information, please contact Patricia Chamberlain or Rohanna Buchanan at the Oregon Social Learning Center at 541-485-2711.

Formal Support for Implementation

There is formal support available for implementation of KEEP SAFE as listed below:

Agency assigns a group leader to participate in an initial five-day intensive training. The group leader receives additional formal support, including:

  • Weekly written feedback on fidelity and participate in weekly telephone consultation with a KEEP SAFE expert.
  • Group Leaders who complete three 16-week KEEP SAFE groups are eligible to be certified.
  • Certified Group Leaders are eligible to be KEEP SAFE Local Coaches/trainers in their agency/region. Local Coaches participate in an additional 3-day training session and the first training session they lead is "shadowed" by a KEEP SAFE expert.
  • Local Coaches/trainers participate in an additional 5-day training session and the first training session they lead is "shadowed" by a KEEP SAFE expert.
  • Local Coaches are trained to reliably to rate session fidelity.

Fidelity Measures

There are fidelity measures for KEEP SAFE as listed below:

The KEEP Fidelity Adherence Rating System is used. The measure can be obtained from Rohanna Buchanan (email: RohannaB@oslc.org).

Group leaders and agency directors are provided with monthly reports

Implementation Guides or Manuals

There are implementation guides or manuals for KEEP SAFE as listed below:

There is an implementation manual. Information about is available from Rohanna Buchanan (email: RohannaB@oslc.org).

Research on How to Implement the Program

Research has been conducted on how to implement KEEP SAFE as listed below:

Buchanan, R., Chamberlain, P., Price, J. M., & Sprengelmeyer, P. (2013). Examining the equivalence of fidelity over two generations of KEEP implementation: A preliminary analysis. Children and Youth Services Review, 35(1), 188-193. doi:10.1016/j.childyouth.2012.10.002

Chamberlain, P. (2017). Toward creating synergy among policy, procedures, and implementation of evidence-based models in child welfare systems: Two case examples. Clinical Child and Family Psychology Review, 20, 78-86. doi:10.1007/s10567-017-0226-5

Chamberlain, P., Feldman, S. W., Wulczyn, F., Saldana, L., & Forgatch, M. (2016). Implementation and evaluation of linked parenting models in a large urban child welfare system. Child Abuse & Neglect, 53, 27-39. doi:10.1016/j.chiabu.2015.09.013

Relevant Published, Peer-Reviewed Research

Child Welfare Outcome: Child/Family Well-Being

Smith, D. K., Leve, L. D., & Chamberlain, P. (2011). Preventing internalizing and externalizing problems in girls in foster care as they enter middle school: Impact of an intervention. Prevention Science, 12(3), 269–277. https://doi.org/10.1007/s11121-011-0211-z

Type of Study: Randomized controlled trial
Number of Participants: 100

Population:

  • Age — Children: Mean=11.54 years; Parents: Not specified
  • Race/Ethnicity — Children: 63% European American, 14% Multiracial, 10% Latino, 9% African American, and 4% Native American; Parents: 70% European American, 17% African American, 5% Multiracial, 4% Latino, 3% Native American, and 1% Asian
  • Gender — Children: 100% Female, Parents: 70% Female
  • Status — Participants were involved in the child welfare system.

Location/Institution: Lane or Multnomah County, Oregon

Summary: (To include basic study design, measures, results, and notable limitations)
The purpose of the study was to examine the immediate impact of the Middle School Success intervention (MSS) [now called KEEP SAFE] targeting the prevention of internalizing and externalizing problems for girls in foster care prior to middle school entry. Participants were randomly assigned to an intervention condition or to a control condition (foster care services as usual). Measures utilized include the Parent Daily Report (PDR). Results indicate that the MSS girls experienced fewer internalizing and externalizing problems. However, there were no significant changes in prosocial behavior. Limitations include limited generalizability due to gender, the outcomes examined were short-term thus demonstrating only the immediate impact of the intervention, and mechanisms underlying the significant improvements in internalizing and externalizing outcomes for the intervention girls were not examined in the present study.

Length of controlled postintervention follow-up: 6 months.

Kim, H. K., & Leve, L. D. (2011). Substance use and delinquency among middle school girls in foster care: A three-year follow-up of a randomized controlled trial. Journal of Consulting and Clinical Psychology, 79(6), 740–750. https://doi.org/10.1037/a0025949

Type of Study: Randomized controlled trial
Number of Participants: 100

Population:

  • Age — Children: Mean=11.54 years; Parents: Not specified
  • Race/Ethnicity — Children: 63% European American, 14% Multiracial, 10% Latino, 9% African American, and 4% Native American; Parents: 70% European American, 17% African American, 5% multiracial, 4% Latino, 3% Native American, and 1% Asian
  • Gender — Children: 100% Female; Parents:70% Female
  • Status — Participants were individuals involved in the child welfare system.

Location/Institution: San Diego County, California

Summary: (To include basic study design, measures, results, and notable limitations)
The study used the same sample as Smith et al. (2011). The purpose of the study was to evaluate the efficacy of the Middle School Success intervention (MSS) [now called KEEP SAFE] for reducing substance use and delinquency among girls in foster care. Participants were randomly assigned to either MSS or the control group. Measures utilized include the Parent Daily Report Checklist (PDR) and the Achenbach System of Empirically Based Assessment (ASEBA). Results indicate that girls in MSS showed significantly lower levels of substance use than did girls in the control condition at 36-month postbaseline. The group difference was only marginally significant for delinquency. Further analyses indicated significant indirect effects of MSS through increased prosocial behaviors which led to decreased internalizing and externalizing symptoms and then to lower levels of substance use. The direct effect of MSS on substance use remained significant in the presence of the indirect effects. For delinquency, the intervention had positive effects mainly through increased prosocial skills. Limitations include low generalizability due to ethnicity, small sample size, and reliance on self-reported measures.

Length of controlled postintervention follow-up: 32 months.

Kim, H. K., Pears, K. C., Leve, L. D., Chamberlain, P., & Smith, D. K. (2013). Intervention effects on health-risking sexual behavior among girls in foster care: The role of placement disruption and tobacco and marijuana use. Journal of Child & Adolescent Substance Abuse, 22(5), 370–387. https://doi.org/10.1080/1067828X.2013.788880

Type of Study: Randomized controlled trial
Number of Participants: 100

Population:

  • Age — Children: Mean=11.54 years; Parents: Not specified
  • Race/Ethnicity — Children: 63% European American, 14% Multiracial, 10% Latino, 9% African American, and 4% Native American; Parents: 70% European American, 17% African American, 5% Multiracial, 4% Latino, 3% Native American, and 1% Asian
  • Gender — Children: 100% Female; Parents: 70% Female
  • Status — Participants were individuals involved in the child welfare system.

Location/Institution: Lane or Multnomah County, Oregon

Summary: (To include basic study design, measures, results, and notable limitations)
The study used the same sample as Smith et al. (2011). The purpose of the study was to examine the effects of the Middle School Success intervention (MSS) [now called KEEP SAFE] on the health-risking sexual behavior of girls involved in foster care. Participants were randomly assigned to an intervention condition or to a control condition (foster care services as usual). Measures utilized include assessments of tobacco and marijuana use and health-risking sexual behaviors, placement change, and pubertal status. Results indicate that girls in MSS showed significantly lower levels of health-risking sexual behavior than did girls in the control condition. Limitations include small sample size, low generalizability due to ethnicity and gender, and reliance on self-reported measures.

Length of controlled postintervention follow-up: 32 months.

Kim, H. K., Buchanan, R., & Price, J. M. (2017). Pathways to preventing substance use among youth in foster care. Prevention Science, 18(5), 18(5), 567–576. https://doi.org/10.1007/s11121-017-0800-6

Type of Study: Randomized controlled trial
Number of Participants: 259

Population:

  • Age — Children: 11-17 years (Mean=14.3 years); Adults: Mean=48.4 years
  • Race/Ethnicity — Children: 47% Hispanic, 23% African American 16% European American, 9% Multiple Races, 3% American Indian, and 2% Asian American/Pacific Islander; Adults: Not specified
  • Gender — Children: 154 Females; Adults: Not specified
  • Status — Participants were individuals involved with child welfare services (CWS).

Location/Institution: San Diego County, California

Summary: (To include basic study design, measures, results, and notable limitations)
The purpose of the study was to determine the efficacy of the KEEP SAFE program. Participants were randomly assigned to the KEEP SAFE intervention condition or to the services as usual (SAU) condition. Measures utilized include a modified version of the Self-Report Delinquency Scale (SRD). Results indicate that the intervention significantly reduced substance use in foster youth at 18 months postbaseline and that the intervention influenced substance use through two processes: youths’ improved quality of relationships with caregivers at 6 months postbaseline, and fewer associations with deviant peers at 12 months postbaseline. Limitations include modest sample size did not allow to fully examine potential ethnic group differences in the intervention effect; participation rate was relatively low (49%), and retention rates of the sample were reduced over time (72% at T4); and reliance on self-report measures.

Length of controlled postintervention follow-up: 6 and 12 months.

Additional References

Chamberlain, P., Price, J., Leve, L. D., Laurent, H., Landsverk, J. A., & Reid, J. B. (2008). Prevention of behavior problems for children in foster care: Outcomes and mediation effects. Prevention Science, 9, 17-27.

Chamberlain, P., Price, J. M., Reid, J. B., Landsverk, J., Fisher, P.A., & Stoolmiller, M. (2006). Who disrupts from placement in foster and kinship care? Child Abuse and Neglect, 30, 409-424.

Price, J. M., Chamberlain, P., Landsverk, J., Reid, J., Leve, L., & Heidemarie, L. (2008). Effects of a foster parent training intervention on placement changes of children in foster care. Child Maltreatment, 13,64-75.

Contact Information

Rohanna Buchanan, PhD
Agency/Affiliation: Oregon Social Learning Center
Website: www.keepfostering.org
Email:
Phone: (541) 485-2711
Fax: (541) 485-7087

Date Research Evidence Last Reviewed by CEBC: January 2023

Date Program Content Last Reviewed by Program Staff: September 2019

Date Program Originally Loaded onto CEBC: October 2017