Skip to content

Quality Standards Assessment – Child Care Professional Version (QSA-CCP)

CONTENTS

CONTENTS

Assessment Rating

A - Psychometrics Well-Demonstrated

Developer:

Shamra Boel-Studt, PhD, and Jonathan Huefne, PhD

A
See entire scale

Assessment Rating

A - Psychometrics Well-Demonstrated

Developer:

Shamra Boel-Studt, PhD, and Jonathan Huefne, PhD

A
See entire scale

Description / Purpose

The QSA-CCP assesses the extent to which children’s residential centers consistently implement research-informed quality practice standards that are associated with positive youth outcomes. The QSA-CCP is an assessment tool designed to evaluate the quality of children’s residential group care programs based on childcare professional ratings. The QSA-CCP includes eight domains that reflect key aspects of care, such as safe living environment, service planning, and staff supervision and training. The QSA-CCP (86 items) is tailored to the roles and experiences of childcare professionals who work within and in collaboration with residential care providers. Items are rated on a 5-point Likert scale ranging from 1 (Standard is not at all met) to 5 (Standard is completely met). Domain scores are calculated by averaging item responses, with higher scores indicating stronger perceived quality. The QSA-CCP enables programs to identify strengths and areas for improvement, contributing to data-driven decision-making and enhanced care quality.

Target Population:

The target population is residential care facilities and shelters for children and youth.

Time to Administer:

On average, completion takes about 1 hour.

Completed By:

QSA-CCP is completed by residential care staff, licensing specialists, case managers, placement coordinators, therapists, and other adults whose professional role entails working directly in a residential care setting or with children who are placed in residential care.

Available Modalities:

Pen/Paper and Online

Scoring Information:

When administered online (typically using Qualtrics), the QSA-CCP is auto-scored based on a preprogrammed algorithm. If taken by pen and paper, responses can be entered into the online version or can be scored by hand. The QSA-CCP is scored by Domain based on the average item rating.

Language Notes:

English, Spanish, Haitian

Training Requirements:

Prior to using the QSA-CCP, users such as state agencies or residential providers are required to complete a 3-hour training. Not all staff from the agencies must participate, but at least 2 representatives involved in implementation are required to participate in the training and follow-up technical assistance calls to support implementation fidelity.

Availability:

Copies of the tool are typically obtained through an electronic link to the online QSA. Paper copies can be shared via email.

Manual details:

  • Boel-Studt, S. (2025). A multi-dimensional quality assessment system for children’s residential programs: Implementation manual (Updated April 2, 2025). Florida State University.

Languages Available: English, Haitian, Spanish

Description / Purpose

The QSA-CCP assesses the extent to which children’s residential centers consistently implement research-informed quality practice standards that are associated with positive youth outcomes. The QSA-CCP is an assessment tool designed to evaluate the quality of children’s residential group care programs based on childcare professional ratings. The QSA-CCP includes eight domains that reflect key aspects of care, such as safe living environment, service planning, and staff supervision and training. The QSA-CCP (86 items) is tailored to the roles and experiences of childcare professionals who work within and in collaboration with residential care providers. Items are rated on a 5-point Likert scale ranging from 1 (Standard is not at all met) to 5 (Standard is completely met). Domain scores are calculated by averaging item responses, with higher scores indicating stronger perceived quality. The QSA-CCP enables programs to identify strengths and areas for improvement, contributing to data-driven decision-making and enhanced care quality.

Target Population:

The target population is residential care facilities and shelters for children and youth.

Time to Administer:

On average, completion takes about 1 hour.

Completed By:

QSA-CCP is completed by residential care staff, licensing specialists, case managers, placement coordinators, therapists, and other adults whose professional role entails working directly in a residential care setting or with children who are placed in residential care.

Available Modalities:

Pen/Paper and Online

Scoring Information:

When administered online (typically using Qualtrics), the QSA-CCP is auto-scored based on a preprogrammed algorithm. If taken by pen and paper, responses can be entered into the online version or can be scored by hand. The QSA-CCP is scored by Domain based on the average item rating.

Language Notes:

English, Spanish, Haitian

Training Requirements:

Prior to using the QSA-CCP, users such as state agencies or residential providers are required to complete a 3-hour training. Not all staff from the agencies must participate, but at least 2 representatives involved in implementation are required to participate in the training and follow-up technical assistance calls to support implementation fidelity.

Availability:

Copies of the tool are typically obtained through an electronic link to the online QSA. Paper copies can be shared via email.

Manual details:

  • Boel-Studt, S. (2025). A multi-dimensional quality assessment system for children’s residential programs: Implementation manual (Updated April 2, 2025). Florida State University.

Languages Available: English, Haitian, Spanish

Contact Information

Shamra Boel-Studt

Contact Information

Shamra Boel-Studt

Summary of Relevant Psychometric Research
This tool has received the Measurement Tools Rating of A – Psychometrics Well-Demonstrated based on the published, peer-reviewed research available. The tool must have 2 or more published, peer-reviewed studies that have established the measure’s psychometrics (e.g., reliability and validity, sensitivity and specificity, etc.). Please see the Measurement Tools Rating Scale for more information.
View All Research Articles

  • Boel-Studt, S., Huefner, J. C., Bender, K., Huang, H., & Abell, N. (2018). Developing quality standards and performance measures for residential group care: Translating theory to practice. Residential Treatment for Children & Youth, 36(4), 260–281. https://doi.org/10.1080/0886571X.2018.1536494

    Sample:

    Participants: 16 subject matter experts (content validation study); 56 service providers and 27 youth from 10 group homes in one region in Florida (reliability study)

    Race/Ethnicity — Not specified

    Summary:

    The psychometrics of the Quality Standards Assessment was examined in two studies. First, data from a survey of subject matter experts was analyzed using the Scale Content Validity Index (S-CVI); a S-CVI score of .80 or higher (≥ 80% agreement) indicates an item was viewed as a valid representation of a standard. The results show that the total S-CVI was above .80 for the youth, provider, and licensing forms. S-CVI scores for six out of eight subscales in the provider form had S-CVI scores meeting the criteria. Second, a feasibility study with 11 group homes provided data for an examination of internal consistency reliability. Results of a preliminary reliability analysis of the provider forms were promising for the overall scales (Provider α = 0.73). For the provider form, estimates for four subscales (50%) met the criteria for good or excellent reliability (≥.80). Four (50%) fell below .70. The results prompted further review and revision of items within the poorer performing subscales.

  • Boel-Studt, S., Huefner, J. C., & Huang, H. (2019). The group care quality standards assessment: A framework for assessment, quality improvement, and effectiveness. Children and Youth Services Review, 105, Article 104425. https://doi.org/10.1016/j.childyouth.2019.104425

    Sample:

    Participants: Licensing specialists (37 forms), youth (72 forms), case managers and placement coordinators (78 forms), and group home directors and direct care workers (116 forms) from 37 group homes in two regions in Florida

    Race/Ethnicity — Not specified

    Summary:

    The reliability of the Quality Standards Assessment was examined in an implementation pilot study through Cronbach’s alphas, which were calculated for all eight scales for the form (Group Care Provider α = 0.46–0.81). Cronbach’s alphas for two scales were below acceptable for the Monitor & Report Problems scale (α = 0.46) of the group home directors/direct care worker form.

  • Boel-Studt, S., Huefner, J. C., & Dowdy-Hazlett, T. (2025). Validity of the Quality Standards Assessment for children’s residential care. Residential Treatment for Children & Youth. 43(2), 272–295. https://doi.org/10.1080/0886571X.2025.2460832n

    Sample:

    Participants: Factorial validity study: 1,407 QSAs were completed by youth (n = 450), state licensing specialists (n = 152), lead agency personnel (n = 183), residential program directors (n = 172), and direct care specialists (n = 450) from 169 residential programs in Florida. Convergent validity study: youth (n = 328), lead agency personnel (n = 137), direct care specialists (n = 302), directors (n = 224), and licensing specialists (n = 159) in 159 residential programs. Concurrent Validity study: 98 programs with complete QSA-CCP and QSA-Y data with incident data reported during the same time.

    Race/Ethnicity — Not specified

    Summary:

    The validity of the Quality Standards Assessment was examined using evidence from multiple approaches to evaluating validity (content (see Boel-Studt, Huefner, Bender et al, 2018 above for more details), factorial, convergent, and criterion validity) from a series of pilots and studies carried out from 2016–2022. Factorial validity was examined using confirmatory factor analyses (CFA); all tested models achieved acceptable fit, supporting the eight-factor structure of the QSA-CCP. Convergent validity was examined through the use of single-item indicators (SII). Pearson’s correlation coefficient was used to estimate associations between mean QSA domain scores and domain SII ratings. All correlations were positive, moderate to large, and statistically significant, providing strong overall evidence of convergent validity. Concurrent validity of the QSA was examined through correlations between QSA domain scores and the number of documented incidents and staff turnover. The results support several expected negative associations, collectively providing additional, albeit preliminary evidence of convergent validity. Most consistently, higher mean scores were associated with fewer total incidents, runaway episodes, law enforcement calls, and staff turnover. The results of this research lend preliminary support for the validity of the QSA as a measure of quality residential care for children and youth.

Summary of Relevant Psychometric Research

This tool has received the Measurement Tools Rating of A – Psychometrics Well-Demonstrated based on the published, peer-reviewed research available. The tool must have 2 or more published, peer-reviewed studies that have established the measure’s psychometrics (e.g., reliability and validity, sensitivity and specificity, etc.). Please see the Measurement Tools Rating Scale for more information.
View All Research Articles

  • Boel-Studt, S., Huefner, J. C., Bender, K., Huang, H., & Abell, N. (2018). Developing quality standards and performance measures for residential group care: Translating theory to practice. Residential Treatment for Children & Youth, 36(4), 260–281. https://doi.org/10.1080/0886571X.2018.1536494

    Sample:

    Participants: 16 subject matter experts (content validation study); 56 service providers and 27 youth from 10 group homes in one region in Florida (reliability study)

    Race/Ethnicity — Not specified

    Summary:

    The psychometrics of the Quality Standards Assessment was examined in two studies. First, data from a survey of subject matter experts was analyzed using the Scale Content Validity Index (S-CVI); a S-CVI score of .80 or higher (≥ 80% agreement) indicates an item was viewed as a valid representation of a standard. The results show that the total S-CVI was above .80 for the youth, provider, and licensing forms. S-CVI scores for six out of eight subscales in the provider form had S-CVI scores meeting the criteria. Second, a feasibility study with 11 group homes provided data for an examination of internal consistency reliability. Results of a preliminary reliability analysis of the provider forms were promising for the overall scales (Provider α = 0.73). For the provider form, estimates for four subscales (50%) met the criteria for good or excellent reliability (≥.80). Four (50%) fell below .70. The results prompted further review and revision of items within the poorer performing subscales.

  • Boel-Studt, S., Huefner, J. C., & Huang, H. (2019). The group care quality standards assessment: A framework for assessment, quality improvement, and effectiveness. Children and Youth Services Review, 105, Article 104425. https://doi.org/10.1016/j.childyouth.2019.104425

    Sample:

    Participants: Licensing specialists (37 forms), youth (72 forms), case managers and placement coordinators (78 forms), and group home directors and direct care workers (116 forms) from 37 group homes in two regions in Florida

    Race/Ethnicity — Not specified

    Summary:

    The reliability of the Quality Standards Assessment was examined in an implementation pilot study through Cronbach’s alphas, which were calculated for all eight scales for the form (Group Care Provider α = 0.46–0.81). Cronbach’s alphas for two scales were below acceptable for the Monitor & Report Problems scale (α = 0.46) of the group home directors/direct care worker form.

  • Boel-Studt, S., Huefner, J. C., & Dowdy-Hazlett, T. (2025). Validity of the Quality Standards Assessment for children’s residential care. Residential Treatment for Children & Youth. 43(2), 272–295. https://doi.org/10.1080/0886571X.2025.2460832n

    Sample:

    Participants: Factorial validity study: 1,407 QSAs were completed by youth (n = 450), state licensing specialists (n = 152), lead agency personnel (n = 183), residential program directors (n = 172), and direct care specialists (n = 450) from 169 residential programs in Florida. Convergent validity study: youth (n = 328), lead agency personnel (n = 137), direct care specialists (n = 302), directors (n = 224), and licensing specialists (n = 159) in 159 residential programs. Concurrent Validity study: 98 programs with complete QSA-CCP and QSA-Y data with incident data reported during the same time.

    Race/Ethnicity — Not specified

    Summary:

    The validity of the Quality Standards Assessment was examined using evidence from multiple approaches to evaluating validity (content (see Boel-Studt, Huefner, Bender et al, 2018 above for more details), factorial, convergent, and criterion validity) from a series of pilots and studies carried out from 2016–2022. Factorial validity was examined using confirmatory factor analyses (CFA); all tested models achieved acceptable fit, supporting the eight-factor structure of the QSA-CCP. Convergent validity was examined through the use of single-item indicators (SII). Pearson’s correlation coefficient was used to estimate associations between mean QSA domain scores and domain SII ratings. All correlations were positive, moderate to large, and statistically significant, providing strong overall evidence of convergent validity. Concurrent validity of the QSA was examined through correlations between QSA domain scores and the number of documented incidents and staff turnover. The results support several expected negative associations, collectively providing additional, albeit preliminary evidence of convergent validity. Most consistently, higher mean scores were associated with fewer total incidents, runaway episodes, law enforcement calls, and staff turnover. The results of this research lend preliminary support for the validity of the QSA as a measure of quality residential care for children and youth.