QSLA Evaluations

Quality Start Los Angeles (QSLA) is Los Angeles’ (LA) county-wide Quality Rating and Improvement System (QRIS) designed to empower early learning providers to build upon and improve the quality of care they provide to children birth to five.

Like the early learning providers who participate in QSLA, we are driven by the desire to continuously evaluate and improve the quality of the offerings we provide. Our goal is to share the processes, reports, and data on the elements of QSLA we have evaluated, as well as the ways we have modified our collective-impact model as a result of these findings.

QSLA Developmental Evaluation (2019 – Ongoing)

In November 2018, First 5 LA contracted with the RAND Corporation to conduct a developmental evaluation of selected QSLA components. The primary goal of the developmental evaluation is to generate real-time, actionable information that will inform modifications to the QSLA model and/or implementation as it is expanded in L.A. County. The research is being conducted in two waves, with the project expected to be completed by June 30, 2020. 

The evaluation focuses on: 

  1. The assessment process and assessment technical assistance
  2. QRIS tier ratings
  3. Coaching

Data collection activities include:

  • Administrative data analysis 
  • Focus groups with QSLA providers, coaches, and assessment technical assistance providers
  • Interviews with QSLA stakeholders
  • Landscape analysis of non-QSLA early childhood coaching agencies in L.A. County that also serve QSLA providers
  • Online survey of QSLA providers
  • Observations of coaching sessions

Throughout the ongoing developmental evaluation, emerging results and recommendations are provided to QSLA stakeholders as they work to build a sustainable quality improvement model for L.A. county. 

At the end of the study, RAND will prepare a public final report, a research brief, and public presentations that detail the developmental evaluation process, findings, and recommendations.

Key takeaways:

Developmental Evaluation Resources

QSLA Formative Evaluation (2017)

In 2017, QSLA contracted with Juárez and Associates, in collaboration with Gary Resnick, Ph.D., to conduct a formative evaluation to understand experiences and perceptions of providers participating in a prior QRIS and/or QSLA, the level of collaboration between implementing partners, and QSLA’s family engagement models and outcomes.

The evaluation focused on:

  1. Site quality, tier rating distribution, and trends
  2. QRIS provider experiences & perceptions (current participants and non-participants)
  3. Collaboration and partnership among implementation partners of QSLA consortium in order to measure the perceived quality of the working relationship between partners
  4. QSLA’s family engagement models and outcomes

Data collection activities included:

  • Administrative data analysis 
  • Focus groups of providers
  • Interviews with implementation partners, family engagement providers, and coaches
  • Literature reviews 
  • Online survey of QSLA coaches, providers, and implementation partners

The results of the the provider perception study were used to improve the QSLA orientation, assessment and rating processes, coaching supports, professional development offerings. The results from the collaboration study were used to refine the governance structure, communications methods, and data sharing agreements. Finally, the results of the family engagement study served to enhance QSLA’s family engagement strategies in accordance with best practices.

Key takeaways:

Formative Evaluation Resources

QSLA Process Evaluation (2016)

In 2016, QSLA contracted with Helen Chavez Consulting Group to conduct a process evaluation designed to obtain input from QRIS administrative agencies and California State Preschool Program (CSPP) administrators about QSLA’s implementation.

The evaluation focused on:

  1. The enrollment of CSPP providers
  2. The incentives QSLA offers to participating providers
  3. The collaborative process between QSLA implementation partners

Data collection activities included:

  • Administrative data analysis
  • Focus groups with CSPP Program Directors
  • Interviews with QSLA Leadership Team members
  • Online survey of CSPP Program Directors

The results of the process evaluation informed improvements in QSLA’s approach to provider onboarding, enrollment, incentives, and collaboration amongst QLSA implementation partners.

Key takeaways: