Evaluation

Child First Evaluation: Highlights of Outcome Data Analysis

Child First collects and analyzes implementation and outcome data on an ongoing basis with the support of the Child First Research and Evaluation Team at the University of Connecticut Health Center (UCHC). 

Child First children and families face many challenges.  In order to understand and measure both problems and strengths at baseline, assessment data is collected on all identified children and their primary caregivers. Outcome data is collected at 6 months and prior to discharge to assess progress and document change.

Baseline data of all children and families served through March 2014 indicates:

  • Trauma: 97.9% of parents had a significant history of trauma (as measured by the Life Stressor Checklist - Revised-LSC-R) and 84.0% of children have experienced significant traumatic events (as measured by the Traumatic Event Screening Inventory - TESI-PRR).
  • Emotional/behavioral problems and social skills: 67.4% of children scored positive for behavior problems (as measured by the Brief Infant-Toddler Social-Emotional Assessment - BITSEA and the Preschool-Kindergarten Behavior Scale - PKBS-2).
  • Social skills/competence: 48.5% of children had impairment in social skills/competence (as measured by the Brief Infant-Toddler Social-Emotional Assessment - BITSEA and the Preschool-Kindergarten Behavior Scale - PKBS-2).
  • Child language delay: 24.9% of children had delays in their language development (as measured by the Ages and Stages Questionnaire-Language - ASQ).
  • Parent-child relationship: 78.3% of parents and children demonstrated significant disturbances in the parent-child relationship (as measured by the Caregiver-Child Interaction Scale - CCIS).
  • Depression: 42.4% scored positive for maternal depressive symptoms (as measured by the Center for Epidemiology-Depression Scale - CES-D).
  • Parent stress: 57.4% of parents scored positive for parental stress (as measured by the Parenting Stress Index - PSI-3 or PSI-4).

Child First data analysis has continued to show strong outcomes in the following areas:

  • Decrease in child behavioral problems

  • Improvement in child social skills

  • Improvement in child language development

  • Strengthening of the parent-child relationship

  • Decrease in maternal depression

  • Decrease in parent stress

The data for the period October 2011 through December 2014 show impressive results among children and families who had documented problems at baseline on a given assessment.

  • The p value or statistical significance of the finding, reflects the certainty that these are real, not chance results. A p<.05 is considered a “statistically significant” finding.  (e.g., p<.05 means that there is a 1 in 20 possibility that this finding was by chance.) In most cases, our p values are p<.0001, meaning that there is only 1 in 10,000 that this finding was by chance.

  • A Cohen’s d or “effect size,” reflects the magnitude or importance of the effect that we have had on the outcome (0.2 is small, 0.5 is moderate, .8 is large, and 1.0 is very large). In most analyses, our effect size is large to very large.

2013 Outcome Report

Overall Improvement:

Data from October 2011 through September 2013 was analyzed to determine if there was statistically significant change in functioning from baseline to discharge scores in those children or parents who presented with problems in each of the key areas targeted for improvement. Further analysis was done to see what percentage of our children and families improved by at least 8% (representing a clinically significant change) in at least one important measure. All scores were converted to T scores for this analysis. 88.6% of children and families showed improvement in at least one area, 69.4% in at least two areas, and 54.1% in at least three areas.

Improvement by Domain:

Among children with problems at baseline:

  • Emotional/Behavioral Problems or Social Competence (measured by BITSEA or PKBS-2):  87.0% improved: 
    • Among those with emotional/behavioral problems only, 66.8% improved (p<.0014, Cohen’s d=0.68)
    • Among those with Social skills/competence impairment only, 74.4% improved (p<.0001, Cohen’s d=0.97)

  • Language Development (measured by ASQ):
    • 77.8% improved, with Cohen’s d of 1.06 and p<.0001
  • Developmental problems in any domain of the ASQ:
    • 98.8% improved

Among mothers with problems at baseline:

  • Maternal Depression or Stress:
    • 80.0% improved on maternal depression (p<.0001, Cohen’s d 1.07)
    • 85.9% improved parenting stress (measured by the PSI) (p<.0001, Cohen’s d=1.00)

Among parent-child dyads with problems at baseline:

  • Parent-Child Relationship (using CCIS):
    • 79.9% improved (p<.0002, Cohen’s d=1.12)