Peer Interventions for Preschoolers With Autism (PIPA)

Examining Adaptive Peer-mediated Interventions for Preschoolers With Autism Spectrum Disorder and Limited or no Spoken Language: A Sequential Multiple Assignment Randomized Trial

This proposal will evaluate a series of peer-mediated interventions (PMIs) for preschool children (3 to 6 years) with ASD and limited or no spoken language, using an innovative Sequential Multiple Assignment Randomized Trial (SMART) design. Available evidence supports the beneficial effects of PMIs for improving social communication in children with ASD. Peer-related social competence is vital to a wide range of child outcomes, such as improved communication and fewer behavioral problems. Unfortunately, approximately 30% of children with ASD remain minimally-verbal in kindergarten, restricting participation in inclusive activities. Recent studies report improved communication after a speech-generating device (SGD) is included in treatment. Effective interventions that can be modified is necessary to ensure optimal communication outcomes when children do not make anticipated progress. A strength of the study is that these interventions can be adopted by community-based, early service providers. All participants will receive an adapted Stay-Play-Talk (SPT) peer-mediated intervention that varies in active ingredients. With SMART designs, it is possible to test and identify alternative combinations of PMI approaches, such as the addition of a SGD. In this study, 132 preschoolers with ASD (and N=264 peers without disabilities) will be initially randomized to SPT and SGD with spoken peer input only (SPT Basic; peers taught to model language) or SPT and SGD with augmented peer input (SPT Plus; peers taught to use verbal language models concurrently with the SGD). Each child's response to treatment after 5 weeks will determine that child's next phase in the SMART design. Children showing a positive response will continue in their originally assigned group; slow responders will be randomly assigned to receive added treatment components to improve communication (either SPT Plus or SPT Advanced). SPT Advanced adds direct instruction strategies (i.e., adult prompts, reinforcers, and teaching trials) to increase child vocalizations in SGD interventions. The use of a SMART design extends our prior work by testing the systematic addition of selected peer-mediated strategies in combination with an SGD that allows for flexible application of interventions based on child response. The investigators have assembled an outstanding team of highly qualified investigators with complementary skills in preschool assessment, language intervention, clinical trials, and statistics.

The research questions in this proposal will be evaluated using a Sequential Multiple Assignment Randomized Trial (SMART). This design allows for evaluation of adaptations to interventions based on a tailoring variable that triggers early or slow child response status at an important decision point - in this study, 5 weeks after start of treatment. Children showing a positive response continue in their originally assigned group; those who are slow responders will be re-randomized to receive added treatment components to improve communication (i.e., either SPT Plus or SPT Advanced). The proposed study will include two research sites, with N=132 preschoolers with ASD (ages of 3-6 years), and up to N=264 peers recruited through (1) Juniper Gardens Children's Project, University of Kansas, and (2) the Marcus Autism Center, Emory University. The investigators plan to recruit 66 children with ASD per research site in five cohorts over five years. Two peers without disabilities will be recruited for each child (N=264). Four measures will be administered at enrollment: (1) the Autism Diagnostic Observational Schedule-2, (2) the Preschool-Language Scale-5 to assess children's expressive and receptive language, and (3) the Mullen Scales of Early Learning to assess verbal and nonverbal cognitive skills, and (4) the Aberrant Behavior Checklist. SGD Access and General Procedures. All children will receive an iPad with Touch Chat app as an SGD to use for the duration of the study. If a child has an SGD, it will be used. The investigators will recommend SGD access across the school day. The investigators will track any concurrent therapies (e.g., speech, behavior therapy) the child receives. Each focal child's caregiver will be asked to complete a preference assessment e.g., toys, TV shows), with monthly monitoring to identify highly preferred stimuli. Prior to baseline, participating school staff will attend a 1-hour training on: (1) study timeline and expectations, (2) peer recruitment, (3) setting up child-preferred activities, and (4) programming the iPad. A minimum of four communicative functions (i.e., request, comment, gain attention, or protest) will be programmed on each vocabulary page on the iPad. The investigators will work with school staff to create symbol vocabularies based on individualized education plans. School staff will not be aware of group assignment at the time of training and will be informed after baseline data are collected. Baseline Procedures. The investigators will schedule three baseline observations. One child with ASD and one peer will be at a table for a 10-min play activity over three different days. Children will be instructed to stay together and play, with the iPad programmed to match the play activity. No adult prompts are provided. Design. The research questions will be evaluated using a Sequential Multiple Assignment Randomized Trial (SMART) design. This design allows for evaluation of first and second stage adaptations to interventions based on a tailoring variable that triggers early or slow child response status at an important decision point - in this study, 5 weeks after the start of treatment. Participants (N=132 preschoolers with ASD) will be initially randomized to Stay-Play-Talk (SPT) with spoken peer input only (SPT Basic; peers taught to model language) or SPT and SGD with augmented peer input (SPT Plus; peers taught to use verbal language models while selecting SGD icons). Each child's response to treatment after 5 weeks will determine that child's next phase in the SMART design. Children showing a positive response will continue in their originally assigned group; those who are slow responders will be randomly assigned to receive added treatment components to improve communication. SPT Advanced adds direct instruction strategies (i.e., adult prompts, reinforcers, and teaching trials). Follow Up Procedures. At Week 20 (5 weeks post treatment), all primary and secondary child communication variables will be collected during three 10-min play sessions with activities similar to baseline and no adult prompts. Similar models will determine if differences due to treatment arm or experiencing augmented input are maintained at the 20-week follow-up direct observations. Child Predictors to Treatment Response. The investigators will explore if child variables (i.e., receptive language, nonverbal intelligence, and peer engagement) assessed at baseline predict peer-directed communication gains in response to first stage PMI after 5 weeks of treatment and adapted PMI treatments after 15 weeks of treatment for all children regardless of condition, as described in the Statistical Design plan. Fidelity Procedures. Treatment fidelity will be monitored for (1) adult implementation of peer training, (2) peer implementation with focal child, and (3) staff implementation of steps for each PMI condition. To monitor adherence to the treatment protocol and identify peers or implementers who may need more support, fidelity will be collected for 25% of randomly selected treatment sessions in all treatment stages. If a peer or implementer falls below 70% fidelity over two sessions, a 20-min refresher session will be provided. Coding Communication Variables. All peer-directed communication and engagement variables will be primary coded from videos at the KU research lab to minimize potential site differences, using Noldus Observer XT software. Two KU research assistants will be primary coders and deemed reliable after achieving 80% inter-rater reliability with the PI or project coordinator (PC) on a minimum of three gold standard vignettes across child initiations and responses, communicative functions and modalities, and reciprocal exchanges; one student assistant will be kept blind to condition and code 30% of sessions for reliability. This coder will also be trained to transcribe language samples using Systematic Analysis of Language Transcripts (SALT) for total number of different words, mean length of utterance, and unique word combinations. During Week 5, coding of child communication to determine responder status will occur within three days for timely decision-making to re-randomize children to second stage treatment. Training on CGI-I. Drs. Scahill and Boyd will train independent evaluators (IEs) at each site on the CGI-I and Parent Target Problem narratives using clinical vignettes. Training will include presentation of a clinical vignette to illustrate interpretation of frequency counts of spontaneous peer-directed communication, PTP narratives and scores on the Aberrant Behavior Checklist (ABC) subscales (Irritability, Social Withdrawal, Hyperactivity) rated by the child's teacher. Given that the CGI-I is a key secondary measure, the investigators will set rigorous standards for agreement with gold standard ratings established by Drs. Scahill and Boyd (perfect agreement on 3 and within one unit on the fourth). The CGI-I resolves to a dichotomous outcome: positive (Much Improved or Very Much Improved) or negative response (all other ratings). Therefore, a disagreement by one unit on the CGI-I is acceptable if it would not affect classification on treatment response. An IE who does not meet reliability criteria will receive additional training and given additional vignettes to achieve reliability. Following training to reliability, Dr. Scahill will review the PTP baseline narratives for the first 10 subjects at each site and provide feedback to the IE. Drs. Scahill and Boyd will convene monthly review sessions. On a rotating basis, IEs will present the CGI-I scores on completed cases, as well as the clinical material that formed the basis of the CGI-I ratings. The purpose of these review sessions is to foster a common approach to scoring the CGI-I. Interobserver Agreement. The KU project coordinator will train two research assistants (RAs) kept blind to treatment condition, to a criterion of 80% interobserver agreement for all primary and secondary child variables using the gold standard videos created to train primary coders. The RAs will be considered reliable once they meet 80% interobserver reliability across variables on three different videos. A minimum of 30% of videos will be randomly selected for reliability coding from each of the four measurement periods, for both research sites. Data Analyses. A series of multilevel models with occasions nested within children will be used to compare changes in peer-directed communication and other language outcomes from baseline to Week 5 in children randomly assigned to the SPT Basic condition with changes in children assigned to the SPT Plus condition (Aim 1a). The investigators will also compare changes in outcomes over the 15 week two-stage intervention for non-responders in each of the four adaptive interventions. Planned pairwise comparisons will enable us to examine which condition/s were most effective at eliciting a treatment response (Aim 1b). Because The investigators are especially interested in the impact of SPT Plus, the investigators will determine whether experiencing that intervention - regardless of the stage - has an impact on intercepts or slopes for child communication and language outcomes. Finally, the investigators will use t-tests to compare baseline predictor variable levels for children identified as early responders or slow responders at Week 5. The investigators will also determine if early and slow responders at Week 15, the end of intervention, differ in baseline predictor characteristics. The second way the investigators will evaluate the predictor variables is to determine if any of them are related to intercept and slopes when treatment group is not a part of the model. More details about the modeling process and a basic equation are provided in the Statistical Design and Power data analysis plan. Missing data and Power. Maximum likelihood estimation will be used to include all available data in a multidimensional likelihood function such that no imputation will be needed. Power simulation conducted within SAS indicates that there is ample power for the models to be conducted in Aims 1a, 1c, and 2. While Aim 1b is more limited in power, the parameter estimates obtained from these models are crucial for taking the next steps in developing adaptive interventions for this population. Power curves are provided in the data plan. Potential Problems and Strategies. It is possible that some preschool-age peers may have difficulty implementing procedures with adequate fidelity. The investigators are confident that our comprehensive peer recruitment criteria, prior peer implementation fidelity average of 80% (based on fidelity data from 235 treatment sessions), and using similar procedures to provide booster training as necessary all support the feasibility of the planned peer training component. It is possible that some children with ASD will attend the same preschool. If this occurs, the investigators will ensure that school staff do not discuss what condition they are in and implement treatment in different locations. Joint lab meetings will be conducted twice per month, with close monitoring of treatment conditions to ensure a high-level of implementation fidelity for adults and peers. The PI will monitor data collection and entry to ensure it is aggregated consistently across sites.

Children with ASD and peer partners will be randomized to a first stage Stay-Play-Talk (SPT) Basic speech generating device (SGD) intervention with spoken peer input only (i.e., peers taught to model language) or SPT Plus intervention with augmented SGD peer input (i.e., peers taught to use verbal language models concurrently while selecting SGD icons). Each child's response to treatment after 5 weeks will determine that child's next phase in the SMART design. Children showing a positive response will continue in their originally assigned group. Children who are slow responders after 5 weeks, will be randomly assigned to receive added treatment components, either SPT Plus or SPT Advanced. SPT Advanced adds direct instruction strategies for the children with ASD (i.e., adult prompts) to increase peer-directed communication.

In addition, we will have a blind coder who will code child-peer communication as an outcome measure.

After being randomly assigned to the SPT Basic condition, these participants responded and therefore remained in this condition

After being randomly assigned to the SPT Basic condition, these participants did not respond but were randomized to stay in this condition to examine longer duration in this treatment.

After being randomly assigned to the SPT Basic condition, these participants did not respond and were randomized to Stay_Play_Talk Plus in the second stage.

After being randomly assigned to the SPT Plus condition, these participants responded and therefore remained in this condition

After being randomly assigned to the SPT Plus condition, these participants did not respond and were randomized to Stay_Play_Talk Plus in the second stage.

After being randomly assigned to the SPT Plus condition, these participants did not respond and were randomized to Stay_Play_Talk Advanced condition in the second stage which incorporates direct instruction.

Stay-Play-Talk (SPT) Basic and SGD with augmented peer input in which peers are taught to model verbal responses while simultaneously selecting screen icons with spoken peer input only (i.e., peers taught to model language)

SPT Plus with augmented SGD peer input (i.e., peers taught to use verbal language models concurrently while selecting SGD icons).

SPT Advanced adds direct instruction strategies for the children with ASD (i.e., adult prompts, reinforcers, and embedded teaching trials) to increase peer-directed communication.

Change in the rate per minute of peer-directed communication acts are defined as intentional communication acts that are clearly directed to a peer using eye contact/body orientation for a functional purpose (e.g., to request objects/actions, comment, or protest) and may include any communicative modality (i.e., vocalizations gestures, speech, and SGD). Trained coders will code communication acts for child-peer baseline and intervention videos using Noldus Observer XT measurement software.

Rate of change in reciprocal social exchanges per 30-min of child-peer social interaction are defined as a one turn exchange between the child and peer and must include a minimum of one initiation and one response, independent of who starts the interaction.

Total number of child's unique word combinations at each measurement point coded using Systematic Analysis of Language Transcripts

The metrics included in the Parent Target Problem Narratives (e.g., frequency, duration, and immediate impacts of parental concerns) will be used to develop a new narrative reflecting the child's current behavior (baseline) and at 15 and 20 weeks to inform the Clinical Global Impression-Improvement scale. The Parent Target Problem narratives will focus on parent identified behaviors at baseline; the interview and narratives will not include parental comments on improvement (e.g., much better) or parental estimates of severity (i.e., no rating scale).

The Clinical Global Impression-Improvement scale is a 7-point scale designed to measure overall improvement in clinical ASD symptoms from baseline. Scores range from 1 (Very Much Improved) to 4 (Unchanged) to 7 (Very Much Worse). Positive response is defined by a rating of Much Improved or Very Much Improved.

Inclusion Criteria: ASD diagnosis limited or no spoken language defined by less than 20 functional, spontaneous words currently using or a candidate for a speech-generating device access to peers without disabilities English as the primary language spoken at home Exclusion Criteria: co-morbid or major medical conditions other than ASD, based on caregiver and teacher report significant physical, sensory, or motor impairments that would prevent playing with another child uncorrected visual or hearing impairments that would cause difficulty following peer instructions a lack of symbol discrimination skills