Change in Behavior Rating Inventory of Executive Function (BRIEF)- Self-Report Form (Gioia, Isquith, Guy & Kenworthy, 2000).
This self-report measure has 55 items with seven clinical scales and three validity scales. It is normed for adolescents between 11 and 18 years of age. Items were developed to capture everyday behaviors associated with EF and tap seven domains: Inhibit, Self-Monitor, shift, Emotional Control, Task Completion, Working Memory, and Plan/Organize. The BRIEF is standardized with normative data expressed as T scores (mean=50; SD=10). Internal consistency is high, with index coefficients in the mid .90s to high .90s, while test-retest stability coefficients for the clinical scales ranged from .67-.79 within the standardization subsample. The individual scales and summary indexes were correlated in various clinical samples with other measures of attentional and behavioral functioning (Behavior Assessment Scales for Children, Child Behavior Checklist, ADHD-RS-IV, Conners 3), providing evidence of convergent and divergent validity.
Safety Issue: No
Change in Challenge Task (CT) scores
The Challenge Task is an unpublished, un-normed measure designed by the study staff to measure flexibility and planning in a social context with standardized tasks (Anthony & Kenworthy, 2012). It is a 20-minute play interview that challenges children to be flexible and planful in the context of three activities with an examiner. Specific challenges are posed, and the child's flexibility and planning are scored on a 3-point scale for each task. The scale has task-specific behavioral markers to guide. The CT yields average Flexibility and Planning scores (higher scores indicate greater impairment). Reliability observations will be completed with a second coder for 25% of the videotapes. Examiners in a previous trial achieved interrater agreement >90%, and we will maintain that same standard for the current project.
Safety Issue: No
Change in Wechsler Abbreviated Scale of Intelligence- Second Edition (WASI-II, Wechsler, 2011), block design subtest
The WASI-II is an estimate of intelligence, comprised of four subtests, which takes 30-45 minutes to administer. It is a well-standardized task with normative data for ages 6-90. Subtests include the Block Design subtest, the Similarities subtest, the Matrix Reasoning subtest, and the Vocabulary subtest. Performance on each subtest is represented as a T score (mean=50; SD=10), with higher scores indicating better performance. Overall IQ is calculated from a composite of all four subtests and is represented as a standard score (mean=100; SD=15). The entire WASI-2 will be completed at the Baseline Evaluation to identify full-scale IQ and verbal age (based on the vocabulary subtest). Subsequently, the Block Design subtest only will be completed at the Post-Treatment and Long-term Follow-up Evaluations.
Safety Issue: No
Change in Delis-Kaplan Executive Functioning System (DKEFS; Delis, Kaplan, and Kramer, 2001), Sorting subtest
The DKEFS is a standardized measure of executive functioning skills and in normed for ages eight through adulthood. The Sorting Subtest particularly measures flexibility. The DKEFS will be completed both at the Baseline and, the Post-Intervention Evaluation as measure of outcome. It takes approximately 10 minutes to administer, and although specific data were not available, the measure has been well documented across several neuropsychological studies to have evidence of reliability and validity.
Safety Issue: No
Change in Tower of London-Drexel (TOL-DX; Culbertson & Zillmer, 2000) scores
TOL-DX measures multiple EFs such as planning, inhibition, and working memory. It requires the subject to work step-by-step to copy a pattern of beads on pegs using the least number of moves possible. The total-moves score will be measured as an omnibus measure of EF. Results are reported as standard scores (M = 100; SD = 15).
Safety Issue: No
Change in Adaptive Behavior Assessment System-Second Edition (ABAS-2)
(ABAS-II; Harrison and Oakland 2003) is a measure of adaptive behavior with national standardization samples representative of the English speaking US population. The informant report adult form of the ABAS-2(Harrison and Oakland 2003) used in the present study was standardized on an age stratified sample and provided information in the areas of Conceptual (including Communication, Functional Academics, Self-Direction), Social (including not only Social but also Leisure), and Practical (including Community Use, Home Living, Health and Safety, Self-Care) Skills, all of which are presented as norm-referenced standard scores (M = 100; SD = 15) and were used as correlates of interest in the present study.
Safety Issue: No
Social Responsiveness Scale-Second Edition (SRS-2; Constantino and Gruber 2012)
The SRS-2 is a 65-item informant report of autistic traits rated on a 4-point Likert Scale (0-3 points). Higher scores indicate more autistic traits; T-scores ≥ 65 (i.e., 1.5 SDs ≥ the population mean of 50) suggest clinically significant autistic traits. The SRS-2 scoring is aligned with DSM-5 criteria for diagnosis of an ASD. The update includes the creation of two higher order indices that correspond to the two symptom domains of ASD: Social Communication and Interaction (SCI) and Restricted Interests and Repetitive Behavior (RRB). Informants provided a single SRS-2 rating for each child in this study. The SRS-2 will be completed at Baseline and Post-Intervention testing.
Safety Issue: No
Change in Behavior Rating Inventory of Executive Function, Second Edition (BRIEF-2)- Parent Form (Gioia, Isquith, Guy & Kenworthy, 2015).
This parent-report measure contains 63 items with nine clinical scales and three validity scales. It is normed for children ages 5-18. Items were developed to capture everyday behaviors associated with EF and tap nine domains including: Inhibit, Self-Monitor, Shift, Emotional Control, Initiate, Working Memory, Plan/Organize, Task-Monitor, and Organization of Materials. It is a standardized questionnaire with normative data and standardized scores expressed as T scores (mean=50; SD=10). Internal consistency is high, with index coefficients above .90, while test-retest stability coefficients for the clinical scales ranged from .67-.92 within the parent standardization subsample. The individual scales and summary indexes of the BRIEF-2 were correlated in various clinical samples with other measures of attentional and behavioral functioning (BASC, CBCL, ADHD-RS-IV, Conners 3), which collectively provided evidence of convergent and divergent validity. Safety Issue: No
Flexibility and Planning Interference Scale
To meet the needs of the current study by addressing the issue of flexibility more specifically, we will modify the BRIEF to include 14 additional unpublished, unnormed "Flexibility" and "Interference" items. These items will assess how much flexibility impacts the child's and family's life. The items will use a 0-3 scale (0-No Interference, 1-Mildly interfering , 2-Moderately Interfering, 3- Severely Interfering) and will ask about behavior observed during the past two weeks (example: "How much do difficulties with flexibility interfere with or disrupt everyday activities (self-care, school, etc.?)") Safety Issue: No
The Swanson, Kotkin, Agler, M-Flynn, and Pelham Scale (SKAMP, Swanson, 1992)
The SKAMP is a teacher rating scale that takes 5 minutes to complete and assesses impairment from classroom behaviors associated with executive function in adolescents. Although our study uses a modified form of the SKAMP for which reliability and validity data are unavailable, previous community-based trials of the SKAMP showed evidence of high internal consistency, with reliabilities of .98 for overall SKAMP scores, .96 for Deportment (Behavior), and .95 for Attention. The SKAMP was found to be strongly correlated to both parent and teacher versions of the Swanson, Nolan, and Pelham-IV (SNAP-IV; r = .93 and .79 for Inattention and Hyperactivity/Impulsivity). Teachers rate the severity of 10 common behaviors on a 4-point scale, including 6 items related to attention and 4 items related to problematic behavior.
Safety Issue: No
Classroom Observations
To further assess functional improvement, at least two 15-minute classroom observations will be conducted by an intervention-blind research assistant (who has achieved reliability on coding criteria) for every study participant. They will occur randomly during the academic school day, but not during Flexible Futures small group sessions or Social Skills training. The following behaviors will be coded for children in this study: Reciprocity, Following Rules, Transitions, Gets Stuck, Negativity/Overwhelm, and Classroom Participation. During the classroom observations, the following behaviors will be coded for the teacher's behavior: Flexibility, Planning/Organizing, Provides Clear Instructions/ Expectations, Actively Uses Visual Support, References Classroom Rules, Maintains Positive Praise: Command/Correction ratio and Uses Reward System.
Safety Issue: No
Cognitive Flexibility Task
A task-based fMRI procedure will be used to detect pre-to-post treatment change. Participants will classify pairs of stimuli (objects and pictures) on the basis of how well they "go together" and respond with an appropriate button press. The specific task may change based on pilot results but will be similar to what is proposed.
Safety Issue: No