Skip to main content
Skip to main content

Studies

Project Title: PIE Study - Cross-sectional and Longitudinal Study of Component Processes for Comprehension

Lead Investigators: Christopher Lonigan and Richard Wagner

Timeline: 2010 – 2012 extended to 2015

Project Purpose/Goals:

  • To determine the relative association between underlying cognitive and linguistic processes and comprehension (both oral and reading where possible),
  • To determine if the relative contribution of these cognitive and linguistic processes to comprehension changes with children’s age / grade level,
  • To determine if the relative contribution of these cognitive and linguistic processes to comprehension changes with children’s developmental level (does the influence of one skill depend on the level of another skill?)

Research Design: The PIE study employed a longitudinal design. Students in grades Pre-kindergarten through 5th grade were tested on 18 cognitive and linguistic factors at multiple time points across several years. During the first year of the study, students completed a large battery of assessments. The students in preschool, first grade, and third grade were followed each year for two years to assess the latent constructs the study was attempting to measure. Based on the results from the first wave of assessment, fifth grade students were included in the follow-up phases of assessment. Furthermore, based on the increasing complexity of reading dimensions revealed in the preliminary analysis, two waves of follow-up testing were added thus providing five longitudinal data points.

Setting and Participants: Students were recruited from a diverse group of school districts in five north Florida Counties. During the two recruitment years, 1,839 students were consented and assessed (Pre-K n = 343, Kindergarten n = 236, 1st grade n = 295, 2nd grade n = 228, 3rd grade n = 280, 4th grade n = 231, 5th grade n = 226). Of the 1,144 students eligible to participate in the follow-up assessments (preschool, 1st, 3rd and 5th graders), 89% were located and assessed in the first follow-up year and 83% in the second follow-up year.

Measures: For each of the 18 constructs, the measurement battery included at least three representative measures (either standardized or researcher constructed). To address the concern of the size of the assessment battery for each student, a missing-by-design approach was used to reduce the testing time and time away from the classroom. In short, not every student completed every measure. Children were randomized to one of four conditions, created by randomizing construct clusters, which varied in the number of measures that were administered. Within each of the four assessment conditions, the order of tests were also varied to reduce the effect of any possible testing-order effects in the final analysis. Finally, for each of the follow-up administrations, the students were randomized to an assessment condition.

  • Listening Comprehension
  • Reading Comprehension
  • NonVerbal/Performance IQ
  • Memory (Span)
  • Working Memory
  • Phonological Awareness
  • Receptive Vocabulary
  • Expressive Vocabulary
  • Receptive Syntax/Grammar
  • Expressive Syntax/Grammar
  • Depth of Vocabulary Knowledge
  • General/Background Knowledge
  • Word Decoding
  • Reading Fluency
  • Orthographic Knowledge
  • Morphological Awareness
  • Narrative/Story Structure
  • Inference

Key Outcomes: One of the outcomes of the PIE study demonstrated that the distinctness of different components of reading (i.e., decoding vs. comprehension) is a developmental process. Findings indicated that a clear component representing comprehension does not emerge until third grade. Another finding was that relatively few children have substantial difficulties with comprehension that can be attributed to a single skill domain. Thus, the majority of children who struggle to understand what they are reading will need instructional support for both decoding and comprehension skills in order to increase their capacity to read with understanding.

The Basic Science Studies focused on understanding critical elements of cognitive and linguistic processing at the word, sentence and text level. Methods used in these studies included both traditional and novel approaches (such as tracking of eye movements) that was used to study both conscious and ‘under the hood' processes. Researchers examined how information was processed during reading; the role of inhibitory processes, attention regulation, and sensorimotor activity during comprehension; understanding in relation to contextualization; dialect awareness; meta-cognitive processes; and semantic connections in relation to comprehension monitoring.

Project Title: PIE – Tracking; Eye tracking Study

Lead Investigators: Ralph Radach and Christopher Lonigan

Timeline: 2010 – 2014

Project Purpose/Goals: 

  • To provide a detailed description of the natural reading behavior at each grade level (1st – 5th grade) within the combined cross-sectional longitudinal design study (PIE).
  • To provide insight into individual trajectories of both silent- and oral- reading development.

Setting and Participants: A sub section of students from the PIE study; approximately 50% of the 1st through 5th graders (1st graders n = 147, 2nd graders n = 113, 3rd graders n = 137, 4th graders n = 112, 5th graders n = 112) for a total of 620 students.Research Design: The eye tracking component was focused on examining online information processing during reading for comprehension. It was administered in three separate sessions. Session one consisted of 50 trials of silent sentence reading and sentence scanning. Session 2 consisted of silent paragraph reading and paragraph scanning. Finally, session three consisted of 50 trials of reading sentences aloud and vision screening.In the sentence reading tasks, students were directed to read single-line sentences with controlled target word material. The exact same sentences were used across all grades in order to track developmental changes independent of grade differences in reading material. The reading-like scanning task served to approximate the attentional and visual-motor demands of reading without adding an additional linguistic workload.

Measures: The eye tracking measures included paragraph reading, sentence reading (silent and aloud) and the Landolt scanning task. The paragraphs were selected from the Florida Assessment for Instruction in Reading (FAIR) passages selected from the FAIR Oral Reading Fluency (ORF) toolkit. The extracted eye movement parameters were correlated with the off-line assessment data (listed under the PIE study) to evaluate performance of struggling readers as well as their response to specific interventions.

Key Outcomes: Preliminary analysis of the sentence level reading tasks revealed significant influences on reading time of word length and word frequency whose effects were moderated by the students’ level of decoding skills. Also, the part of the moment-by-moment of reading that is associated with comprehension; i.e., reading time, is primarily predicted by the students’ reading comprehension skill and not by the size and depth of their vocabulary.


Project Title: Semantic Relations & Comprehension Monitoring – Project 8

Lead Investigator: Ralph Radach

Setting and Participants: A subgroup of students from the PIE study during the follow–up phase of the study.

Measures: Using the eye-tracking machines, four studies of 5th and 7th graders (5th grade students from the second year of follow-up from the original PIE study) manipulated parts of text to yield changes and challenges in students on-line processing of text. The four parts of text were a) verb-agent inferences, b) semantic plausibility, c) passage topic monitoring, and d) complex causal relations. Students in the sample also completed a battery of standardized reading and vocabulary tests.

Key Outcomes: Results indicated that comprehension monitoring strategies can be observed within a single sentence. Causal inconsistencies were detected and lead to increased refixation durations, which resulted in large increases in re-reading of the initial parts of sentences. This indicated attempts by the reader to establish coherence. Another finding was that text difficulty influences students’ moment-by-moment reading of text.


Project Title: Inhibitory Control and Comprehension

Lead Investigators: Michael Kaschak and Christopher Lonigan

Project Purpose/Goals:

  • To examine the relation between inhibitory control and language comprehension,
  • To examine the relation between multiple linguistic and non-linguistic measures of inhibitory control,
  • To examine the relation of the linguistic and non-linguistic measures to other measures of comprehension ability.

Setting and Participants: A subgroup of students from the original PIE study (Pre-K n = 146, Kindergarten n= 113, 1st grade n = 138, 2nd grade n = 112, 3rd grade n = 139, 4th grade n = 113, and 5th grade n = 115 for a total of 876).

Research Design: The construct of interest in this project was inhibitory control. The element of this construct, along with executive function, that was of most concern for this study was children’s abilities to attend selectively to specific elements of a situation, (while ignoring others) to perform a task. The participating students were administered six computer-based tasks designed to measure different aspects of inhibitory control.

Measures: 

  • 4 General Inhibitory Control tasks: Animal Stroop, Fruit Stoop, Color Matcher, Flanker Task
  • 2 Specifically related to Inhibitory Control in Language Processing: Put Task and Word Repeating

Key Outcomes: Despite extensive pilot testing, some tasks yielded inconsistent data quality during the initial data collection phase, which has made it difficult to complete data analysis for this component of the project. Because of these technical problems, a number of modifications were made to the tasks for the follow-up data collection phase. Analysis and interpretation of these data is ongoing.


Project Title: Implicit Learning & Comprehension

Lead Investigator: Michael Kaschak

Project Purpose/Goals:

  • To examine the hypothesis that implicit learning is a key contributor to language comprehension,
  • To assess the extent to which variation in implicit learning ability in students is related to variation in their language comprehension ability.

Setting and Participants: The same subgroup of students from the original PIE study who were part of the inhibitory control and comprehension study (Pre-K n = 146, Kindergarten n= 113, 1st grade n = 138, 2nd grade n = 112, 3rd grade n = 139, 4th grade n = 113, and 5th grade n = 115 for a total of 876).

Research Design: The participating students were administered three computer-based tasks designed to measure aspects of implicit language learning.

Measures: 3 Computer-based tasks:

  • Simon Task
  • Word Segmentation Task
  • Picture Description Task

Key Outcomes: Analysis and interpretation of these data is ongoing.


Project Title: Inference Study

Lead Investigator: Christopher Lonigan

Project Purpose/Goals:

  • To examine whether associations between specific abilities (i.e., abilities related to text memory, text inferencing, knowledge integration, and knowledge access) are associated with comprehension of text and spoken language or if that association is non-specific,
  • To determine if similar processes of knowledge integration and access are related across oral and text-based presentations,
  • To identify how different components of knowledge integration and access are associated with reading comprehension and general language skills.

Participants and Setting:

Research Design: Students were administered two computer-based tasks that consisted of reading or listening to two- to three-sentence paragraphs describing the relations between a set of real and made-up terms. The students were then asked a series of true-false statements to assess the degree to which they were able to 1) access and integrate information from their existing knowledge base with the information provided in the sentences, 2) use their knowledge base along with the provided information to make inferences, and 3) recall the information presented in the sentences.

Measures:

  • 2 computer-based tasks: one text-based and one oral-language-based task
  • Standardized measures of reading comprehension, listening comprehension, and vocabulary

Key Outcomes: Preliminary analysis indicated a complex pattern of relations between types of inferencing, with limited evidence that responses to the different types of questions coalesce into the categories outlined by Hannon and Daneman (2001) and Hannon and Frias (2012). These analyses also provided little evidence that there was cross-modality consistency of knowledge integration and access across oral and text-based presentations.


Project Title: English-learner Study: RFUEL

Lead Investigator: Christopher Lonigan

Project Purpose/Goals: The goals of this project were to develop and validate both a comprehensive assessment instrument and a screening measure for Spanish-speaking ELL preschool children’s early literacy skills (SPELA: Spanish Preschool Early Literacy Assessment). A primary design goal of this measure was that it would be appropriate for Spanish-speaking ELL children regardless of Spanish language dialect variations to which they are exposed. The domains included in the measures included: Definitional Vocabulary, Phonological Awareness, Print Knowledge, and Invented Spelling.

Setting and Participants: The RFUEL study drew its population from two completed studies. One was a large-scale measurement development study in which children’s oral language, early literacy, and reading skills were measured in both English and Spanish. These were preschool through first grade Spanish or English-learner students. The second study was a large-scale intervention study that examined the efficacy of a preschool curricula on the pre-academic skills of Spanish-speaking English-learner students also in preschool, Kindergarten and 1st grade. Students were in grades two through fourth when they were located and re-consented for this study.

Measures: A reduced PIE- assessment battery focusing on: decoding, reading comprehension, and oral comprehension

Key Outcomes: Analyses and interpretations of findings for these data are ongoing.

Lead Investigators: Most of the project's key personnel were involved in phases of these studies. The key personnel most associated with these studies included: Kenn Apel, Stephanie Al'Otaiba, Carol Connor, Young-Suk Kim, Christopher Lonigan, Beth Phillips, and Shurita Thomas-Tate.

Timeline: 2010 – 2012

Purpose: To accelerate the development of promising interventions, 10 design studies and, for some of the interventions, small-scale randomized trials, were conducted over the first two years of the project. The content for the developed interventions was based on several cognitive and linguistic components for which there was already substantial evidence of their role in supporting comprehension: semantic knowledge, syntax, comprehension monitoring, background knowledge, strategy use, text structure, and morphological awareness.

Across the two-year period seven distinct interventions were developed and field-tested in these design studies. Each included primary and secondary instructional targets (e.g., vocabulary, morphological awareness, expository text structure). All but two of these interventions (Content Area Literacy Instruction, CALI and Dialect Awareness Study, DAWS), were designed as small-group, pull-out interventions for children demonstrating risk of, or already displaying, reading difficulties. The five other new small group interventions are described in detail under Comparative Efficacy I.

Lead Investigators: Kenn Apel, Stephanie Al'Otaiba, Carol Connor, Young-Suk Kim, Christopher Lonigan, Beth Phillips, Chris Schatschneider, and Shurita Thomas-Tate.

Timeline: 2012 – 2015

Purpose: Given preliminary results from the multivariate study of components of reading comprehension, which indicated that there was less distinction between potential component language skills that could contribute to reading comprehension, the component interventions developed to promote foundational skills (i.e., syntax, narrative, morphological awareness, text structure) were tested in a comparative efficacy study to identify which interventions produced large effects, effects that generalized across multiple domains of language skills, or both. Children who were identified as at risk for comprehension difficulties in grades Pre-K to 4 were randomly assigned to one of the interventions developed for their grade level or to a business-as-usual control group. Specific grades and eligibility criteria were applied for each study.


Project Title: Reading for Understanding, Comparative Efficacy I

Lead Investigators: Christopher Lonigan, Beth Phillips, Carol Connor, & Young-Suk Kim.

Type of Study: Efficacy

Timeline: Year 3 - 2012-2013

Project Purpose/Goals:

  • To determine the degree to which interventions designed to influence specific language components have impacts on broader measures of language-related processes,
  • To identify the underlying processes that contribute to successful text comprehension and comprehension for the purpose of learning,
  • To rapidly develop appropriate interventions and determine which are effective for students with varying skill constellations,
  • To test the efficacy and usability of such interventions.

Setting and Participants: The sample consisted of 3,702 students in Pre-kindergarten through fourth grade with vocabulary scores below the 48th percentile according to pre-intervention screening. Students were matched within school and randomly assigned to interventions (up to 4 possibilities per grade) or a business-as-usual control group within their grade.

Research Design: Five new interventions were designed and implemented in Pre-kindergarten through fourth grade. A slightly expanded version of Dialogic Reading, DR-Extended (DR-E) was added to the preschool interventions because it is a vocabulary intervention with known positive effects for this age group, and it provided a useful counterfactual against which to compare the other two preschool interventions. Each intervention was intentionally designed to be modular – focusing on just one or a few primary language skills (vocabulary, grammar, narrative). During Comparative Efficacy I, 3 to 5 interventions were directly competed against one another to examine which particular one would be most effective in each grade. Interventions were implemented by trained research personnel in small groups of 3 – 5 students.

Measures: The following are the assessments used in the study:

  • EOW - The EOWPVT-4 tests an individual’s ability to name, with one word, objects, actions, and concepts when presented with color illustrations.
  • OWLS - The Listening Comprehension scale is designed to measure the understanding of spoken language.
  • WJLW - Naming letters and reading words aloud from a list.
  • TOSREC - The Test of Silent Reading Efficiency and Comprehension
  • GATES Reading Comprehension - The Comprehension test evaluates students' abilities to understand extended written text.
  • CASL Syntax Construction – Correctly provides a grammatically correct response for a sentence.
  • CELF Concepts and Following Directions - evaluates the student’s ability to interpret, recall, and execute oral commands of increasing length and complexity.
  • CELF Expressive Vocabulary - evaluates the student’s ability to name illustrations of people, objects, and actions (referential naming).
  • TOWRE - The Test of Word Reading Efficiency–Second Edition is a measure of an individual’s ability to pronounce printed words (Sight Word Efficiency) and phonemically regular non-words (Phonemic Decoding Efficiency) accurately and fluently.
  • Test of Narrative Language - Measures the ability to answer literal and inferential comprehension questions about narrative text.
  • Inconsistency Detection Task (created by Young) – Short scenarios with one inconsistent sentence, which the student is challenged to identify.
  • WJAK - Oral questions about factual knowledge of science, social studies, and humanities.

Intervention Description: There were 6 interventions: COMPASS, ERC, LIM, MAT, TEXTS, and DR-E (adapted from existing Dialogic Reading interventions). Different interventions were administered in different grades: in pre-K – COMPASS, LIM, DR-E; in K, G1 and G2 – COMPASS, LIM, MAT, TEXTS; in G3 – COMPASS, LIM, ERC; in G4 – ERC, TEXTS. Interventions lasted 8 to 12 weeks, each for 25 minutes 4 days per week, conducted in the form of pull-out small group instruction, by trained project personnel with range of knowledge and credentials.

  • Comprehension Monitoring and Providing Awareness of Story Structure (COMPASS): The purpose was to improve students’ listening comprehension by enhancing listening comprehension monitoring and awareness of narrative structure elements. Students were helped to identify characters, setting, events, problems and resolutions within narrative structures and understand how these elements aid in better comprehension.
  • Enacted Reading Comprehension (ERC): The purpose was to improve students’ reading comprehension for persuasive, expository, and narrative texts by introducing students to the idea of sensorimotor simulation. There is a growing body of evidence suggesting that language is understood by constructing internal sensorimotor simulations of the events that are being described. Students were introduced initially to the idea of using their hands to simulate the content of science books that describe the operation of opposing forces. This idea was extended into the use of hands to simulate the internal struggles of the characters in a novel.
  • Language in Motion (LIM): The purpose was to improve students’ language and listening comprehension abilities through hands-on interactive learning of syntactical and semantic concepts. Students were introduced to specific primary targets through hands-on science activities as well as narratives with interactive aspects throughout the story. Some targets included were prepositions, conjunctions, negation, modal verbs, passive construction, and advanced quantifiers. We also helped students understand basic physic concepts appropriate for their grade level.
  • Morphological Awareness Training (MAT): The purpose was to improve students’ conscious awareness of prefixes and suffixes and relations among base words and their inflected (e.g., cat-cats) and derived (friend-friendly) forms. We also help students understand how meaning affects words’ spellings and how words’ spellings give insight into their meaning. Collectively, MAT lessons helped students create more meaning or understanding for what they read.
  • Teach Expository Text Structures (TEXTS): The purpose was to improve students’ listening and reading comprehension. Understanding the features of narrative text structure, or Story Grammar, (e.g., characters, plot, setting) helps children form a better understanding of the whole story. Similarly, understanding how expository text is structured, or organized, can support the reader in getting the gist and understanding the connections across sentences or paragraphs. The intervention included three structures: compare/contrast, cause/effect, and sequencing.
  • Dialogic Reading – Extended (DR-E): The purpose was to increase students’ vocabulary while further developing their overall language skills. By using a series of increasingly complex questions and prompts, students are encouraged to talk more about the story. They begin by labeling pictures, gradually moving to open-ended type questions and eventually progressing to distancing type questions which relate personal experiences to those in the story. The same story book is used multiple times to help children develop verbal fluency while using the new vocabulary words.

Key Outcomes: Despite general unity of linguistic skills, effects were specific – DR-E led to impacts on vocabulary measures, LIM led to impacts in syntax/grammar measures, COMPASS led to impacts on narrative comprehension and so on. Also, students differently benefited from the intervention depending on the strength of their initial language skills.


Project Title: Reading for Understanding, Comparative Efficacy II: Testing Combinations and Contrasts in Targeted Small Group Interventions in Early Grade

Type of Study: Efficacy

Lead Investigators: Christopher Lonigan, Beth Phillips, & Young Suk Kim.

Timeline: Year 4 - 2013 – 2014

Project Purpose/Goals:

  • To learn even more about which intervention or combination of interventions was the most effective at supporting substantial growth in oral language and comprehension skills in prekindergarten and kindergarten,
  • To explore whether the combined focus of two interventions and extended intensity of these pairings would have similar modular or perhaps more generalizable impacts across language and oral comprehension measures than the modular effects when implemented individually.

Setting and Participants: Based on the findings of the CE I Study, a second comparative efficacy study was conducted in pre-k, kindergarten and fourth grade. This study took place in 61 schools representing nine public school districts, plus Head Start and subsidized child care centers. Schools were recruited that served a moderate to high proportion of students receiving free or reduced price lunch. All grade-eligible general education classrooms were invited to participate. Consent was received from 1334 and 1718 prekindergarten and kindergarten students, respectively, who were screened on two standardized measures of listening comprehension to determine their qualification. Of these, 739 (~55%) students in prekindergarten and 871 (~51%) in kindergarten met the qualification criteria of being at or below a standard score of 97 on two measures in listening comprehension. These students all (excepting small percentages who left their schools during the study) were pre- and post-tested on the measures listed below and randomized within school and grade after being matched on the screening measures assigned to a block.

Research Design: Three of the five interventions from Comparative Efficacy I were implemented in Pre-Kindergarten ad Kindergarten: Dialogic Reading - Extended (DR-E; vocabulary focus), Language in Motion (LIM; language/syntax focus), and Comprehension Monitoring and Story Structure (COMPASS; narrative text structure and oral comprehension monitoring focus) since each of these interventions was found to be effective for improving one or more language- or comprehension-related skill during the Comparative Efficacy I Study. This study was an incomplete-blocks randomized efficacy trial of four experimental conditions: (1) LIM/COMPASS, (2) LIM/DR, (3) DR-E/COMPASS, (4) Business-as-usual. In each active condition students received 18 weeks of small group intervention lessons approximately 20 minutes in length; they received nine weeks of each of the two included interventions. Within assigned active condition, students were also randomly assigned to the order in which they received the two interventions (i.e., DR-then-LIM or LIM-then-DR). All intervention sessions were conducted in small groups of no more than five students by trained interventionists supervised by the intervention developers and the Investigators.

Measures:

Screening Listening Comprehension Measures (also administered at post-test)

  • Oral and Written Language Scales -2nd Edition –Listening Comprehension
  • Woodcock Johnson Tests of Achievement –Oral Comprehension

Additional Pretest-Post-test Measures

  • Comprehensive Assessment of Spoken Language –Syntax Construction
  • Comprehensive Assessment of Spoken Language –Antonyms (Kindergarten Only)Test of Narrative Language-selected subtests
  • Clinical Evaluation of Language Fundamentals –Sentence Structure (either from Preschool Second Edition or Kindergarten 4th Edition)
  • Expressive One-Word Picture Vocabulary Test-4th Edition
  • Test of Preschool Early Literacy-Definitional Vocabulary (Preschool Only)
  • Woodcock Johnson Tests of Achievement – Letter –Word ID
  • Test of Word Reading Efficiency- 2nd Edition (Kindergarten Only)
  • Intervention-Aligned Proximal Assessments for LIM. Distinct Prekindergarten and Kindergarten assessments included items addressing intervention components inclusive of syntax and listening comprehension. Item formats include multiple choice, short answer and cloze items.
  • Inconsistency Detection Task. This measure served as the Intervention-Aligned Proximal Assessment for COMPASS. The measure includes brief passages read to students that include either external or internal inconsistencies that children are asked to identify.
  • Intervention-Aligned Proximal Assessments for Dialogic Reading. Distinct Prekindergarten and Kindergarten assessments included randomly selected vocabulary items from each instructional unit. All items required expressive responses.

Key Outcomes: Preliminary analyses have been conducted on the proximal measures and on key standardized assessments of oral language. All analyses were conducted for each grade separately. To account for the nesting of children in schools and assignment blocks, all analyses were multilevel models using school and block as random factors and controlling for age and for pretest score on the relevant measure.

Preliminary results suggest broader impacts from the paired interventions than were previously indicated for each intervention delivered singly. However, results continue to suggest that impacts are modular such that significant effects only accrue to measures of constructs explicitly targeted by the interventions received.


Project Title: Reading for Understanding, Comparative Efficacy II: Testing Static and Dynamic Versions of a Text Structure Intervention

More information coming soon.


Project Title: LIM/CALI Study - Integrating language, text, and academic knowledge interventions to promote second grade reading for understanding

Lead Investigators: Christopher Lonigan, Beth Phillips, Carol Connor

Timeline: Year 5- 2014-2015

Type of Study: Efficacy

Project Purpose/Goals: Two efficacious interventions, Language in Motion (LIM) and Content Area Literacy Instruction (CALI) were combined to create a hybrid intervention that provided oral language intervention (i.e., LIM) combined with CALI design features (i.e., appropriate informational text, specific comprehension strategies of connecting, visualizing and generating questions, written activities, discussion strategies to build word and content knowledge), which was titled LIM/CALI. The intervention also included an augmented focus on lexical quality through exploration of targeted vocabulary words embedded in texts and instruction. Key goals were

  • To determine if a language intervention in combination with supporting written text and activities along with support for increasing content knowledge, would be effective in promoting reading comprehension,
  • To determine if combining language and content area literacy instruction with a targeted decoding intervention would be effective in promoting reading comprehension.

Setting and Participants: This study took place in 42 schools (195 classrooms) in 8 school districts in North Florida and South Florida. Schools were recruited that serve a moderate to high proportion of students receiving free or reduced price lunch. All second grade general education classrooms were invited to participate. Consent was received from 2,285 second-grade students. OF these, 2,256 were screened on reading comprehension to determine their qualification. Of these, 1,148 (~50%) students met the qualification criteria of being at or below the 40th percentile in reading comprehension. 1,123 of these students were pre-tested on the measures listed below and randomized within school after being matched on the screening measures. Once randomized, students assigned to the LIM/CALI Plus condition were evaluated based on two standardized decoding measures administered at pretest to determine eligibility to receive the augmentative decoding intervention. Eligibility was set at an average standard score on the decoding measures below 100.

Research Design: There were three experimental conditions: (1) LIM/CALI Only: 12 weeks of LIM-CALI Intervention, which includes 48 30-minute lessons, (2) LIM/CALI Plus: The identical LIM CALI intervention plus the decoding intervention (for decoding-qualified students only). The decoding intervention includes 48 10-minute lessons delivered in 12 30-minute lessons over three week and then weekly 20-minute booster-sessions during the first six weeks of the LIM/CALI intervention, (3) Business-as-usual.

All intervention sessions were conducted in small groups of no more than five students by trained interventionists supervised by the intervention developers and the Investigators. All analyses took school and assignment block into consideration using multi-level modeling. Analyses for hypothesis one compared each active condition to BAU. Analyses for hypothesis two compared the LIM/CALI Plus condition to the LIM/CALI only condition.

Measures:

  • Gates-MacGinitie Test of Reading Comprehension
  • Woodcock-Johnson Tests of Achievement-Passage Comprehension

Additional Pretest-Post-test Measures

  • Comprehensive Assessment of Spoken Language –Syntax Construction
  • Expressive One-Word Picture Vocabulary Test-4th Edition
  • Oral and Written Language Scales -2nd Edition –Listening Comprehension
  • Woodcock Johnson Tests of Achievement –Oral Comprehension
  • Woodcock Johnson Tests of Achievement – Academic Knowledge
  • *Woodcock Johnson Tests of Achievement – Letter –Word ID
  • *Test of Word Reading Efficiency- 2nd Edition Sight Word Efficiency

*Used to determine eligibility for decoding intervention for students randomized to LIM/CALI Plus condition.

Intervention-Aligned Assessment for LIM/CALI. This 40-item assessment includes items addressing intervention components inclusive of syntax, vocabulary, and listening comprehension. Item formats include multiple choice, short answer and cloze items. Intervention Aligned Assessment for Decoding. This measure includes single-, and multi-syllable individual nonwords and real words to be read aloud by students for a total of 80 items that represent a wide variety of phonemes, digraphs, and blends.Intervention-Aligned Assessment for Reading Comprehension. This measure includes two subtests, inclusive of brief researcher-developed passages embedded with the syntax targets for which students complete multiple choice items and a researcher-developed maze task requiring students to select the appropriate syntactically-correct word to complete the connected text sentences.

Key Outcomes: Analyses revealed significant positive effects on the proximal and ‘distimal’ (i.e., near-transfer) measures of targeted vocabulary, targeted syntax, and reading comprehension (but not listening comprehension). LIM-CALI Plus had a significant positive effect on the proximal measure of decoding. However, there were few significant effects on the standardized measures of language, decoding, and reading comprehension. There was also a significant interaction that revealed that the intervention was more effective for children who had higher scores initially on the proximal measures.

Project Title: Professional Development Study of LIM/CALI

Lead Investigator: Beth Phillips

Timeline: 2015-2016

Type of Study: Efficacy

Project Purpose/Goals: To investigate the intensity level of professional development support required by educators to achieve high levels of fidelity in their implementation of a language intervention.

Setting and Participants: Forty coached and 40 workshop-only second grade teachers representing 23 schools in seven school districts participated. Within these schools, 1184 students were screened, and 385 qualified and were disproportionately randomized within schools to receive (n =268) or not receive the intervention (n =112).

Research Design: The central question was regarding differential implementation by teachers in two randomly assigned conditions. Teachers assigned to the workshop only condition received a four-hour face to face professional development that included didactic, demonstration and video, and hands-on practice components. Coached teachers participated in this workshop and also received three coaching visits that included modeling and observations with reflective feedback sessions in which teachers and coaches jointly developed implementation goals. All lessons were audiotaped; coached teachers also received four rounds of written feedback on recorded lessons. All teachers were observed live three times during the eight week intervention period and rated on five other audio-recordings by personnel blind to their coaching condition.

Measures: Participating children received a limited battery of language and comprehension assessments (both proximal and distal) before and after the 8 weeks of intervention or BAU experiences. Hierarchical linear modeling (HLM) was used for group comparisons among the teacher fidelity and the child assessment data. Descriptive, correlational additional HLM models were used to analyze the fidelity data.

Student measures:

  • Researcher-developed proximal measure of language and comprehension
  • GMRT -2nd grade TOWRE

Key Outcomes: Preliminary results indicated that coached teachers implemented a greater number of lessons, and those lessons were rated as more engaging for students. Some general aspects of implementation fidelity, such as adherence to lesson plans, appear comparable between groups. Analyses are in progress to explore whether students receiving intervention from coached or uncoached teachers experienced differential skill gains. Furthermore, detailed exploration of scaffolding and engagement techniques used within the intervention is underway with both this sample and the earlier LIM/CALI Efficacy sample.

More information coming soon.