The Effective Reading Intervention Academy (ERIA) supports schools in identifying struggling students and trains teachers in providing effective interventions to assist in improving specific student reading skills. The purpose of this report is to examine the implementation of this program at 33 school sites in the state of California.
CalSTAT began working with local education agencies in 2004 to bring ERIA to classrooms. Each cohort of approximately 10 schools receives training and ongoing support. Sites in West Orange County and Antelope Valley piloted ERIA starting in the 2004-05 school year (Cohort 1), followed by San Joaquin Valley sites in 2005-06 (Cohort 2) and San Diego County sites in 2006-07 (Cohort 3).
Literacy assessments are implemented throughout the year and used by sites to guide intervention decisions with current data. This data is also forwarded to CalSTAT for evaluation purposes. The following analyses are based on these sources of student assessment data:
These assessment scores allow sites to make data-based intervention decisions, delivering specific, targeted help to students based on their individual needs. However, only 30% of student pre and post scores were used in this program-wide summary analysis, excluding data which either fell outside of ERIA’s focus population (struggling students) or were inconsistent with the summary reporting criteria, making aggregation impossible.
| Measurements | % | |
|---|---|---|
| Struggling Students | 4,409 | 30% |
| Succeeding Studentsmeasurements, | 3,937 | 27% |
| Student Data Not Meeting Summary Criteria | 6,110 | 43% |
Cohort 1, the only cohort to have been implementing ERIA for a full three years, has reported with greater fidelity on far more students than Cohorts 2 and 3, as reflected in reported student data. Increasing student participation and the completeness of data at Cohorts 2 and 3 is a goal for this year.
| Measurements | % | |
|---|---|---|
| Cohort 1 | 5,694 | 68% |
| Cohort 2 | 1,383 | 17% |
| Cohort 3 | 1,269 | 15% |
Decoding assessments require students to identify words on a grade-level vocabulary list. The San Diego Quick is the most-frequently used instrument for this measure. Student data is only included here if it includes the student’s grade level and the highest grade level list completed on both pre and post tests.
Students who are only one grade-level behind (yellow in the chart) are students at risk, but not necessarily high risk. ERIA sites have shown progress helping these students grow, as well as helping students at greater risk (more than 1 grade level behind) move closer to grade-level literacy.
| Pre | Post | |||
|---|---|---|---|---|
| Students | % | Students | % | |
| Ahead 1 Grade Level or More | 273 | 17% | ||
| Decoding at Grade Level | 407 | 25% | ||
| Behind 1 Grade Level | 817 | 51% | 481 | 30% |
| Behind More than 1 Grade Level | 794 | 49% | 450 | 28% |
| Pre | Post | |
|---|---|---|
| Ahead 1 Grade Level or More | 38% | |
| Decoding at Grade Level | 27% | |
| Behind 1 Grade Level | 38% | 18% |
| Behind More than 1 Grade Level | 62% | 40% |
| Pre | Post | |
|---|---|---|
| Ahead 1 Grade Level or More | 14% | |
| Decoding at Grade Level | 33% | |
| Behind 1 Grade Level | 57% | 32% |
| Behind More than 1 Grade Level | 43% | 21% |
| Pre | Post | ||||||
|---|---|---|---|---|---|---|---|
| N | Behind > 1 GL | Behind 1 GL | Behind > 1 GL | Behind 1 GL | Decoding At GL | Ahead 1 GL or More | |
| Cohort 1 | 1,611 | 49% | 51% | 28% | 30% | 25% | 17% |
| Huntington Beach City, Dwyer (Ethel) Middle | 258 | 47% | 53% | 26% | 41% | 19% | 14% |
| Huntington Beach City, Peterson (John R.) Elementary | 32 | 72% | 28% | 19% | 25% | 41% | 15% |
| Ocean View Elementary, Marine View Middle | 169 | 43% | 57% | 18% | 28% | 38% | 16% |
| Ocean View Elementary, Mesa View Middle | 154 | 86% | 14% | 56% | 18% | 15% | 11% |
| Ocean View Elementary, Spring View Middle | 289 | 40% | 60% | 26% | 36% | 27% | 11% |
| Ocean View Elementary, Vista View Middle | 449 | 56% | 44% | 34% | 26% | 19% | 21% |
| Westminster Elementary, Webber Elementary | 60 | 43% | 57% | 20% | 42% | 35% | 3% |
| Westside Union Elementary, Quartz Hill Elementary | 200 | 28% | 72% | 9% | 22% | 39% | 30% |
| Cohort 2 | 278 | 62% | 38% | 40% | 18% | 27% | 15% |
| Alta Vista Elementary, Alta Vista Elementary | 15 | 60% | 40% | 40% | 27% | 13% | 20% |
| Alvina Elementary, Alvina Elementary Charter | 38 | 53% | 47% | 34% | 32% | 18% | 16% |
| Exeter Public Schools | 92 | 45% | 55% | 23% | 30% | 30% | 17% |
| Exeter Union Elementary, Rocky Hill Elementary | 62 | 34% | 66% | 2% | 29% | 45% | 24% |
| Exeter Union High, Exeter High | 30 | 100% | 0% | 90% | 7% | 0% | 3% |
| Fresno Unified, Herbert Hoover High | 24 | 100% | 0% | 100% | 0% | 0% | 0% |
| Fresno Unified, McLane High | 31 | 100% | 0% | 97% | 3% | 0% | 0% |
| Golden Valley Unified, Sierra View Elementary | 10 | 40% | 60% | 0% | 30% | 60% | 10% |
| Golden Valley Unified, Webster Elementary | 29 | 55% | 45% | 3% | 10% | 42% | 45% |
| Pioneer Union Elementary, Pioneer Elementary | 20 | 35% | 65% | 15% | 20% | 55% | 10% |
| Sanger Unified, Centerville Elementary | 19 | 53% | 47% | 26% | 16% | 47% | 11% |
| Cohort 3 | 328 | 43% | 57% | 21% | 32% | 33% | 14% |
| Alpine Union Elementary, Mac Queen (Joan) Middle | 108 | 53% | 47% | 26% | 48% | 19% | 6% |
| Fallbrook Union Elementary, Live Oak Elementary | 24 | 29% | 71% | 21% | 33% | 17% | 29% |
| La Mesa-Spring Valley, Spring Valley Middle | 10 | 10% | 90% | 60% | 20% | 10% | 10% |
| Lakeside Union Elementary, Riverview Elementary | 19 | 21% | 79% | 11% | 21% | 63% | 5% |
| Mountain Empire Unified, Campo Elementary | 23 | 70% | 30% | 39% | 4% | 48% | 9% |
| Mountain Empire Unified, Descanso Elementary | 19 | 32% | 68% | 16% | 26% | 37% | 21% |
| Mountain Empire Unified, Pine Valley Elementary | 7 | 29% | 71% | 0% | 14% | 86% | 0% |
| Ramona Unified, Dukes (James) Elementary | 54 | 30% | 70% | 9% | 33% | 41% | 17% |
| Ramona Unified, Mt. Woodson Elementary | 64 | 48% | 52% | 16% | 25% | 37% | 22% |
| Overall | 2,217 | 50% | 50% | 29% | 29% | 26% | 16% |
Oral Reading Fluency assessment tracks incremental changes in the number of words read aloud in a minute from a passage of text specifically calibrated by grade level. Student data must include the student’s grade level, the passage’s grade level, and the words correct per minute (WCPM) for both pre and post tests.
In order to monitor whether ERIA has helped enable accelerated learning at sites, change in WCPM values was determined for all struggling students between 4th and 8th grade (Post WCPM - Pre WCPM). This was further calculated as a percentage of expected change in WCPM over the course of the year, based upon Hasbrouck and Tindal’s 2004 oral reading fluency study.
| Cohort 1 | Cohort 2 | Cohort 3 | ||||
|---|---|---|---|---|---|---|
| Students | % | Students | % | Students | % | |
| Growth Above 150% | 385 | 29% | 67 | 17% | 41 | 12% |
| Growth > 100% to 150% | 306 | 23% | 87 | 22% | 63 | 18% |
| Growth > 50% to 100% | 271 | 20% | 103 | 25% | 95 | 27% |
| Growth Below 50% or Decline | 358 | 28% | 146 | 36% | 153 | 43% |
| N | 50% or less | >50% to 100% | >100% to 150% | greater than 150% | |
|---|---|---|---|---|---|
| Cohort 1 | 1,320 | 28% | 20% | 23% | 29% |
| Huntington Beach City, Dwyer (Ethel) Middle | 252 | 30% | 22% | 26% | 22% |
| Huntington Beach City, Peterson (John R.) Elementary | 39 | 74% | 18% | 3% | 5% |
| Ocean View Elementary, Marine View Middle | 148 | 16% | 11% | 14% | 59% |
| Ocean View Elementary, Mesa View Middle | 167 | 26% | 22% | 25% | 27% |
| Ocean View Elementary, Vista View Middle | 421 | 29% | 20% | 23% | 28% |
| Westminster Elementary, Webber Elementary | 88 | 58% | 24% | 11% | 7% |
| Westside Union Elementary, Quartz Hill Elementary | 205 | 6% | 24% | 35% | 35% |
| Cohort 2 | 403 | 36% | 25% | 22% | 17% |
| Alta Vista Elementary, Alta Vista Elementary | 10 | 60% | 20% | 10% | 10% |
| Alvina Elementary, Alvina Elementary Charter | 50 | 44% | 32% | 14% | 10% |
| Exeter Public Schools | 163 | 55% | 22% | 11% | 12% |
| Exeter Union Elementary, Rocky Hill Elementary | 41 | 12% | 27% | 32% | 29% |
| Exeter Union Elementary, Wilson Middle | 122 | 70% | 20% | 4% | 6% |
| Golden Valley Unified, Sierra View Elementary | 22 | 32% | 41% | 27% | 0% |
| Golden Valley Unified, Webster Elementary | 67 | 15% | 27% | 37% | 21% |
| Pioneer Union Elementary, Pioneer Elementary | 62 | 15% | 26% | 27% | 32% |
| Sanger Unified, Centerville Elementary | 29 | 7% | 21% | 45% | 27% |
| Cohort 3 | 352 | 43% | 27% | 18% | 12% |
| Chula Vista, Marshall (Thurgood) Elementary | 64 | 34% | 33% | 22% | 11% |
| Mountain Empire Unified, Campo Elementary | 67 | 34% | 27% | 34% | 5% |
| Mountain Empire Unified, Clover Flat Elementary | 13 | 77% | 15% | 8% | 0% |
| Mountain Empire Unified, Descanso Elementary | 23 | 35% | 57% | 4% | 4% |
| Mountain Empire Unified, Pine Valley Elementary | 6 | 0% | 33% | 33% | 34% |
| Ramona Unified, Dukes (James) Elementary | 97 | 43% | 19% | 14% | 24% |
| Ramona Unified, Mt. Woodson Elementary | 82 | 58% | 26% | 10% | 6% |
| Overall | 2,075 | 31% | 23% | 22% | 24% |
Monitoring CST English Language Arts (ELA) proficiency scores has been a focus of ERIA evaluation, just as it is a focus for all CA schools. The following chart averages schoolwide percent proficient scores, with all sites weighted equally.
| 2004 | 2005 | 2006 | 2007 | ||
|---|---|---|---|---|---|
| All Students | Statewide | 37.4 | 41.9 | 44.8 | 45.5 |
| Cohort 1 | 48.3 | 54.5 | 46.9 | 57.4 | |
| Cohort 2 | 38.0 | 40.6 | 45.4 | 44.0 | |
| Cohort 3 | 46.9 | 49.5 | 54.9 | 55.2 | |
| Students with Disabilities | Statewide | 14.7 | 17.0 | 19.6 | 21.0 |
| Cohort 1 | 12.6 | 17.4 | 26.7 | 20.9 | |
| Cohort 2 | 9.5 | 10.2 | 14.1 | 15.0 | |
| Cohort 3 | 16.2 | 14.2 | 25.9 | 23.7 |
CST tests place students in one of five proficiency levels: advanced, proficient, basic, below basic, or far below basic. However, “Proficient or above” is the reporting focus under No Child Left Behind, so most available data does not report on all five levels.
Because student scores according to the five proficiency levels have not been aggregated and reported at the schoolwide level by CDE, much of the progress sites may have made in advancing the reading skills of students most at-risk hasn’t been visible through CST ELA test reports. However, obtaining these values directly from sites has become a priority for ERIA evaluation, and future reports will include this information.
| 2004 | 2005 | 2006 | 2007 | Growth (2004-2007) |
|
|---|---|---|---|---|---|
| Cohort 1 | 48.3% | 54.5% | 56.9% | 57.4% | 9.1 |
| Huntington Beach City, Dwyer (Ethel) Middle | 58.2% | 62.8% | 63.5% | 66.1% | 7.9 |
| Huntington Beach City, Peterson (John R.) Elementary | 64.3% | 69.6% | 72.5% | 73.0% | 8.7 |
| Ocean View Elementary, Marine View Middle | 59.2% | 64.8% | 69.2% | 63.9% | 4.7 |
| Ocean View Elementary, Mesa View Middle | 53.5% | 59.9% | 62.8% | 66.8% | 13.3 |
| Ocean View Elementary, Spring View Middle | 46.8% | 52.5% | 56.4% | 55.8% | 9.0 |
| Ocean View Elementary, Vista View Middle | 39.4% | 48.6% | 53.1% | 55.5% | 16.1 |
| Westminster Elementary, Demille Elementary | 38.0% | 40.5% | 41.6% | 41.7% | 3.7 |
| Westminster Elementary, Webber Elementary | 32.5% | 41.7% | 43.0% | 45.8% | 13.3 |
| Westside Union Elementary, Quartz Hill Elementary | 42.9% | 50.1% | 49.8% | 47.9% | 5.0 |
| 2004 | 2005 | 2006 | 2007 | Growth (2005-2007) |
|
| Cohort 2 | 38.0% | 40.6% | 45.4% | 44.5% | 3.9 |
| Alta Vista Elementary, Alta Vista Elementary | 9.8% | 14.4% | 19.8% | 20.5% | 6.1 |
| Alvina Elementary, Alvina Elementary Charter | 29.5% | 33.1% | 32.9% | 30.4% | -2.7 |
| Exeter Public Schools | |||||
| Exeter Union Elementary, Lincoln Elementary | 34.2% | 40.7% | 53.0% | 44.4% | 3.7 |
| Exeter Union Elementary, Rocky Hill Elementary | 33.6% | 37.2% | 40.7% | 41.6% | 4.4 |
| Exeter Union Elementary, Wilson Middle | 33.4% | 37.8% | 45.3% | 47.0% | 9.2 |
| Exeter Union High, Exeter High | 55.0% | 50.4% | 53.8% | 50.8% | 0.4 |
| Fresno Unified, Herbert Hoover High | 42.2% | 43.6% | 42.5% | 42.0% | -0.2 |
| Fresno Unified, McLane High | 22.4% | 22.0% | 26.8% | 22.3% | 0.3 |
| Golden Valley Unified, Sierra View Elementary | * | * | 54.9% | 55.9% | |
| Golden Valley Unified, Webster Elementary | 55.2% | 59.4% | 62.1% | 59.3% | -0.1 |
| Palo Verde Union, Palo Verde Elementary | 34.7% | 34.7% | 43.8% | 41.3% | 6.6 |
| Pioneer Union Elementary, Pioneer Elementary | 56.4% | 60.1% | 63.1% | 61.9% | 1.8 |
| Sanger Unified, Centerville Elementary | 28.7% | 34.9% | 42.4% | 46.2% | 11.3 |
| 2004 | 2005 | 2006 | 2007 | Growth (2006-2007) |
|
| Cohort 3 | 46.9% | 49.5% | 54.9% | 55.2% | 0.3 |
| Alpine Union Elementary, Mac Queen (Joan) Middle | 53.3% | 57.3% | 62.0% | 58.3% | -3.7 |
| Chula Vista, Marshall (Thurgood) Elementary | 58.6% | 55.1% | 61.9% | 63.1% | 1.2 |
| Fallbrook Union Elementary, Live Oak Elementary | 43.1% | 46.9% | 53.4% | 50.4% | -3.0 |
| La Mesa-Spring Valley, Spring Valley Middle | 42.5% | 42.4% | 46.4% | 43.7% | -2.7 |
| Lakeside Union Elementary, Riverview Elementary | 44.7% | 42.6% | 47.3% | 42.5% | -4.8 |
| Mountain Empire Unified, Campo Elementary | 32.2% | 36.2% | 35.6% | 45.8% | 10.2 |
| Mountain Empire Unified, Clover Flat Elementary | 27.5% | 28.8% | 37.5% | 44.1% | 6.6 |
| Mountain Empire Unified, Descanso Elementary | 48.5% | 61.4% | 67.0% | 56.7% | -10.3 |
| Mountain Empire Unified, Pine Valley Elementary | 51.5% | 56.0% | 59.0% | 71.6% | 12.6 |
| Ramona Unified, Dukes (James) Elementary | 63.3% | 65.8% | 74.0% | 73.8% | -0.2 |
| Ramona Unified, Mt. Woodson Elementary | 50.4% | 52.0% | 60.0% | 57.6% | -2.4 |
| Overall | 44.0% | 47.6% | 51.7% | 51.6% |
| 2004 | 2005 | 2006 | 2007 | Growth (2004-2007) |
|
|---|---|---|---|---|---|
| Cohort 1 | 12.6% | 17.4% | 26.7% | 20.9% | 8.3 |
| Huntington Beach City, Dwyer (Ethel) Middle | 10.2% | 22.2% | 28.9% | 24.3% | 14.1 |
| Huntington Beach City, Peterson (John R.) Elementary | 24.0% | 34.8% | 62.1% | 44.4% | 20.4 |
| Ocean View Elementary, Marine View Middle | 20.0% | 19.7% | 36.7% | 11.8% | -8.2 |
| Ocean View Elementary, Mesa View Middle | 8.1% | 4.8% | 16.2% | 22.4% | 14.3 |
| Ocean View Elementary, Spring View Middle | 7.1% | 15.0% | 23.0% | 17.8% | 10.7 |
| Ocean View Elementary, Vista View Middle | 3.4% | 8.1% | 18.8% | 12.0% | 8.6 |
| Westminster Elementary, Demille Elementary | 25.0% | 22.9% | 19.4% | 27.8% | 2.8 |
| Westminster Elementary, Webber Elementary | 9.7% | 10.7% | 13.6% | 14.3% | 4.6 |
| Westside Union Elementary, Quartz Hill Elementary | 6.1% | 18.5% | 21.4% | 13.6% | 7.5 |
| 2004 | 2005 | 2006 | 2007 | Growth (2005-2007) |
|
| Cohort 2 | 9.5% | 10.2% | 14.1% | 15.0% | 4.8 |
| Alta Vista Elementary, Alta Vista Elementary | * | * | * | * | |
| Alvina Elementary, Alvina Elementary Charter | * | * | * | 21.1% | |
| Exeter Public Schools | |||||
| Exeter Union Elementary, Lincoln Elementary | 26.6% | 9.1% | * | * | |
| Exeter Union Elementary, Rocky Hill Elementary | 17.5% | 9.1% | 12.1% | 9.7% | 0.6 |
| Exeter Union Elementary, Wilson Middle | 11.1% | 18.8% | 21.2% | 6.1% | -12.7 |
| Exeter Union High, Exeter High | 0.0% | 0.0% | 5.9% | * | |
| Fresno Unified, Herbert Hoover High | 3.7% | 4.5% | 12.7% | 5.2% | 1.5 |
| Fresno Unified, McLane High | 1.5% | 5.6% | 10.7% | 6.3% | 0.7 |
| Golden Valley Unified, Sierra View Elementary | * | * | 0.0% | 15.4% | |
| Golden Valley Unified, Webster Elementary | 4.7% | 3.8% | 10.5% | 12.1% | 8.3 |
| Palo Verde Union, Palo Verde Elementary | |||||
| Pioneer Union Elementary, Pioneer Elementary | 34.6% | 35.9% | 37.5% | 44.7% | 8.8 |
| Sanger Unified, Centerville Elementary | 8.0% | * | 20.0% | 17.4% | |
| 2004 | 2005 | 2006 | 2007 | Growth (2006-2007) |
|
| Cohort 3 | 16.2% | 14.2% | 25.9% | 23.7% | -2.2 |
| Alpine Union Elementary, Mac Queen (Joan) Middle | 15.0% | 22.2% | 16.8% | 12.6% | -4.2 |
| Chula Vista, Marshall (Thurgood) Elementary | 20.0% | 13.5% | 23.3% | 5.7% | -17.6 |
| Fallbrook Union Elementary, Live Oak Elementary | 21.2% | 12.2% | 24.6% | 23.8% | -0.8 |
| La Mesa-Spring Valley, Spring Valley Middle | 9.5% | 4.8% | 11.4% | 16.1% | 4.7 |
| Lakeside Union Elementary, Riverview Elementary | 8.8% | 13.2% | 27.3% | 36.0% | 8.7 |
| Mountain Empire Unified, Campo Elementary | 17.3% | 19.0% | 22.2% | 21.4% | -0.8 |
| Mountain Empire Unified, Clover Flat Elementary | 5.5% | 5.0% | 29.4% | * | |
| Mountain Empire Unified, Descanso Elementary | * | 0.0% | * | * | |
| Mountain Empire Unified, Pine Valley Elementary | * | * | 15.4% | * | |
| Ramona Unified, Dukes (James) Elementary | 26.5% | 26.7% | 51.1% | 46.6% | -4.5 |
| Ramona Unified, Mt. Woodson Elementary | 21.6% | 25.3% | 37.5% | 27.7% | -9.8 |
| Overall | 12.8% | 14.1% | 22.1% | 19.6% |
Report contributors: Cheryl “Li” Walter, Ph.D.; Alan Wood
This ERIA report was developed by CalSTAT on behalf of the California Department of Education. CalSTAT is located at Napa County Office of Education. For more information about CalSTAT, visit our website at <www.calstat.org>.
Funds for this project come from federal funds awarded in Part B of Public Law 108-446, the Individuals with Disabilities Education Act (IDEA), as amended in 2004. These dollars will assist individuals serving children birth to 22 years of age and their families.