Research data
Up ]

Home
Why the CRP?
What is it?
How to use it.
Testimonials
Research data
Products
Ordering
About CEA
FREE Download

A Research Study

This research was conducted during the 1995-1996 academic year. Note the gains in percentile scores made by those using The Caldwell Reading Program.

Students in two first grade classrooms, who had been randomly assigned to their respective teachers, participated in the study. One teacher used the Treasury of Literature reading program by Harcourt Brace and Company, along with a considerable amount of her own "supplemental phonics" materials. The second teacher, at her request, used The Caldwell Reading Program in its entirety, and minimal portions of the Treasury of Literature program. Students in both classes were given three sub-scales (Word Identification, Word Attack, and Passage Comprehension) of the Woodcock Reading Mastery Tests--Revised in September 1995 and again in May 1996. Participants were individually tested in random order by psychologists who were unaware with which reading group the participants were being instructed. While both groups showed gains from pretest to the post test, those using The Caldwell Reading Program showed significantly greater gains on all three sub-scales, both statistically and practically. The following tables below show the results.

Pretest and Post-test Means of Age-Standardized Scores, Standard Deviations, Z-Scores, and Percentile Scores for the Control Group and the Caldwell Group

Sub-scale                           Pretest                                         Post-test             

Control Group

Mean

SD

Z

Percentile1  

Mean

SD

Z

Percentile1

Word Identification

104.44

12.6

.296

62

NS2

107.04

18.5

.469

68

Word Attack

95.68

15.6

-.288

39

NS2

96.92

18.5

-.205

42

Passage Comprehension

96.24

13.1

-.251

40

NS2

97.12

14.4

-.192

42

Caldwell 

Mean

SD

Z

Percentile1  

Mean

SD

Z

Percentile1

Word Identification

101.75

9.0

.117

54

*

111.41

14.8

.760

78

Word Attack

96.96

16.1

-.203

42

**

106.54

9.10

.436

67

Passage Comprehension

95.04

9.8

-.331

37

*

105.00

21.6

.333

63

1A percentile score is the percent of the population one is equal to or better than. Thus the 50th percentile is "in the middle" of the population and is equal to or better than 75% of the population, etc.
2
"NS" means that no significant gains were made in percentile scores. The students in the control group made average improvement from pre to post-test, i.e. they maintained about the same position relative to other students in their grade.
* Significant increase between pretest and post-test (p. < .05)
**Significant increase between pretest and post-test and significantly greater than Control group on the post-test.
Note: There were no significant differences in mean sub-scale pretest scores between the control group and Caldwell group.

As can be seen from the table above, in Word Identification students went from slightly above average to the top one-fourth; in Word Attack from about the lower 40 percent to the top one-third, and in Passage Comprehension from about the lower one-third to nearly the upper one-third. All gains for the Caldwell group were statistically significant. No significant gains were made by the control group.

Number and Percent of Students Whose Scores Increased from Pretest to Post-test for the Control Group and the Caldwell Reading Group

Sub-scale                           Control Group                    Caldwell Group           

Increase

No Increase

%

Increase

No Increase

%

Word Identification

15 10

60

20 4 83

Word Attack

12 13

48

19 5 79

Passage Comprehension

11 14

44

18 6 75

The greater percentage of students whose scores increased on all three sub-scales for the Caldwell Group is quite apparent.  Therefore the greater test scores for those using the Caldwell Reading Program did not occur because only a few students made unusually large gains.  Rather, nearly all of those using the Caldwell Reading Program benefited from it.

Because of the results of this research and the very favorable reports by teachers using the CRP, during the 1997-98 academic year it was used in all of the elementary schools in the county district as a supplemental program. The county was awarded honors for showing the most improvement in the entire state on the Stanford Achievement Test/9th Edition for the year.

The following survey was conducted in Marion County, West Virginia, by Jane Reynolds, Curriculum Specialist. The twelve second grade teachers had use the program for approximately six months.

Caldwell Reading Program Evaluation Survey
(Use of "?" indicates that an assessment on the item is not yet possible.)

              Statement                                                       Yes    No  Maybe  "?"

1. The program improved student reading.  12   0   0    0 
2. The program helped poor readers.  11   0    1   0
3. The program helped average readers.  10   0   1   1
4. The program helped good readers.    9   1     1   0*
5. The students easily connected the printed letters to the sounds.  11   0   1   0
6. The students improved word attack skills.  11   0   1   0
7. The students improved their understanding of affixes and root words.   9   0   2   1
8. The students improved comprehension.   2   2   8   0
9. The students transferred skills to other reading materials.   7   1   4   0
10. The students felt better about reading.   9   1   2   0
11. The students could work in the workbooks independently.   8   1   3   0
12. The program is easy for students to use.  11   1   0    0
13. The program is easy for teachers to use.  11   0   1   0
14. The amount of time required was manageable.  12   0   0   0
15. he program was flexible and adaptable for my classroom.  12   0   0   0
16. I liked the program.  12   0   0   0
17. The students liked the program.  12   0   0   0
18. The students looked forward to Caldwell time.  10   0   2   0
19. The parents understood the program.   7   0   4   1
20. My poorest reader like the program.  10   0   2   0
21. My best reader liked the program.   8   1   1   2
22. I needed extra time to plan and prepare.   4   1   6  0**

                                                                                              YES     NO

23. I would like to use the materials next year.  12      0   
24. I would recommend the materials to other teachers.  12    0  
25. I do not need phonics books if I use Caldwell   5   7
26. I would like to have the students use book 4 and5 next year with their new teacher.  11   1
27. Caldwell is better for small groups than for an entire class.   6   6

* One marked "NA".
**One not marked.

Selected Teacher Comments from Those Responding to the Survey:

"On the whole, the program is a wonderful and rewarding program both for the teacher and the students."

"It was repetitious and fun for the students. After they caught on their confidence grew to the point that they wanted to participate."  "I have seen the most progress in my students since using the Caldwell program. Their vocabulary has gown as well."

"It built vocabulary for all students, not just students with reading difficulties. Students were able to use what they learned in all other subjects." "I liked all of it. In the beginning it seemed difficult for students but they bean flying through the sounds and activity pages in no time."  "I noticed that Caldwell really helped most of my students. I still have one student that has shown no growth at all. I even sent the sounds home on cards for her to study and it didn't help."

Using The Caldwell Reading Program in Kindergarten

This research was conducted during the 1997-1999 academic years. Students in one of four typical kindergarten classes in one elementary school were given instruction in The Caldwell Reading Program and completed the first level of the five level program ( KDG Group). Those students instructed with the program were kept together as a class and given extensive instruction in the program the following year in first grade. The other students were given less extensive instruction with The Caldwell Reading Program and more instruction with the more traditional Harcourt Brace series (TRD Group). Although The Caldwell Reading Program was used with all of the students, those who began with the program in kindergarten and continued with extensive instruction in it in first grade performed much better on the Stanford Early School Achievement Tests (Stanford 9). In fact the lowest score in the class on the Total Reading sub test was at the 59th percentile, compared to the 4th percentile in the other classes, i.e., those with no kindergarten experience with the program and more limited use of it in first grade. The following results are from the Stanford Early School Achievement Tests (Stanford 9) given in the spring of 1999.

Mean Standard Scores, Standard Deviations, and Percentile Scores for the TRD (Traditional) and KDG (Used CRP in Kindergarten) Groups*

   Sub-scale                     Stanford Early Achievement Test (Stanford 9)
                             Mean              SD                    Percentile   p. value
       Group             TRD        KDG       TRD    KDG   TRD  KDG

Word Study

573.23

623.06

55.56

56.29

72

92

p<.0007

Word Reading

544.89

591.22

46.82

28.45

71

89

p<.002

Comprehension

556.06

581.67

54.47

30.94

71

84

p<.0629

Total Reading

560.45

599.33

53.18

36.79

73

89

p<.0054

Total Math

571.61

578.83

51.31

37.96

86

90

p<.5853


  
  Note that all reading score differences are statistically significant with the exception of the comprehension sub test. When considered individually in another analysis, the KDG group was significantly better than one of the other three classes (p.<0196). None of the other classes was significantly better than any other class on comprehension. One might argue that the students in the KDG group were superior in general ability and this superiority accounted for the better performance rather than the reading materials used. If that were the case, one would expect their performance on the math sub test to be superior. As can be seen in the table, there was very little difference in the math scores, means of 578.16 and 578.38 that yielded a p. value of <.5883. i.e., it could have occurred by chance nearly 6 out of 10 times. When considered individually, the KDG group was significantly better in math than one of the other three classes (p<.0311.) But the other two classes also attained scores in math that were significantly better than that same class (p.<.0048 and p.<.0262). Thus it is most unlikely that the KDG group was superior in general ability.

*Four of the students in the KDG Group were considered "LD" and were given the test under non-standard conditions, as were all of the "LD" students in the other three classes. Further analyses of the data for all of the "LD" students was recently initiated.

Click here to go to the beginning of this section.