








| |
A Research Study
This research was conducted during the 1995-1996 academic
year. Note the gains in percentile scores made by those using The Caldwell
Reading Program.
Students in two first grade classrooms, who had been randomly
assigned to their respective teachers, participated in the study. One teacher
used the Treasury of Literature reading program by Harcourt Brace and
Company, along with a considerable amount of her own "supplemental
phonics" materials. The second
teacher, at her request, used The Caldwell Reading Program in its
entirety, and minimal portions of the Treasury of Literature program.
Students in both classes were given three sub-scales (Word Identification, Word
Attack, and Passage Comprehension) of the Woodcock Reading Mastery
Tests--Revised in September 1995 and again in May 1996. Participants were
individually tested in random order by psychologists who were unaware with which
reading group the participants were being instructed. While both groups showed
gains from pretest to the post test, those using The Caldwell Reading Program
showed significantly greater gains on all three sub-scales, both statistically
and practically. The following tables below show the results.

Pretest and Post-test Means of Age-Standardized Scores,
Standard Deviations, Z-Scores, and Percentile Scores for the Control Group and
the Caldwell Group
Sub-scale
Pretest
Post-test
|
| Control Group |
Mean
|
SD
|
Z
|
Percentile1 |
|
Mean
|
SD
|
Z
|
Percentile1 |
|
Word Identification |
104.44 |
12.6 |
.296 |
62 |
NS2 |
107.04 |
18.5 |
.469 |
68 |
|
Word Attack |
95.68 |
15.6 |
-.288 |
39 |
NS2 |
96.92 |
18.5 |
-.205 |
42 |
|
Passage Comprehension |
96.24 |
13.1 |
-.251 |
40 |
NS2 |
97.12 |
14.4 |
-.192 |
42 |
| Caldwell |
Mean
|
SD
|
Z
|
Percentile1 |
|
Mean
|
SD
|
Z
|
Percentile1 |
|
Word Identification |
101.75 |
9.0 |
.117 |
54 |
* |
111.41 |
14.8 |
.760 |
78 |
|
Word Attack |
96.96 |
16.1 |
-.203 |
42 |
** |
106.54 |
9.10 |
.436 |
67 |
|
Passage Comprehension |
95.04 |
9.8 |
-.331 |
37 |
* |
105.00 |
21.6 |
.333 |
63 |
1 A percentile score is the percent
of the population one is equal to or better than. Thus the 50th
percentile is "in the middle" of the
population and is equal to or better than 75% of the
population, etc.
2"NS"
means that no significant gains were made in percentile scores. The students in
the control group made average improvement from pre to post-test, i.e. they
maintained about the same position relative to other students in their grade.
* Significant increase between pretest
and post-test (p. < .05)
**Significant increase between pretest and post-test and
significantly greater than Control group on the post-test.
Note: There were no significant differences in mean sub-scale
pretest scores between the control group and Caldwell group.
As can be seen from the table above, in Word Identification
students went from slightly above average to the top one-fourth; in Word
Attack from about the lower 40 percent to the top one-third, and in Passage
Comprehension from about the lower one-third to nearly the upper one-third.
All gains for the Caldwell group were statistically significant. No significant
gains were made by the control group.
Number and Percent of Students Whose Scores Increased from Pretest to Post-test
for the Control Group and the Caldwell Reading Group
Sub-scale
Control Group Caldwell
Group
|
|
Increase
|
No
Increase
|
% |
Increase
|
No Increase
|
%
|
|
Word Identification |
15 |
10 |
60 |
20 |
4 |
83 |
|
Word Attack |
12 |
13 |
48 |
19 |
5 |
79 |
|
Passage Comprehension |
11 |
14 |
44 |
18 |
6 |
75 |
The greater percentage of students whose scores increased on
all three sub-scales for the Caldwell Group is quite apparent. Therefore
the greater test scores for those using the Caldwell Reading Program did not
occur because only a few students made unusually large gains. Rather,
nearly all of those using the Caldwell Reading Program benefited from it.
Because of the results of this research
and the very favorable reports by teachers using the CRP, during the
1997-98 academic year it was used in all of the elementary schools in the
county district as a supplemental program. The county was awarded honors
for showing the most improvement in the entire state on the Stanford
Achievement Test/9th Edition for the year.

The following survey was conducted in Marion County, West Virginia, by Jane
Reynolds, Curriculum Specialist. The twelve second grade teachers had use the
program for approximately six months.
Caldwell Reading Program
Evaluation Survey
(Use of "?" indicates that an assessment on
the item is not yet possible.)
Statement
Yes No Maybe "?"
| 1. The program improved student reading. |
12 |
0 |
0 |
0 |
| 2. The program helped poor readers. |
11 |
0 |
1 |
0 |
| 3. The program helped average readers. |
10 |
0 |
1 |
1 |
| 4. The program helped good readers. |
9 |
1 |
1 |
0* |
| 5. The students easily connected the printed letters to
the sounds. |
11 |
0 |
1 |
0 |
| 6. The students improved word attack skills. |
11 |
0 |
1 |
0 |
| 7. The students improved their understanding of affixes
and root words. |
9 |
0 |
2 |
1 |
| 8. The students improved comprehension. |
2 |
2 |
8 |
0 |
| 9. The students transferred skills to other reading
materials. |
7 |
1 |
4 |
0 |
| 10. The students felt better about reading. |
9 |
1 |
2 |
0 |
| 11. The students could work in the workbooks
independently. |
8 |
1 |
3 |
0 |
| 12. The program is easy for students to use. |
11 |
1 |
0 |
0 |
| 13. The program is easy for teachers to use. |
11 |
0 |
1 |
0 |
| 14. The amount of time required was manageable. |
12 |
0 |
0 |
0 |
| 15. he program was flexible and adaptable for my
classroom. |
12 |
0 |
0 |
0 |
| 16. I liked the program. |
12 |
0 |
0 |
0 |
| 17. The students liked the program. |
12 |
0 |
0 |
0 |
| 18. The students looked forward to Caldwell time. |
10 |
0 |
2 |
0 |
| 19. The parents understood the program. |
7 |
0 |
4 |
1 |
| 20. My poorest reader like the program. |
10 |
0 |
2 |
0 |
| 21. My best reader liked the program. |
8 |
1 |
1 |
2 |
| 22. I needed extra time to plan and prepare. |
4 |
1 |
6 |
0** |
YES NO
| 23. I would like to use the materials next year. |
12 |
0 |
| 24. I would recommend the materials to other teachers. |
12 |
0 |
| 25. I do not need phonics books if I use Caldwell |
5 |
7 |
| 26. I would like to have the students use book 4 and5
next year with their new teacher. |
11 |
1 |
| 27. Caldwell is better for small groups than for an
entire class. |
6 |
6 |
* One marked "NA".
**One not marked.
Selected Teacher Comments from Those Responding to the
Survey:
"On the whole, the program is a wonderful and rewarding program both for
the teacher and the students."
"It was repetitious and fun for the students. After they caught on their
confidence grew to the point that they wanted to participate."
"I have seen the most progress in my students since using the Caldwell
program. Their vocabulary has gown as well."
"It built vocabulary for all students, not just students with reading
difficulties. Students were able to use what they learned in all other
subjects." "I liked all of it. In the beginning it seemed difficult
for students but they bean flying through the sounds and activity pages in no
time." "I noticed that Caldwell really helped most of my
students. I still have one student that has shown no growth at all. I even sent
the sounds home on cards for her to study and it didn't help."

Using The Caldwell Reading Program in Kindergarten
This research was conducted during the 1997-1999 academic
years. Students in one of four typical kindergarten classes in one elementary
school were given instruction in The Caldwell Reading Program and completed the
first level of the five level program ( KDG Group). Those students instructed
with the program were kept together as a class and given extensive instruction
in the program the following year in first grade. The other students were given
less extensive instruction with The Caldwell Reading Program and more
instruction with the more traditional Harcourt Brace series (TRD Group).
Although The Caldwell Reading Program was used with all of the students, those
who began with the program in kindergarten and continued with extensive
instruction in it in first grade performed much better on the Stanford Early
School Achievement Tests (Stanford 9). In fact the lowest score in the class on
the Total Reading sub test was at the 59th percentile, compared to
the 4th percentile in the other classes, i.e., those with no
kindergarten experience with the program and more limited use of it in first
grade. The following results are from the Stanford Early School Achievement
Tests (Stanford 9) given in the spring of 1999.
Mean Standard Scores, Standard Deviations, and Percentile
Scores for the TRD (Traditional) and KDG (Used CRP in Kindergarten) Groups*
Sub-scale
Stanford Early Achievement Test (Stanford
9)
Mean
SD
Percentile p. value
Group
TRD KDG
TRD KDG TRD
KDG
|
Word Study |
573.23 |
623.06 |
55.56 |
56.29 |
72 |
92 |
p<.0007 |
|
Word Reading |
544.89 |
591.22 |
46.82 |
28.45 |
71 |
89 |
p<.002 |
|
Comprehension |
556.06 |
581.67 |
54.47 |
30.94 |
71 |
84 |
p<.0629 |
|
Total Reading |
560.45 |
599.33 |
53.18 |
36.79 |
73 |
89 |
p<.0054 |
|
Total Math |
571.61 |
578.83 |
51.31 |
37.96 |
86 |
90 |
p<.5853 |
Note that all reading score differences are statistically
significant with the exception of the comprehension sub test. When considered
individually in another analysis, the KDG group was significantly better than
one of the other three classes (p.<0196). None of the other classes was
significantly better than any other class on comprehension. One might argue that
the students in the KDG group were superior in general ability and this
superiority accounted for the better performance rather than the reading
materials used. If that were the case, one would expect their performance on the
math sub test to be superior. As can be seen in the table, there was very little
difference in the math scores, means of 578.16 and 578.38 that yielded a p.
value of <.5883. i.e., it could have occurred by chance nearly 6 out of 10
times. When considered individually, the KDG group was significantly better in
math than one of the other three classes (p<.0311.) But the other two classes
also attained scores in math that were significantly better than that same class
(p.<.0048 and p.<.0262). Thus it is most unlikely that the KDG group
was superior in general ability.
*Four of the students in the KDG Group were considered
"LD" and were given the test under non-standard conditions, as were
all of the "LD" students in the other three classes. Further analyses
of the data for all of the "LD" students was recently initiated.
Click here to go to the beginning of this
section.
|