An Educators' Guide to Schoolwide Reform - Home
An Educators' Guide to Schoolwide Reform - Introduction
An Educators' Guide to Schoolwide Reform - Acknowledgments
An Educators' Guide to Schoolwide Reform - Overview
An Educators' Guide to Schoolwide Reform - 24 Approaches
An Educators' Guide to Schoolwide Reform - Catalogs & Reviews
An Educators' Guide to Schoolwide Reform - References
An Educators' Guide to Schoolwide Reform - Appendices
An Educators' Guide to Schoolwide Reform - Ordering Information
An Educators' Guide to Schoolwide Reform

APPENDIX B
SUMMARY OF FINDINGS ON
STRENGTH OF THE RESEARCH BASE


Strength of the Research on Student Achievement Outcomes
for Accelerated Schools

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Chasin, Levin (1995) Developer

4.0

3.0

1.0

2.0

1.0

2.0

4.0

4.0

1.5/2.5

2.1

McCarthy, Hopfenberg, Levin (1991) Developer

4.0

3.0

1.0

2.0

1.0

2.0

3.5

4.0

1.7/2.5

2.5

McCarthy, Still (1993) Developer

4.0

3.0

1.0

2.0

1.0

2.0

3.9

4.0

1.2/2.5

2.5

Knight, Stallings (1995) Developer

4.0

3.0

4.0

3.0

1.0

3.0

3.4

4.0

2.0/3.7

3.1

Ross, Alberg, McNelis (1997) Independent

4.0

2.0

3.0

3.0

4.0

3.0

3.6

4.0

2.2/3.7

3.3


Strength of the Research on Student Achievement Outcomes for
America’s Choice

No studies on effects of America’s Choice on students are publicly available.
However, the developer collects and makes publicly available student test
data from America’s Choice schools.


Strength of the Research on Student Achievement Outcomes
for ATLAS Communities

No studies on effects of ATLAS Communities on students are publicly
available. According to the developers, most of the research on ATLAS
to date has been formative, and has led to improvements in the approach.
Further, the developers, New American Schools, and participating
pathways collect and make publicly available test data on student effects.


Strength of the Research on Student Achievement Outcomes
for Audrey Cohen College: Purpose-Centered Education

No studies on effects of Audrey Cohen College:Purpose-Centered
Education on students are publicly available. However, the developers
collect and make publicly available standardized test score data on
Audrey Cohen College: Purpose-Centered Education.


Strength of the Research on Student Achievement Outcomes for
Basic Schools Network

No studies on the effects of the Basic Schools Network on students are
publicly available. However, the developer collects and makes publicly
available test data, and will release a full report on the Basic Schools
Network in spring 1999.


Strength of the Research on Student Achievement Outcomes for
Coalition of Essential Schools

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Billups (1991) Independent

4.0

4.0

1.0

2.0

1.0

4.0

2.4

2.0

3.7/3.2

2.7

Cushman (1991) Developer

4.0

1.0

1.0

1.0

1.0

1.0

3.3

4.0

1.2/2.2

2.0

McCarthy (1994) Independent

4.0

4.0

3.0

3.0

1.0

3.0

3.0

2.2

3.7/2.8

3.0

Riedel (1994) Independent

4.0

3.0

3.0

1.0

1.0

2.0

2.6

3.0

2.0/3.1

2.5

Sikorski, Wallace, Stariha, Rankin (1993) Independent

4.0

4.0

1.0

4.0

1.0

3.0

2.6

1.0

3.1/1.3

2.5

Stringfield et al. (1997) Independent

4.0

3.0

1.0

2.0

4.0

3.0

4.0

4.0

2.3/4.0

3.1

 

Strength of the Research on Student Achievement Outcomes for
Community for Learning

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Brookhart, Casile, McCown (1997) Independent 4.0 3.0 2.0 4.0 4.0 2.0 3.4 4.0 1.3/3.1 3.1
Oates, Flores, Weishew (1997) Developer 4.0 4.0 3.0 2.0 1.0 4.0 3.5 3.3 2.3/2.4 3.1
Reynolds, Heistad, Peterson, Dehli (1992) Independent 4.0 4.0 1.0 4.0 4.0 3.0 3.2 4.0 3.2/3.7 3.4
Temple University (1997) Developer 4.0 3.0 2.0 4.0 1.0 3.0 3.5 4.0 1.8/3.1 2.9
Wang (1983) Developer 4.0 2.0 3.0 3.0 1.0 2.0 2.0 4.0 1.3/3.4 2.6
Wang (1985) Developer 4.0 1.0 1.0 1.0 4.0 2.0 2.4 4.0 1.2/2.2 2.3
Wang, Birch (1984a) Developer 4.0 2.0 3.0 4.0 1.0 2.0 2.8 4.0 1.8/3.4 2.9
Wang, Birch (1984b) Developer 4.0 2.0 3.0 4.0 1.0 2.0 2.8 4.0 1.3/3.4 2.8
Wang, Genmari, Waxman (1985) Developer 4.0 2.0 3.0 3.0 1.0 2.0 3.0 4.0 3.1/3.7 2.9
Wang, Nojan, Stron, Walblerg (1984) Developer 4.0 2.0 1.0 1.0 4.0 1.0 3.3 4.0 1.0/2.5 2.4
Wang, Oates, Weishew (1995) Developer 4.0 3.0 3.0 3.0 1.0 2.0 3.5 4.0 3.0/3.4 3.1
Wang, Peverly, Randolph (1984) Developer 4.0 2.0 2.0 3.0 4.0 2.0 3.2 4.0 3.1/4.0 3.1
Wang, Walberg (1983) Developer 4.0 2.0 3.0 4.0 3.0 1.0 3.4 4.0 1.3/3.4 2.9

 

Strength of the Research on Student Achievement Outcomes for
Co-NECT

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Co-NECT Schools (1997) Developer 4.0 4.0 1.0 3.0 1.0 3.0 2.9 1.9 1.7/2.8 2.5
Co-NECT Schools (1998) Developer 4.0 4.0 1.0 4.0 1.0 3.0 2.0 4.0 1.3/3.4 2.8

The developer collects and makes publicly available student test data.


Strength of the Research on Student Achievement Outcomes for
Core Knowledge

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Oklahoma City Public Schools (1996) Independent

4.0

3.0

3.0

4.0

4.0

4.0

4.0

3.3

2.3/3.7

3.5

Schubnell (1996) Independent

4.0

3.0

1.0

3.0

3.0

4.0

3.2

0.2

2.0/3.1

2.7

Stringfield, McHugh (1996) Independent

4.0

3.0

2.0

4.0

1.0

4.0

3.9

4.0

1.8/2.8

3.1

Stringfield, McHugh (1998) Independent

4.0

4.0

2.0

4.0

1.0

4.0

4.0

4.0

2.5/3.1

3.3

 

Strength of the Research on Student Achievement Outcomes for
Different Ways of Knowing

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Catterall (1995) Independent 4.0 4.0 1.0 3.0 4.0 3.0 4.0 4.0 1.8/4.0 3.3
Catterall, Dreyfus, DeJarnette (1995) Independent 4.0 4.0 3.0 3.0 4.0 3.0 2.9 2.4 2.3/3.7 3.2
Kentucky Department of Education (1998) Independent 4.0 3.0 3.0 4.0 3.0 3.0 1.8 4.0 1.3/3.4 3.1
Petrosko (1997); Hovda, Kyle (1997); Wang, Sogin (1996) Independent 4.0 3.0 4.0 4.0 1.0 3.0 2.5 4.0 1.7/4.0 3.1

 

Strength of the Research on Student Achievement Outcomes for
Direct Instruction

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Adams, Engelman (1996) Developer 4.0 na 4.0 4.0 4.0 4.0 4.0 4.0 1.5/4.0 3.8
Becker, Carnine (1980) Developer 4.0 4.0 1.0 4.0 4.0 4.0 3.0 4.0 1.5/3.7 3.4
Becker, Gersten (1982) Developer 3.0 4.0 3.0 4.0 4.0 4.0 4.0 4.0 2.8/3.7 3.7
Brent, DiObilda (1993) Independent 2.0 2.0 1.0 3.0 4.0 3.0 3.7 4.0 2.5/3.2 2.9
Davis (1998) Independent 4.0 1.0 4.0 3.0 1.0 3.0 2.4 3.2 2.3/4.0 2.8
Gersten (1985) Developer 3.0 4.0 3.0 4.0 4.0 4.0 3.6 4.0 3.2/3.7 3.6
Gersten, Becker, Heiry, White(1981) Developer 3.0 4.0 3.0 4.0 4.0 4.0 4.0 3.5 3.0/3.7 3.6
Gersten, Carnine (1984) Developer 3.0 4.0 3.0 4.0 3.0 3.0 3.6 4.0 2.7/3.1 3.4
Gersten, Carnine, Williams (1982) Developer 4.0 2.0 1.0 1.0 4.0 1.0 2.9 4.0 2.0/3.1 2.5
Gersten, Darch, Gleason (1988) Developer 4.0 4.0 1.0 2.0 4.0 4.0 3.6 4.0 2.0/3.7 3.2
Gersten, Carnine, Zoref, Cronin (1986) Developer 4.0 3.0 2.0 3.0 4.0 2.0 3.2 4.0 1.5/3.1 3.0
Grossen, Ewing (1994) Independent 3.0 3.0 3.0 4.0 4.0 3.0 3.0 2.2 2.8/3.7 3.2
Meyer (1984) Independent 4.0 4.0 1.0 3.0 4.0 3.0 3.3 3.7 2.7/3.7 3.3
Meyer, Gersten, Gutkin (1983) Developer 4.0 4.0 2.0 3.0 4.0 4.0 3.6 4.0 1.7/3.1 3.3
Slocum (1998) Independent 3.0 4.0 3.0 3.0 4.0 2.0 1.4 2.1 1.7/3.1 2.8
Tarver, Jung (1995) Independent 2.0 3.0 3.0 3.0 4.0 2.0 4.0 4.0 3.0/3.4 3.2
Varela-Russo, Blasik, Ligas (1997) Independent 4.0 4.0 2.0 4.0 4.0 2.0 3.5 2.9 3.1/3.2 3.3
Wellington (1994) Independent 3.0 3.0 3.0 3.0 4.0 2.0 4.0 4.0 2.5/3.4 3.2

 

Strength of the Research on Student Achievement for Expeditionary
Learning Outward Bound

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Academy for Educational Development (1995) Independent 3.0 3.0 4.0 4.0 1.0 2.0 3.4 4.0 4.0/3.6 3.2
Expeditionary Learning (1997) Developer 4.0 3.0 3.0 4.0 3.0 3.0 2.5 4.0 3.7/1.2 3.1
Farrell, Leibowitz (1998) Developer 4.0 4.0 2.0 4.0 1.0 2.0 3.7 3.0 3.1/2.2 3.0

 

Strength of the Research on Student Achievement Outcomes for
Foxfire Fund

No studies on the effects of the Foxfire approach are publicly available.
However, the developer collects and makes publicly available student test
data on Foxfire Fund.


Strength of the Research on Student Achievement Outcomes for
High Schools That Work

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Bottoms, Mikos (1995) Developer 4.0 4.0 1.0 4.0 1.0 3.0 3.5 4.0 1.7/3.7 3.0
Bottoms, Presson, Johnson (1992) Developer 4.0 3.0 4.0 4.0 3.0 4.0 3.5 2.7 3.3/4.0 3.6
Bradby, Teitelbaum (1998) Independent 4.0 4.0 3.0 4.0 1.0 3.0 4.0 4.0 1.8/3.1 3.2
Emanuel, et al. (1997) Developer 4.0 4.0 3.0 4.0 3.0 3.0 3.7 3.6 3.0/3.4 3.5
SREB (1996) Developer 4.0 1.0 1.0 1.0 1.0 1.0 3.3 0.0 1.0/2.2 1.6
SREB (1997a) Developer 4.0 4.0 2.0 3.0 1.0 2.8 3.6 4.0 1.8/2.8 2.9
SREB (1997b) Developer 4.0 4.0 1.0 3.0 1.0 3.0 3.6 4.0 1.8/3.1 2.9
SREB (1997c) Developer 4.0 4.0 2.0 3.0 1.0 3.0 3.6 4.0 1.8/2.8 2.9
SREB (1997d) Developer 4.0 4.0 2.0 3.0 1.0 3.0 3.6 4.0 1.8/2.8 2.9
SREB (1998) Developer 4.0 4.0 2.0 3.0 1.0 3.0 3.6 4.0 2.0/2.8

2.9

 

Strength of the Research on Student Achievement Outcomes for
High/Scope K-3 Model

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Schweinhart, Wallgren (1993) Developer 4.0 4.0 4.0 4.0 4.0 4.0 3.3 3.3 3.0/4.0 3.8

 

Strength of the Research on Student Achievement for League
of Professional Schools

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Council for School Performance (1997) Independent 4.0 2.0 1.0 4.0 1.0 3.0 3.0 4.0 2.0/3.0 2.7
Glickman (undated) Developer 4.0 4.0 3.0 3.0 4.0 3.0 2.4 4.0 1.7/3.4 3.2
Harkreader, Henry (1997) Independent 4.0 4.0 2.0 4.0 3.0 4.0 3.0 4.0 2.0/3.0 3.7

 

Strength of the Research on Student Achievement Outcomes for
Modern Red Schoolhouse

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Modern Red Schoolhouse (1998) Developer 4.0 3.0 3.0 4.0 1.0 2.0 2.5 4.0 1.2/3.1 2.6

The developer collects and makes publicly available student test data.

Strength of the Research on Student Achievement Outcomes for
Onward to Excellence

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Mississippi Department of Education (1998) Independent 4.0 3.0 1.0 4.0 3.0 3.0 3.0 4.0 2.5/3.0 3.1
Kushman, Yap (1997) Developer 4.0 4.0 1.0 3.0 4.0 4.0 3.6 4.0 2.0/2.5 3.2
Landis (1997a) Developer 4.0 4.0 1.0 4.0 1.0 3.0 0.7 4.0 1.2/2.5 2.5
Landis (1997b) Developer 4.0 4.0 1.0 4.0 1.0 3.0 3.5 4.0 1.2/2.5 2.8

 

Strength of the Research on Student Achievement Outcomes for
Paideia

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Center for Educational Research and Evaluation (1998) Developer 4.0 4.0 1.0 4.0 4.0 2.0 3.6 2.7 1.7/3.1 3.0
Chesser, Gellatly, Hale (1997) Independent 4.0 3.0 2.0 1.0 1.0 3.0 3.1 2.7 1.5/2.2 2.3
Howard (1992) Independent 4.0 1.0 1.0 2.0 4.0 4.0 4.0 4.0 3.2/3.4 3.1
Moore (1990) Independent 1.0 4.0 1.0 4.0 1.0 3.0 3.4 4.0 1.5/2.8 2.6
Stringfield et al. (1997) Independent 4.0 3.0 1.0 2.0 4.0 3.0 4.0 4.0 2.3/4.0 3.1
Tarkington (1989) Independent 4.0 1.0 3.0 3.0 4.0 4.0 2.8 4.0 2.3/3.7 3.2
Wallace (1993) Independent 4.0 3.0 1.0 2.0 1.0 3.0 3.0 3.0 2.5/3.7 2.6

 

Strength of the Research on Student Achievement Outcomes for
Roots and Wings

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Madden, Slavin, Simons (1997) Developer 4.0 4.0 3.0 4.0 1.0 2.0 3.1 4.0 1.7/3.1 3.0
Ross, Sanders, Wright (1998) Independent 4.0 4.0 3.0 4.0 1.0 3.0 2.4 4.0 1.3/3.1 3.0
Slavin, Madden, Dolan, Wasik (1994) Developer 4.0 4.0 3.0 1.0 1.0 2.0 2.2 4.0 1.7/3.1 2.6

  

Strength of the Research on Student Achievement Outcomes for
School Development Program

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Becker, Hedges (1992) Independent 4.0 3.0 2.0 3.0 4.0 2.0 3.3 4.0 1.3/3.1 3.0
Comer, et al. (1992) Developer 4.0 3.0 2.0 4.0 4.0 1.0 2.0 4.0 1.2/3.1 2.9
Haynes (Ed.) Chapter 8, part 1 (1994) Developer 4.0 1.0 1.0 1.0 4.0 4.0 1.0 3.3 1.3/4.0 2.5
Haynes (Ed.) Chapter 8, part 2 (1994) Developer 4.0 1.0 2.0 2.0 4.0 4.0 3.1 4.0 1.5/2.8 2.8
Haynes (Ed.) Chapter 8 part 3 (1994) Developer 4.0 3.0 2.0 2.0 4.0 4.0 3.1 1.0 1.7/2.8 2.8
Haynes, et al. (1987) Developer 4.0 4.0 1.0 4.0 1.0 3.0 2.4 2.9 1.7/2.5 2.7
Haynes, Comer, Hamilton-Lee (1988) Developer 4.0 4.0 1.0 4.0 1.0 3.0 2.4 2.9 1.7/2.5 2.7
Haynes, Comer, Hamilton-Lee (1989) Developer 4.0 3.0 2.0 3.0 2.0 3.0 2.8 4.0 1.8/2.5 2.8
Joyner (1990) Developer 4.0 3.0 2.0 3.0 4.0 4.0 3.3 4.0 2.2./3.1 3.3
Lockwood (undated) Independent 4.0 3.0 1.0 3.0 1.0 3.0 3.3 4.0 1.2/2.7 2.6
Millsap, Chase, Brigham, Gamse (1997) Independent 4.0 4.0 1.0 1.0 3.0 3.0 3.4 1.0 1.7/2.2 2.4
Stringfield, et al. (1997) Independent 4.0 3.0 1.0 2.0 4.0 3.0 4.0 4.0 2.3/4.0 3.1

 

Strength of the Research on Student Achievement Outcomes for
Success for All

(all ratings on scale of 1-4, with 4=best)

Source

Affiliation

Construct
Validity

Duration

Sample
Bias

External
Validity

Statistical
Validity

Study
Design

Measures

Sample
Description

Study
Clarity

Overall Research Rating

Jones, Gottfredson Gottfredson (1997) Independent 4.0 4.0 3.0 2.0 4.0 4.0 3.9 3.3 2.3/3.4 3.4
Livingston, Flaherty (1997) Developer 4.0 4.0 3.0 4.0 4.0 3.0 3.5 3.2 3.7/2.33 3.6
Madden, et al. (1993) Developer 4.0 4.0 3.0 1.0 4.0 4.0 3.6 4.0 2.2/3.7 3.3
Ross, Alberg, McNelis (1997) Independent 4.0 2.0 3.0 3.0 4.0 3.0 3.6 4.0 2.2/3.7 3.3
Ross, Nunnery, Smith (1996) Independent 4.0 3.0 4.0 1.0 4.0 4.0 3.4 4.0 2.2/4.0 3.4
Ross, Smith, Casey, Slavin (1995) Developer 4.0 2.0 3.0