Designing Small Evaluation Studies

Larry V. Hedges, Elizabeth Tipton

• Publisher: SAGE Publications, Inc
• Year: 2025
• Print ISBN:
  9781071954157
• Edition: 1
• eBook ISBN:
  9781071954171
• Topic: Social Sciences
• Subtopic: Social Science Research & Methodology
• Index: Social Sciences

"The book will be an important addition to instruction in designs for causal inference in the field of education. It is long overdue." - Thomas J. Lipscomb, The University of Southern Mississippi

This text describes how to design and analyze small efficacy or evaluation studies, typically carried out as part of the development of programs or interventions in areas such as education. The problem facing many researchers is how to design a study that is as small as possible, yet big enough to yield relatively unambiguous evidence about an intervention's average effect. This text begins with an overview of validity, causal inference, statistics, effect sizes, and measurement. The authors then focus on designs for small, randomized trials, followed by a section on non-randomized causal designs: here they focus on three designs most useful for small studies including the non-equivalent control group, difference-in-difference, and interrupted time series designs. The final section summarizes the book, compares designs, discusses approaches to choosing a design, and provides guidance on reporting. Five case examples are used throughout the book to illustrate the material and there is a glossary of terms and concepts.

Table of contents

• Cover
• Half Title
• Acknowledgements
• Title Page
• Copyright Page
• Brief Contents
• Detailed Contents
• Table List
• Illustration List
• Preface
• About the Authors
• 1 Introduction
• Section I Background Concepts
• 2 Introduction to Section I: Is a Small Efficacy Study Right for You?
• 3 Research Design
• 4 Validity of Research Designs
• 5 A Brief Review of Statistics
• 6 A Brief Review of Measurement
• 7 Choosing an Appropriate Effect Size
• Section II Randomized Designs
• 8 Introduction to Section II: What Is Randomization?
• 9 Individually Randomized Designs
• 10 Multisite Individually Randomized Designs
• 11 Multisite Cluster Randomized Designs
• 12 Cluster Randomized Designs
• Section III Quasi-Experimental Designs
• 13 Intro to Section III: What Is a “Quasi”-Experiment?
• 14 Nonequivalent Control Group Designs
• 15 The Difference-in-Differences Design
• 16 Interrupted Time-Series Designs
• Section IV Tools and Reporting
• 17 Introduction to Section IV: Tools and Considerations for Practice
• 18 Choosing a Research Design
• 19 Worksheets for Comparing Designs
• 20 Best Practices for Reporting Small Efficacy Study Results
• Glossary
• References
• Index