Preface xi
Acknowledgements xv
About the Authors xvii
About the Companion Website xix
Part 1 Overview of Evidence-Informed Practice
1 Introduction to Evidence-Informed Practice (EIP) 2
1.1 Emergence of EIP 4
1.2 Defining EIP 4
1.3 Types of EIP Questions 5
1.4 EIP Practice Regarding Policy and Social Justice 13
1.5 EIP and Black Lives Matter 13
1.6 Developing an EIP Practice Process Outlook 14
1.7 EIP as a Client-Centered, Compassionate Means, Not an End unto Itself 16
1.8 EIP and Professional Ethics 17
Key Chapter Concepts 18
Review Exercises 19
Additional Readings 19
2 Steps in the EIP Process 21
2.1 Step 1: Question Formulation 22
2.2 Step 2: Evidence Search 22
2.3 Step 3: Critically Appraising Studies and Reviews 29
2.4 Step 4: Selecting and Implementing the Intervention 30
2.5 Step 5: Monitor Client Progress 33
2.6 Feasibility Constraints 33
2.7 But What about the Dodo Bird Verdict? 36
Key Chapter Concepts 38
Review Exercises 39
Additional Readings 39
3 Research Hierarchies: Which Types of Research Are Best for Which Questions? 40
3.1 More than One Type of Hierarchy for More than One Type of EIP Question 41
3.2 Qualitative and Quantitative Studies 42
3.3 Which Types of Research Designs Apply to Which Types of EIP Questions? 43
Key Chapter Concepts 52
Review Exercises 53
Additional Readings 53
Part 2 Critically Appraising Studies for EIP Questions about Intervention Effectiveness
4 Criteria for Inferring Effectiveness: How Do We Know What Works? 56
4.1 Internal Validity 57
4.2 Measurement Issues 62
4.3 Statistical Chance 65
4.4 External Validity 66
4.5 Synopses of Fictitious Research Studies 67
Key Chapter Concepts 71
Review Exercises 72
Exercise for Critically Appraising Published Articles 73
Additional Readings 73
5 Critically Appraising Experiments 74
5.1 Classic Pretest-Posttest Control Group Design 75
5.2 Posttest-Only Control Group Design 76
5.3 Solomon Four-Group Design 77
5.4 Alternative Treatment Designs 78
5.5 Dismantling Designs 79
5.6 Placebo Control Group Designs 80
5.7 Experimental Demand and Experimenter Expectancies 82
5.8 Obtrusive Versus Unobtrusive Observation 83
5.9 Compensatory Equalization and Compensatory Rivalry 83
5.10 Resentful Demoralization 84
5.11 Treatment Diffusion 84
5.12 Treatment Fidelity 85
5.13 Practitioner Equivalence 85
5.14 Differential Attrition 86
5.15 Synopses of Research Studies 88
Key Chapter Concepts 91
Review Exercises 92
Exercise for Critically Appraising Published Articles 92
Additional Readings 93
6 Critically Appraising Quasi-Experiments: Nonequivalent Comparison Groups Designs 94
6.1 Nonequivalent Comparison Groups Designs 95
6.2 Additional Logical Arrangements to Control for Potential Selectivity Biases 97
6.3 Statistical Controls for Potential Selectivity Biases 101
6.4 Creating Matched Comparison Groups Using Propensity Score Matching 105
6.5 Pilot Studies 108
6.6 Synopses of Research Studies 110
Key Chapter Concepts 113
Review Exercises 114
Exercise for Critically Appraising Published Articles 114
Additional Readings 114
7 Critically Appraising Quasi-Experiments: Time-Series Designs and Single-Case Designs 115
7.1 Simple Time-Series Designs 116
7.2 Multiple Time-Series Designs 118
7.3 Single-Case Designs 119
7.4 Synopses of Research Studies 125
Key Chapter Concepts 129
Review Exercises 130
Exercise for Critically Appraising Published Articles 131
Additional Reading 131
8 Critically Appraising Systematic Reviews and Meta-Analyses 132
8.1 Advantages of Systematic Reviews and Meta-Analyses 133
8.2 Risks in Relying Exclusively on Systematic Reviews and Meta-Analyses 135
8.3 Where to Start 135
8.4 What to Look for When Critically Appraising Systematic Reviews 135
8.5 What Distinguishes a Systematic Review from Other Types of Reviews? 142
8.6 What to Look for When Critically Appraising Meta-Analyses 143
8.7 Synopses of Research Studies 152
Key Chapter Concepts 155
Review Exercises 156
Exercise for Critically Appraising Published Articles 157
Additional Readings 157
Part 3 Critically Appraising Studies for Alternative EIP Questions
9 Critically Appraising Nonexperimental Quantitative Studies 160
9.1 Surveys 161
9.2 Cross-Sectional and Longitudinal Studies 169
9.3 Case-Control Studies 171
9.4 Synopses of Research Studies 172
Key Chapter Concepts 178
Review Exercises 179
Exercise for Critically Appraising Published Articles 179
Additional Readings 179
10 Critically Appraising Qualitative Studies 180
10.1 Qualitative Observation 182
10.2 Qualitative Interviewing 183
10.3 Other Qualitative Methodologies 186
10.4 Qualitative Sampling 186
10.5 Grounded Theory 187
10.6 Alternatives to Grounded Theory 188
10.7 Frameworks for Appraising Qualitative Studies 189
10.8 Mixed Model and Mixed Methods Studies 193
10.9 Synopses of Research Studies 193
Key Chapter Concepts 198
Review Exercises 200
Exercise for Critically Appraising Published Articles 201
Additional Readings 201
Part 4 Assessment and Monitoring in Evidence-Informed Practice
11 Critically Appraising, Selecting, and Constructing Assessment Instruments 204
11.1 Reliability 205
11.2 Validity 208
11.3 Feasibility 214
11.4 Sample Characteristics 214
11.5 Locating Assessment Instruments 215
11.6 Constructing Assessment Instruments 216
11.7 Synopses of Research Studies 218
Key Chapter Concepts 220
Review Exercises 221
Exercise for Critically Appraising Published Articles 222
Additional Readings 222
12 Monitoring Client Progress 223
12.1 A Practitioner-Friendly Single-Case Design 224
12.2 Using Within-Group Effect-Size Benchmarks 234
Key Chapter Concepts 235
Review Exercises 236
Additional Readings 236
Part 5 Additional Aspects of Evidence-Informed Practice
13 Appraising and Conducting Data Analyses in EIP 238
13.1 Introduction 238
13.2 Ruling Out Statistical Chance 239
13.3 What Else Do You Need to Know? 244
13.4 The 05 Cutoff Point Is Not Sacred! 245
13.5 What Else Do You Need to Know? 246
13.6 Calculating Within-Group Effect Sizes and Using Benchmarks 247
13.7 Conclusion 248
Key Chapter Concepts 248
Review Exercises 249
Additional Reading 249
14 Critically Appraising Social Justice Research Studies 250
14.1 Introduction 250
14.2 Evidence-Informed Social Action 251
14.3 What Type of Evidence? 252
14.4 Participatory Action Research (PAR) 253
14.5 Illustrations of Other Types of Social Justice Research 254
14.6 Conclusion 254
Key Chapter Concepts 258
Review Exercises 259
Additional Readings 260
Glossary 261
References 269
Index 273
