EVIDENCE-BASED PRACTICE IN SCHOOL MENTAL HEALTH OXFORD WORKSHOP SERIES: SCHOOL SOCIAL WORK ASSOCIATION OF AMERICA Series Advisory Board Judith Shine, President Susan L Ellis, Executive Director Randy A Fisher Stephen P Hydon Donna J Secor Evidence-Based Practice in School Mental Health James C Raines The Domains and Demands of School Social Work Practice Michael S Kelly Solution-Focused Brief Therapy in Schools Michael S Kelly, Johnny S Kim, and Cynthia Franklin EVIDENCE-BASED PRACTICE IN SCHOOL MENTAL HEALTH A Primer for School Social Workers, Psychologists, and Counselors James C Raines ■■■ OXFORD WORKSHOP SERIES 2008 Oxford University Press, Inc., publishes works that further Oxford University’s objective of excellence in research, scholarship, and education Oxford New York Auckland Cape Town Dar es Salaam Hong Kong Karachi Kuala Lumpur Madrid Melbourne Mexico City Nairobi New Delhi Shanghai Taipei Toronto With offices in Argentina Austria Brazil Chile Czech Republic France Greece Guatemala Hungary Italy Japan Poland Portugal Singapore South Korea Switzerland Thailand Turkey Ukraine Vietnam Copyright © 2008 by Oxford University Press, Inc Published by Oxford University Press, Inc 198 Madison Avenue, New York, New York 10016 www.oup.com Oxford is a registered trademark of Oxford University Press All rights reserved No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, without the prior permission of Oxford University Press Library of Congress Cataloging-in-Publication Data Raines, James Curtis Evidence-based practice in school mental health / James C Raines p cm.—(Oxford workshop series) Includes bibliographical references and index ISBN 978-0-19-536626-6 School children—Mental health services School social work—United States Evidence-based social work—United States Evidence-based psychiatry—United States Students with disabilities—Services for—United States I School Social Work Association of America II Title III Series [DNLM: School Health Services Adolescent Child Evidence-Based Medicine Mental Disorders—therapy Mental Health Services WA 352 R155e 2008] LB3430.R35 2008 371.7′130973 dc22 2008001223 Printed in the United States of America on acid-free paper Contents Preface vii Chapter Introduction Chapter Evidence-Based Practice: Definition and Process 25 Chapter Creating Answerable Questions Chapter Investigating the Evidence Chapter Appraising the Evidence Chapter Adapting and Applying the Evidence Chapter Evaluating Group Outcomes Using Descriptive Designs 163 Chapter Evaluating Individual Outcomes Using Single-Subject Designs 197 Chapter Ethics for Evidence-Based Practice Chapter 10 Systemic Change Glossary Appendix A 45 67 103 133 221 255 277 Internet Resources for Evidence-Based Practice 285 v Appendix B Annotated Bibliography on Empirically Supported Interventions 293 Appendix C Ten Threats to Internal Validity References Index vi 295 297 351 Contents Preface Evidence-based practice has become a common expression in the helping professions over the last decade Beginning with medicine and moving to fields such as psychology and social work, the number of books on evidencebased practice has grown significantly What makes this book different? This book is aimed at preservice and in-service school-based mental health service providers, such as school counselors, school psychologists, and school social workers It is not a research book It is a book about research-infused practice What does this mean? It means that this book aims to give school service providers a pragmatic approach to informing every major practice decision with the appropriate research so that students receive the best possible services The book addresses how to use research to make reliable and valid assessments, how to use research to choose the best intervention, and how to use research to evaluate student progress Estimates of child and adolescent mental health problems range from 10% to 20% (Roberts, Attkinson, & Rosenblatt, 1998) The best estimate is that at least 10% of youths suffer from serious behavioral or emotional problems (National Advisory Mental Health Council, 2001) If there are 70 million school-age children in the United States (Kazdin, 2003), then at least million need help Unfortunately, up to 70% of these children never receive any mental health services Of those who get help, schools are the primary providers (Burns et al., 1995; Rones & Hoagwood, 2000) Child and adolescent psychotherapy has not always had a history of being effective Levitt (1957) came to the conclusion that children who received treatment were no better off than those who did not By the year 2000, however, approximately 1,500 outcome studies have been completed on youth treatment (Durlak, Wells, Cotton, & Johnson, 1995; Kazdin, 2000) The later studies have overcome earlier methodological weaknesses and demonstrated significantly stronger results (Weisz, 2004) This book, however, is not about evidence-based practices, which may be defined as techniques or treatments that have empirical support This book is about evidence-based practice or the process of continually infusing practice with the current best research (Drake, Hovmand, Jonson-Reid, & Zayas, 2007; Evidence-Based Medicine Working Group, 1992) Why choose vii a process approach? Paul (2004) describes the problem when he reviews multiple books about empirically supported treatments: Even books published in the last year, are to years behind the times By virtue of the lag between writing and publication, even the most recently released book will have citations that are a few years old Journals and conventions remain the best vehicle to stay on top of the learning curve (p 39) Staying on top of the curve is what professional practice is all about Each new client brings a unique amalgam of strengths and problems, developmental issues, cultural diversity, and value preferences There are no clinicians who can sit back and comfortably assume that they have no more to learn The world is changing much too fast to believe that we can stop growing along with it What’s up ahead in this book? In Chapter 1—Introduction—I provide five compelling reasons for evidence-based practice They include ethical, legal, clinical, educational, and economic justifications I also describe the philosophy of science that undergirds this book In Chapter 2—EvidenceBased Practice: Definition and Process—I define evidence-based practice and dispel some myths I also describe the five basic steps of evidence-based practice These include determining answerable questions, investigating the evidence, appraising the evidence, adapting and applying the evidence, and evaluating the results In the next six chapters, I describe each step in much more detail, providing user-friendly tips along the way as well as illustrations about how this process works in an applied setting In Chapter 9—Ethics for Evidence-Based Practice—I address some of the important concerns about evaluating results with children Such issues include informed consent, client self-determination, and parental access and control In Chapter 10—Systemic Change—I address what has changed to facilitate evidence-based practice and what still needs to change to make it work smoothly and seamlessly within our schools Finally, each chapter offers a brief preview of what’s ahead for the reader, a summary of what has been covered in the chapter, suggestions for further reading, and Internet resources I hope that you will approach this material with an open mind and an open heart Overall, I hope that the book is both intellectually stimulating and useful in your daily practice viii Preface EVIDENCE-BASED PRACTICE IN SCHOOL MENTAL HEALTH Shapiro, E S (2004) Academic skills problems workbook (rev ed.) New York: Guilford Shapiro, E S., & Heick, P (2004) School psychologist assessment practices in the evaluation of students refined for social/behavioral/emotional problems Psychology in the Schools, 41, 551–561 Shapiro, E S., & Kratochwill, T R (2000) Introduction: Conducting a multidimensional behavioral assessment In E S Shapiro & T R Kratochwill (Eds.), Conducting school-based assessments of child and adolescent behavior (pp 1–20) New York: Guilford Shapiro, J P., Welker, C J., & Jacobson, B J (1997) A naturalistic study of psychotherapeutic methods and client-in-therapy functioning in a child community setting Journal of Clinical Child Psychology, 26 (4), 385–396 Shaywitz, S E., Fletcher, J M., Holahan, J M., Schneider, A E., Marchione, K E., Stuebing, K K., et al (1999) Persistence of dyslexia: The Connecticut Longitudinal Study at adolescence Pediatrics, 104, 1351–1359 Shlonsky, A., & Gibbs, L (2006) Will the real evidence-based practice please stand up? Teaching the process of evidence-based practice to the helping professions In A R Roberts & K R Yeager (Eds.), Foundations of evidencebased practice (pp 103–121) New York: Oxford University Press Sholomskas, D E., Syracuse-Siewart, G., Rounsaville, B J., Ball, S A., Nuro, K F., & Carroll, K M (2005) We don’t train in vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy Journal of Consulting and Clinical Psychology, 73 (1), 106–115 Silver, L B (2004) Attention-deficit/hyperactivity disorder In F M Kline & L B Silver (Eds.), The educator’s guide to mental health issues in the classroom (pp 35–53) Baltimore, MD: Paul H Brookes Sinclair, M F., Christenson, S L., Evelo, D L., & Hurley, C M (1998) Dropout prevention for youth with disabilities: Efficacy of a sustained school engagement procedure Exceptional Children, 65 (1), 7–21 Sinclair, M F., Christenson, S L., & Thurlow, M L (2005) Promoting school completion of urban secondary youth with emotional or behavioral disabilities Exceptional Children, 71 (4), 465–482 Sindelar, P T., Allman, C., Monda, L., Vail, C O., Wilson, C L., & Schloss, P J (1988) The power of hypothesis testing in special education efficacy research Journal of Special Education, 22 (3), 284–296 Singh, N N., Lancioni, G E., O’Reilly, M F., Molina, E J Adkins, A D., & Oliva, D (2003) Self-determination during mealtimes through microswitch choice-making by an individual with complex multiple disabilities and profound mental retardation Journal of Positive Behavior Interventions, (4), 209–215 References 341 Sink, C A., & Igelman, C N (2004) Anxiety disorders In F M Kline & L B Silver (Eds.), The educator’s guide to mental health issues in the classroom (pp 171–191) Baltimore, MD: Paul H Brookes Sink, C A., & Spencer, L R (2005) My Class Inventory-Short Form as an accountability tool for elementary school counselors to measure classroom climate Professional School Counseling, (1), 37–48 Sitlington, P L., & Clark, G M (2007) Transition assessment process and IDEIA 2004 Assessment for Effective Intervention, 32 (3), 133–142 Skara, S., Rohrbach, L A., Sun, P., & Sussman, S (2005) An evaluation of the fidelity of implementation of a school-based drug abuse prevention program: Project toward no drug abuse (TND) Journal of Drug Education, 35 (4), 305–329 Sklare, G B (1997) Brief counseling that works: A solution-focused approach for school counselors Thousand Oaks, CA: Corwin Slater, P., & McKeown, M (2004) The role of peer counselling and support in helping to reduce anxieties around transition from primary to secondary school Counselling and Psychotherapy Research, (1), 72–79 Slawson, D C., & Shaughnessy, A F (2005) Teaching evidence-based medicine: Should we be teaching information management instead? Academic Medicine, 80 (7), 685–689 Slovenko, R (2005) Commentary: Malpractice, non-medical negligence, or breach of contract Journal of Psychiatry and Law, 33 (3), 445–467 Small, M A., Lyons, P M., & Guy, L S (2002) Liability issues in child abuse and neglect reporting statutes Professional Psychology: Research and Practice, 33 (1), 13–18 Smith, S L (2000) Creating useful individualized education programs (IEPs) ED449636 2000-12-00 ERIC Digest, #E600 Retrieved May 19, 2007, from http://www.eric.ed.gov/ERICDocs/data/ericdocs2sql/content_ storage_01/0000019b/80/16/d3/23.pdf Smith, M L., Glass, G V., & Miller, T L (1980) The benefits of psychotherapy Baltimore: Johns Hopkins University Press Smith, C A., Ireland, T O., & Thornberry, T P (2005) Adolescent maltreatment and its impact on young adult antisocial behavior Child Abuse and Neglect, 29 (10), 1099–1119 Solomon, Y., Warin, J., & Lewis, C (2002) Helping with homework? Homework as a site of tension for parents and teenagers British Educational Research Journal, 28 (4), 603–622 Southam-Gerow, M A., Weisz, J R., & Kendall, P C (2003) Youth with anxiety disorders in research and service clinics: Examining client differences and similarities Journal of Clinical Child and Adolescent Psychology, 32 (3), 375–385 342 References Spielmans, G I., Pasek, L F., & McFall, J P (2006) What are the active ingredients in cognitive and behavioral psychotherapy for anxious and depressed children? A meta-analytic review Clinical Psychology Review, 27 (5), 642–654 Spirito, A., & Kazak, A E (2006) Effective and emerging treatments in pediatric psychology New York: Oxford University Press Springer, D W., Abell, N., & Hudson, W (2002a) Creating and validating rapid assessment instruments for practice and research, Part Research on Social Work Practice, 12 (3), 408–439 Springer, D W., Abell, N., & Hudson, W (2002b) Creating and validating rapid assessment instruments for practice and research, Part Research on Social Work Practice, 12 (6), 768–795 Sprott, J B., Jenkins, J M., & Doob, A N (2005) The importance of school: Protecting at-risk youth from early offending Youth Violence and Juvenile Justice, (1), 59–79 Squires, G (2001) Using cognitive-behavioural psychology with groups of pupils to improve self-control of behaviour Educational Psychology in Practice, 17 (4), 317–335 Stathakos, P., & Roehrle, B (2003) The effectiveness of intervention programmes for children of divorce—A meta-analysis International Journal of Mental Health Promotion, (1), 31–37 Steckler, A., Ethelbah, B., Martin, C J., Stewart, D., Pardilla, M., Gittelsohn, J., et al (2003) Pathways process evaluation results: A school-based prevention trial to promote healthful diet and physical activity in American Indian third, fourth, and fifth grade students Preventive Medicine, 37 (6, Pt 2), S80–S90 Stirman, S W., Crits-Christoph, P., & DeRubeis, R J (2004) Achieving successful dissemination of empirically supported psychotherapies: A synthesis of dissemination theory Clinical Psychology: Science and Practice, 11 (4), 343–359 Stone, S., & Gambrill, E (2007) Do school social work textbooks provide a sound guide for education and practice? Children and Schools, 29 (2), 109–118 Storr, C L., Ialongo, N S., Kellam, S G., & Anthony, J C (2002) A randomized controlled trial of two primary intervention strategies to prevent early onset tobacco smoking Drug and Alcohol Dependence, 66 (1), 51–60 Story, M., Stevens, J., Himes, J., Stone, E., Rock, B H., Ethelbah, B., et al (2003) Obesity in American-Indian children: Prevalence, consequences, and prevention Preventive Medicine, 37 (6, Pt 2), S3–S12 St Pierre, R G., & Rossi, P H (2006) Randomize groups, not individuals: A strategy for improving early childhood programs Evaluation Review, 30 (5), 656–685 References 343 Sundarararjan, L (2002) Humanistic psychotherapy and the scientistpractitioner debate: An “embodied” perspective Journal of Humanistic Psychology, 42 (2), 34–47 Swanson, H L., & Deshler, D (2003) Instructing adolescents with learning disabilities: Converting a meta-analysis to practice Journal of Learning Disabilities, 36 (2), 124–135 Tan, C S., (2007) Test review: Behavior Assessment System for Children (2nd ed.) Assessment for Effective Intervention, 32 (2), 121–124 Tawney, J W., & Gast, D L (1984) Single-subject research in special education Columbus, OH: Merrill Taylor, J L., & Novaco, R W (2005) Anger treatment for people with developmental disabilities: A theory, evidence and manual-based approach New York: John Wiley Thomas, E (2007, April 30) Special report: Tragedy at Virginia Tech Quiet and disturbed, Cho Seung-Hui seethed, then exploded His odyssey MSNBC/Newsweek Retrieved May 25, 2007, from http://www.msnbc msn.com/id/18248298/site/newsweek/page/0/ Thompson, R A (1990) Vulnerability in research: A developmental perspective on research risk Child Development, 61 (1), 1–16 Tillett, J (2005) Adolescents and informed consent Journal of Perinatal and Neonatal Nursing, 19 (2), 112–121 Todman, J., & Dugard, P (2001) Single-case and small-n experimental designs: A practical guide to randomization tests Mahwah, NJ: Lawrence Erlbaum Tonn, J L (February 16, 2005) Chicago dropouts Education Week, 24 (23), 16 Torgerson, C (2003) Systematic reviews New York: Continuum Trautwein, U., & Köller, O (2003) The relationship between homework and achievement—Still much of a mystery Educational Psychology Review, 15 (2), 115–145 Treatment for Adolescents with Depression Study (TADS) Team (2005) The treatment for adolescents with depression study (TADS): Demographic and clinical characteristics Journal of the American Academy of Child and Adolescent Psychiatry, 44 (1), 28–40 Trickett, E J., Leone, P E., Fink, C M., & Braaten, S L (1993) The perceived environment of special education classrooms for adolescents: A revision of the Classroom Environment Scale Exceptional Children, 59 (5), 411–420 Trickett, E J., & Moos, R H (1995) Classroom Environment Scale manual: Development, applications, research (3rd ed.) Palo Alto, CA: Consulting Psychologist Turner, W (2000) Cultural considerations in family-based primary prevention programs in drug abuse Journal of Primary Prevention, 21 (2), 285–303 344 References Tyson, K (1992) A new approach to relevant research for practitioners: The heuristic paradigm Social Work, 37 (6), 541–556 Tyson, K (1994) Author’s reply: Response to “Social work researchers’ quest for responsibility.” Social Work, 39 (6), 737–741 Unrau, Y A., Grinnell, R M., Jr., & Williams, M (2008) The quantitative approach In R M Grinnell, Jr., & Y A Unrau (Eds.), Social work research and evaluation: Foundations of evidence-based practice (pp 61–82) New York: Oxford University Press Urkin, J., & Merrick, J (2006) Editorial International Journal of Adolescent Medicine and Health, 18 (2), 207–208 U.S Census Bureau (2001) The Hispanic population: Census 2000 brief Washington, DC: U.S Census Bureau U.S Department of Education (2002a) A new era: Revitalizing special education for children and their families Washington, DC: U.S Department of Education Retrieved May 19, 2003, from http://www.ed.gov/inits/commissionsboards/whspecialeducation/[cited in chap 1] U.S Department of Education (2002b) Twenty-fourth annual report to Congress on the implementation of the Individuals with Disabilities Education Act Washington, DC: U.S Department of Education U.S Department of Education (2004a) Digest of education statistics Washington, DC: U.S Department of Education Retrieved August 1, 2007, from http://nces.ed.gov/programs/digest/d04/tables/dt04_109.asp U.S Department of Education (2004b, April 21) Family educational rights and privacy act Final rule Federal Register, 69 (77), 21669–21672 U.S Department of Education (2006) WWC intervention report: Dropout prevention: Check and Connect Retrieved June 11, 2007, from http://w-w-c org/PDF/Intervention/WWC_Check_Connect_092106.pdf U.S Department of Education (2007, May 20) Final regulations on modified academic achievement standards Retrieved July 30, 2007, from http://www ed.gov/policy/speced/guid/modachieve-summary.html U.S Department of Education, Office of Special Education and Rehabilitative Services (2006, August 14) Assistance to states for the education of children with disabilities and preschool grants for children with disabilities: Final rule 34CFR Parts 300 and 301 Federal Register, 71 (156), 46540–46845 U.S National Library of Medicine (2006, December 11) Fact sheet: Medline Retrieved June 8, 2007, from http://www.nlm.nih.gov/pubs/factsheets/ medline.html U.S Public Health Service (2000) Report of the Surgeon General’s Conference on Children’s Mental Health: A national action agenda Washington, References 345 DC: US Department of Health and Human Services Retrieved August 7, 2003, from www.surgeongeneral.gov/topics/cmh/childreport.htm Valentine, J C., & Cooper, H (2003) Effect size substantive interpretation guidelines: Issues in the interpretation of effect sizes Washington, DC: What Works Clearinghouse Retrieved September 24, 2007, from http://ies ed.gov/ncee/wwc/pdf/essig.pdf Van Baar, A L., Ultee, K., Gunning, W B., Soepatmi, S., & de Leeuw, R (2006) Developmental course of very preterm children in relation to school outcome Journal of Developmental and Physical Disabilities, 18 (3), 273–293 Van den Noortgate, W., Geeraert, L., Grietens, H., & Onghena, P (2006) The effects of early prevention programs for families with young children at risk for physical child abuse and neglect: A reply on the comments of Miller Child Maltreatment, 11 (1), 98–101 Van Horn, M L (2003) Assessing the unit of measurement for school climate through psychometric and outcome analyses of the school climate Educational and Psychological Measurement, 63 (6), 1002–1019 Van Reusen, A K., Box, C S., Schumaker, J B., & Deschler, D D (1994) The self-advocacy strategy for education and transition planning Lawrence, KS: Edge Enterprises Vandercook, T., York, J., & Forest, M (1989) The McGill action planning system (MAPS): A strategy for building the vision Journal of the Association for Persons with Severe Handicaps, 14 (2), 205–215 Vaughn, S., Klingner, J., & Hughes, M (2000) Sustainability of researchbased practices Exceptional Children, 66 (2), 163–171 Velasquez, M M., Maurer, G G., Crouch, C., & DiClemente, C C (2001) Group treatment for substance abuse: A stages-of-change therapy manual New York: Guilford Verhulst, F C (2002) Editorial Journal of Child Psychology and Psychiatry, 43 (6), 693–694 Viadero, D (2001, February 7) The dropout dilemma Education Week, 20 (21), p 26–30 Viggiani, P A., Reid, W J., & Bailey-Dempsey, C (2002) Social workerteacher collaboration in the classroom: Help for elementary students at risk of failure Research on Social Work Practice, 12 (5), 604–620 Virginia Tech Review Panel (2007) Mass shootings at Virginia Tech, April 16, 2007: Report of the review panel presented to Timothy M Kaine, Governor, Commonwealth of Virginia Retrieved September 4, 2007, from http://www governor.virginia.gov/TempContent/techPanelReport.cfm Volpe, R J., DiPerna, J C., Hintze, J M., & Shapiro, E S (2005) Observing students in classroom settings: A review of seven coding schemes School Psychology Review, 34 (4), 454–474 346 References Vostanis, P (2006) Strengths and Difficulties Questionnaire: Research and clinical applications Current Opinion in Psychiatry, 19 (4), 367–372 Wakefield, J C., & Kirk, S A (1996) Unscientific thinking about scientific practice: Evaluating the scientist-practitioner model Social Work Research, 20 (1), 83–95 Waldron, H B., Kern-Jones, S., Turner, C W., Peterson, T R., & Ozechowski, T J (2007) Engaging resistant adolescents in drug abuse treatment Journal of Substance Abuse Treatment, 32 (2), 133–142 Walker, H M (2003) Commentary: Addressing the gap between science and practice in children’s mental health School Psychology Review, 32 (1), 44–47 Walker, J S., Briggs, H E., Koroloff, N., & Friesen, B J (2007) Implementing and sustaining evidence-based practice in social work Journal of Social Work Education, 43 (3), 361–375 Guest editorial Walker, H M., & Severson, H H (1990) Systematic screening for behavior disorders: Users guide and administration manual Longmont, CO: Sopris West Wallerstein, J S (1991) Tailoring the intervention to the child in the separating and divorced family Family and Conciliation Courts Review, 29 (4), 448–459 Ward, M J (2005) An historical perspective of self-determination in special education: Accomplishments and challenges Research and Practice for Persons with Severe Disabilities, 30 (3), 108–112 Ward, E C (2007) Examining differential treatment effects for depression in racial and ethnic minority women: A qualitative systematic review Journal of the National Medical Association, 99 (3), 265–274 Ware, W B., & Galassi, J P (2006) Using correlational and prediction data to enhance student achievement in K-12 schools: A practical application for school counselors Professional School Counseling, (5, special issue), 344–356 Waschbusch, D A., & Hill, G P (2003) Empirically supported, promising, and unsupported treatments for children with attention-deficit/hyperactivity disorder In S O Lilienfeld, S J Lynn, & J M Lohr (Eds.), Science and pseudoscience in clinical psychology (pp 333–362) New York: Guilford Wasserman, J D., & Bracken, B A (2002) Selecting appropriate tests: Psychometric and pragmatic considerations In J F Carlson & B B Waterman (Eds.), Social and personality assessment of school-aged children: Developing interventions for educational and clinical use (pp 18–43) Boston: Allyn & Bacon Watson, S (1995) Successful treatment of selective mutism: Collaborative work in a secondary school setting Child Language Teaching and Therapy, 11 (2), 163–175 References 347 Wehmeyer, M., Agran, M., & Hughes, C (2000) A national survey of teachers’ promotion of self-determination and student-directed learning Journal of Special Education, 34 (2), 58–69 Wehmeyer, M L., Palmer, S B., Soukup, J H., Garner, N W., & Lawrence, M (2007) Self-determination and student transition planning knowledge and skills: Predicting involvement Exceptionality, 15 (1), 31–44 Weinbach, R W., & Grinnell, R M., Jr (2007) Statistics for social workers (7th ed.) Boston: Pearson Weis, R., & Smenner, L (2007) Construct validity of the Behavior Assessment System for Children (BASC) Self-Report of Personality: Evidence from adolescents referred to residential treatment Journal of Psychoeducational Assessment, 25 (2), 111–126 Weiss, C H., Murphy-Graham, E., & Birkeland, S (2005) An alternate route to policy influence: How evaluations affect D.A.R.E American Journal of Evaluation, 26 (1), 12–30 Weisz, J R (2004) Psychotherapy for children and adolescents: Evidence-based treatments and case examples Cambridge: Cambridge University Press Weisz, J R., Chu, B C., & Polo, A J (2004) Treatment dissemination and evidence-based practice: Strengthening intervention through clinicianresearcher collaboration Clinical Psychology: Science and Practice, 11 (3), 300–307 Weithorn, L A., & Campbell, S B (1982) The competency of children and adolescents to make informed treatment decisions Child Development, 53 (6), 1589–1598 Welsh, W (2000) The effects of school climate on school disorder Annals of the American Academy of Political and Social Science, 567, 88–107 Welsh, M., Parke, R D., Widaman, K., & O’Neill, R (2001) Linkages between children’s social and academic competence: A longitudinal analysis Journal of School Psychology, 39 (6), 463–481 Wenzlaff, T L., Fager, J J., & Coleman, M J (1999) What is a rubric? Do practitioners and the literature agree? Contemporary Education, 70 (4), 41–46 Wesley, P W., & Buysse, V (2006) Ethics and evidence in consultation Topics in Early Childhood Special Education, 26 (3), 131–141 West, S L., & O’Neal, K K (2004) Project D.A.R.E outcome effectiveness revisited American Journal of Public Health, 94 (6), 1027–1029 Westen, D I (2006a) Patients and treatments in clinical trials are not adequately representative of clinical practice In J C Norcross, L E Beutler, & R F Levant (Eds.), Evidence-based practices in mental health: Debate and dialogue on the fundamental questions (pp 161–171) Washington, DC: American Psychological Association 348 References Westen, D I (2006b) Transporting laboratory-validated treatments to the community will not necessarily produce better outcomes In J C Norcross, L E Beutler, & R F Levant (Eds.), Evidence-based practices in mental health: Debate and dialogue on the fundamental questions (pp 383–393) Washington, DC: American Psychological Association Westen, D., Novotny, C M., & Thompson-Brenner, H (2005) EBP ≠ EST: Reply to Crits-Christroph et al (2005) and Weisz et al (2005) Psychological Bulletin, 131 (3), 427–433 What Works Clearinghouse (2006a) Teacher intervention confound Retrieved June 11, 2007, from http://w-w-c.org/reviewprocess/teacher_confound.pdf What Works Clearinghouse (2006b) What Works Clearinghouse evidence standards for reviewing studies Retrieved June 11, 2007, from http://w-w-c org/reviewprocess/study_standards_final.pdf What Works Clearinghouse (2006c) What Works Clearinghouse tutorial on mismatch between unit of assignment and unit of analysis Retrieved June 11, 2007, from http://w-w-c.org/reviewprocess/mismatch.pdf Wheat, K (1999) Liability for failure to diagnose dyslexia Journal of Forensic Psychiatry, 10 (2), 355–365 Willet, S L (1996) Health risk reduction among African American females: A one-year follow-up Northwestern University, AAT 9614861 Dissertation Abstracts International, Section B: The Sciences and Engineering, 57 (1-B), p 0717 UMI #9614861 Williams, M., Grinnell, R G., Jr., & Unrau, Y (2008) Case level designs In R M Grinnell, Jr., & Y A Unrau (Eds.), Social work research and evaluation: Quantitative and qualitative approaches (8th ed., 157–178) New York: Oxford University Press Winter, D (2006) Avoiding the fate of the Dodo bird: The challenge of evidence-based practice In D Loewenthal & D Winter (Eds.), What is psychotherapeutic research? (pp 41–46) London: Karnac Winters, W G., & Easton, F (1983) The practice of social work in schools: An ecological perspective New York: Free Press Witkin, S L (1991) Empirical clinical practice: A critical analysis Social Work, 36 (2), 158–165 Woerner, W., Fleitlich-Bilyk, B., Martinussen, R., Fletcher, J., Cucchiaro, G., Dalgalarrondo, P., et al (2004) The Strengths and Difficulties Questionnaire overseas: Evaluations and applications of the SDQ beyond Europe European Child and Adolescent Psychiatry, 13 (Suppl 2), II47–II54 Wolfersberger, M E., Reutzel, D R., Sudweeks, R., & Fawson, P C (2004) Developing and validating the Classroom Literacy Environmental Profile References 349 (CLEP): A tool for examining the “print richness” of early childhood and elementary classrooms Journal of Literacy Research, 36 (2), 211–272 Wood, J R., & Nezworksi, M T (2005) Science as a history of corrected mistakes: Comment American Psychologist, 60 (6), 657–658 Wouters, P., Reddy, C., & Aguillo, I (2006) On the visibility of information on the Web: An exploratory experimental approach Research Evaluation, 15 (2), 107–115 Yell, M L., & Stecker, P M (2003) Developing legally correct and educationally meaningful IEPs using curriculum-based measurement Assessment for Effective Intervention, 28 (3–4), 73–88 Youngstrom, E A., & Busch, C P (2000) Expert testimony in psychology: Ramifications of Supreme Court decision in Kumho Tire Co Ltd v Carmichael Ethics and Behavior, 10 (2), 185–193 Yu, L (1999) Preventing depressive symptoms in Chinese children University of Pennsylvania Dissertation Abstracts International, Section B: The Sciences and Engineering, 60 (12-B), 2000, 6389 UMI #9953624 Zhang, D (2005) Parent practices in facilitating self-determination skills: The influence of culture, socioeconomic status, and children’s special education status Research and Practice for Persons with Severe Disabilities, 30 (3), 154–162 Zimmerman, T S., Jacobsen, R B., MacIntyre, M., & Watson, C (1996) Solution-focused parenting groups: An empirical study Journal of Systemic Therapies, 15 (4), 12–25 Zimpfer, D G (1990) Groups for divorce/separation: A review Journal for Specialists in Group Work, 15 (1), 51–60 Zins, J E., Bloodworth, M R., Weissberg, R P., & Walberg, H J (2004) The scientific base for linking social and emotional learning to school success In J E Zins, R P Weissberg, M C Wang, & H J Walberg (Eds.), Building academic success on social and emotional learning: What does the research say? (pp 3–22) New York: Teachers College Press 350 References Index Page numbers in italics indicate boxes or figures Abstinence-only programs, 20 Abstract screening, 97–98 Accommodations, 209 Adapting the evidence guidelines for, 157–158 reasons for, 135–137 Appraisal forms cohort study evaluation form, 123 effectiveness studies evaluation form, 115–116 instrument study evaluation form, 121 meta-analysis summary evaluation form, 109 survey evaluation form, 128 Appraising the evidence primary evidence consistency, 113–115 relevance, 110–111 strength, 111–113 secondary evidence, 104–109 Asking questions answerable questions, 45–46, 46 unanswerable questions, 29, 58 Assessment questions diagnosis, 50–51 intervention planning, 51–52 screening, 48–50 Avoiding harm, 11–12 Bell-shaped curve, 120 Best evidence, 40, 78–79 Biases confirmation, 107–108 expectation, 119 language, 119 nonresponse, 125 publication, 107 response, 35, 115, 119, 190 sampling, 190 workup, 119 Boolean logic Boolean operators, 79–80 Boolean syntax, 81 Cart before the horse problem, 91–93 Causation three tests, 190 Choosing the best intervention, 129–130, 209, 237 Classroom environment scales, 271 Clearinghouses for systematic reviews Campbell Collaboration, 74–75 SAMHSA registry, 75–77 What Works Clearinghouse, 72–74 Clinical cut scores, 120 Clinical significance vs Statistical significance, 191–192 Columbine tragedy, 58–59 Contextual constraints intensive treatment, 154–157 short-term groupwork, 152–154 teacher consultation, 151–152 Continuum of evidence, Cookbook practice, 39–40 Core professional journals, 31–32 Correlation vs Causation, 189–191 Cultural sensitivity African Americans, 148 Asians, 148–149 critical factors, 146–147 Hispanics, 147–148 Native Americans, 206–207 351 DARE program, 60–61, 106 Data analysis, 179 Databases ERIC, 81–85 PsycINFO, 88–95 PubMed, 85–87 Social Work Abstracts, 95–97 Data collection frequency, 178 Data dredging, 127 Definitions evidence based practice, 27 evidence based practitioners, 28 primary research, 68 reliable evidence, scientifically based research, 7–8 secondary research, 68 Developmental considerations affective education, 138–142 cognitive restructuring, 142 engagement, 138 parent involvement, 142–144 self-determination skills, 145–146 tasks/homework, 144–145 Dissemination of research to practice, 255 Dodo bird verdict, 3, 272 Dose-response, 122, 187 Effectiveness, 62–63 Effect sizes, 108 Efficacy, 61–62 Emperor’s New Clothes, 36–39 Empirically supported treatments, 27 Ethics host settings, 222 informed consent, 222 release of information, 250–251 typology, 233 Evaluating web-based information, 34 Evidence based practice art of, 58, 130, 133–134 caricatures of, 36–40 definition, 27 personal objections, 272–273 pitfalls, 41–42 process, 28–35, 29 352 Excel® common operators, 182 data entry, 181–184 frequency distributions, 183–185 pivot table results, 185 pivot tables, 184–185 spreadsheet: data entry, 184 Federal legislation FERPA, 248–251 IDEA, 7–8, 46–51, 58–59, 61, 198–199, 201, 203, 227, 229, 232–233, 259 No Child Left Behind, 7–8, 39, 46, 72, 198, 251 Rehabilitation Act (Section 504), 52 Federal Rules of Evidence, 5–6 File drawer problem, 107 Funnel approach to service delivery, 150 Generic factors, 41 Goal attainment scaling, 206–207 GOBSAT Guidelines, 38 Google, 30 Grey literature, 107 Group research designs descriptive, 165–167 explanatory, 167 exploratory, 165 Hierarchy of evidence, 70 Iatrogenic effects death by medication, 16–17 death by restraint, 15–16 death by therapy, 13–14 IDEA See Federal legislation Implementation barriers institutional issues, 267–272 lack of relevant information, 264–266 lack of technology skills, 266–267 lack of time, 263–264 Individualized Education Programs (IEPs) benchmarks, 212 cookie-cutter goals, 201 Index establishing baselines, 201–208 measurable annual goals, 208–212 myths of measurability, 211 Informed assent, 231 Informed consent capacity, 225 clinical research, 226–227 information, 225–228, 230 passive consent, 222, 236 paternalism, 228, 236 voluntariness, 228 Integration of research & practice, 25–26 Invisible web, 78 Levels of measurement, 180 descriptive statistics and, 186 inferential statistics and, 188 Literature reviews journalistic, 68 systematic, 68 Logs daily, 171 weekly, 172 Measurable annual goals benchmarks, 212 defined actions, 210 environmental conditions, 208 performance criteria, 210–212 services needed, 208–210 Mental health problems prevalence in children, 149–150 Meta-analysis, 104–109 seven steps, 105 Minors emancipated, 234–235 emergency care, 235 mature, 234 Modifications, 209 No Child Left Behind See Federal legislation Optimal treatment, 12–13 Organizational change assessing readiness to change, 258–259 Index cornerstones, 256–257 force field analysis, 260–261 stages of change, 257–262 types of implementation, 257 Outcome evaluation, 27–28, 35–36, 163–164 Parents access & control of records, 248–251 consent for minor children, 229 questions about EBP, 248 Peer-review, 8, 71 Person-in-environment perspective, 26–27 Philosophies of science constructivism, 21 critical realism, 22–23 positivism, 21 Practice-based evidence, 134, 190 Process of EBP adaptation and application, 33–35 answerable questions, 29 critical appraisal, 32–33 investigating the evidence, 29–32 outcome evaluation, 35–36 Progress monitoring behavioral change, 200 progress measurement plan, 199 regular reporting, 199–200 revolving door, 200–201 single standard for progress, 198–199 Pseudoscience, 6–7 Purpose synonyms, 94 Quasi-experimental designs (QEDs), 113 Questions assessment, 48–52 description, 52–53 intervention, 61–63 prevention, 59–60 risk, 53–59 Randomized controlled trials (RCTs), 111–113 Rapid assessment instruments, 51 353 Reasons for EBP clinical, 9–17 economic, 19–20 educational, 18–19 ethical, 4–5 legal, 5–9 Recommended ratios, 39–40, 46 Referral issues & standardized instruments, 173–176 Relative risk, 123 Reliability, 118 Research vulnerability & developmental growth, 242–243 Response-to-Intervention, 11, 150, 178, 192, 247 Rigor quantitative vs qualitative terms for, 129 Rubrics for emotional, behavioral, and social issues, 204–205 SAMHSA’s Registry of Evidence-Based Programs & Practices, 75–77 Sampling bias, 190 nonprobability, 125 probability, 125 Scared Straight programs, 28 School climate scales, 270 Scientifically based indicators, 84 Scientific fairness, 71–72 Secondary research guidelines for going beyond, 69–70 meta-analysis, 69 reasons for, 68–69 Self-determination defining the primary client, 238–241 dignity of risk, 237–238 education for risk-taking, 238 paternalism, 245–247 research on, 243–245 Sensitivity, 117 Significance clinical, 191–192 statistical, 191–192 354 Single-subject designs single-subject reversal designs, 214–215 within-subject designs, 213–215 Six degrees of separation, 273–274 Social validity, 169, 217–218 Sources of data archival school records, 167–168 daily/weekly logs, 169–170 direct observation, 170–171 rating scales, 170 scaled questions, 178 teacher interviews, 168–169 Special education, 198–201 Specificity, 117 Standards of care, 9–10 Statistical analysis descriptive, 185–186 inferential, 186–189 Statistical tests central tendency, 185 nonparametric, 125–126 parametric, 125–126 variability, 185 Strengths-based practice, 46–48 Student information letter, 230 Student permission note, 231 Student self-monitoring, 216–217 Supreme Court Cases Daubert v Merrell Dow Pharmaceuticals, 5–6 General Electric Co v Joiner, In re Gault, 228–229 Kumho Tire Co v Carmichael, Planned Parenthood of Missouri v Danforth, 229 Tinker v Des Moines Independent School District, 229 Systematic reviews, 104–109 Threats to internal validity, 166, Appendix C Treatment fidelity, 61–62, 158–159, 165 Treatment manuals, 136 Triangulation, 99 Types of questions, 104 Types of studies cohort, 121–123 Index effectiveness, 104–116 instrument, 116–121 qualitative, 128–129 quantitative, 124–126 Validity, 118 Variables dependent, 164 independent, 165 Index Virginia Tech tragedy, 55–57 Visual analysis level, 215 trend, 216 variability, 216 Willowbrook School, 223–224 355 ... by mental health interventions First, school behavioral measures indicated increases in school attendance and school bonding as well as decreases in disciplinary referrals, grade retention, school. .. National Center for School Counseling Outcome Research http://www.umass.edu/schoolcounseling/ 24 Evidence-Based Practice in School Mental Health ■■■ Evidence-Based Practice: Definition and Process... stimulating and useful in your daily practice viii Preface EVIDENCE-BASED PRACTICE IN SCHOOL MENTAL HEALTH This page intentionally left blank ■■■ Introduction Preview Thirty years ago, in a classic