Shank Harden dissertation formatted after defenseCPR--Complete Final Edited Version.docx

A Dissertation Entitled Changes of University of Rhode Island Change Assessment Over Time Associated with Stages of Change By Tamara Shank Harden Submitted to the Graduate Faculty as a partial fulfillment of the requirements for the Doctor of Philosophy Degree in Counselor Education Dr Christopher Roseman, Committee Chair Dr John Laux, Committee Member Dr Yanhong Liu, Committee Member Dr Wendy Cochrane, Committee Member Dr Amanda Bryant-Friedrich Dean, College of Graduate Studies The University of Toledo May 2017 Copyright 2017, Tamara Shank Harden This document is copyrighted material Under copyright law, no parts of this document may be reproduced without the expressed permission of the author An Abstract of Changes of University of Rhode Island Change Assessment Over Time Associated with Stages of Change By Tamara Shank Harden Submitted to the Graduate Faculty as a partial fulfillment of the requirements for the Doctor of Philosophy in Counselor Education The University of Toledo May 2017 Approximately one-quarter of the American population are affected by their own mental illness each year (National Alliance on Mental Illness [NAMI], 2013) Of those who take part in counseling, one-third to one-half not see treatment gains and approximately 50% leave counseling prematurely (Duncan, Miller & Hubble, 2007).) Research examining immediate feedback on the therapeutic alliance and therapeutic progress has shown statistically significant therapeutic improvements (Reese, Norworthy, & Rowlands, 2009) In addition, the client’s stage of change has been shown through research to correlate with progress in counseling (Ogrodniczuk, Joyce, & Piper, 2005) Clients who have not met their goals and leave counseling prematurely have described a reduction in therapeutic improvement and more emotional distress and are two times as likely seek out mental health services again, often becoming “chronic” clients (Ogrodniczuk, Joyce, and Piper (2005) Premature termination, along with other factors, leads to 10% of clients being the source of 60-70% of expenses (Miller, n.d.) The purpose of this research was to determine whether completing Feedback Informed Treatment (FIT) moved clients through the Stages of Change more quickly, discouraging iii premature termination and lowering mental health expenses Participants were mental health clients 18 and over assigned to four counselors for counseling at a community counseling center Half of the participants were given FIT and half were not The intent was for the URICA scores of the two groups to be compared to determine if FIT moves people through the Stages of Change more quickly URICA scores were measured at the beginning of counseling and at 30 days and 60 days when possible Six participants consented to the research so descriptive statistics are presented This study showed it would be worthwhile to rerun the study with a larger sample iv This dissertation is dedicated to Bob, mom, Molly, and Abby Although I lost all of you during this process, your love, encouragement, support, and companionship made this project possible Acknowledgements This signifies the end of many years of dedication I did not accomplish alone I would like to acknowledge several of the people who believed in me and offered support Dr Martin Ritchie was my first advisor and staunch believer in my capabilities, even through times of great loss, ensuring I kept momentum toward the ultimate goal Dr John Laux provided support and feedback, ensuring my comprehensive exams were completed, and also served on my dissertation committee Dr Christopher Roseman, chairperson of my dissertation committee, encouraged and guided me through some tough deadlines I would like to thank the other members of my dissertation committee: Dr Yanhong Liu and Dr Wendy Cochrane for their feedback and encouragement Sue Martin, department secretary, has been a source of smiles, encouragement, support, and information Her help has been invaluable Graduating from the Counselor Education program at the University of Toledo is a great source of pride This project would not have been possible without the team of professionals at Behavioral Connections of Wood County Clancy, I don’t have words to thank you for your support and all the assistance you have provided Tiffany and Julie you have become my friends and I am forever grateful to you Bob- we made it You knew it would happen all along Mom- I hope you can see and are proud Molly and Abby your constant companionship and love kept me going I wish you were all here to see the culmination Scott, what can I say? You put up with me, fed me, edited, and were always here Dad, Tonya, and Bob, I did it Karen, your support means everything Shawn and Patty, thanks for listening vi Table of Contents Abstract iii Acknowledgements vi Table of Contents vii List of Tables xii I Chapter One: Introduction A General Introduction B Background of the Problem C Statement of the Problem D Purpose of the Study E Research Question F Significance of the Study G Research Design H Definition of Terms I Organization of Chapters 10 J Summary 11 II Chapter 2: Literature Review 12 A Introduction 12 B Prevalence of Mental Health Issues in the United States 12 C a Effect of Caring for the Mentally Ill on the American Economy and How We Can Manage It 13 b “The Age of Accountability.” 15 Ethical Responsibilities of Mental Health Professionals vii 16 D History of Outcomes 18 E Importance of Outcomes 19 F Reluctance of Counselors to Use Outcomes 20 G Feedback 23 a Patient-Focused Research H 27 Use of Feedback/Outcomes 28 a Evidence- Based Practice 29 b Practice-Based Evidence 30 I Overview and History of FIT 31 J Measures of Client Functioning and Effect on Outcomes 34 K Therapeutic Alliance as it Relates to the Outcome of Counseling 34 L Measures of Feedback on Client Functioning 36 a Behavior and Symptom Identification Scale (BASIS-24) 37 b Clinical Outcomes in Routine Evaluation (CORE-OM) 38 c Outcome Questionnaire (OQ-45) 39 d Patient Reported Outcomes Management Information System (PROMIS) 40 e Symptom Checklist-Revised (SCL-90-R) 42 f Brief Symptom Inventory (BSI) 43 g Outcome Rating Scale (ORS) 43 M Measures of the Therapeutic Alliance 45 a California Counseling Alliance Scale (CALPAS) 45 b Helping Alliance Questionnaire (HAQ) 46 viii C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an c Working Alliance Inventory (WAI) 47 d Session Rating Scale (SRS) 48 N Stages of Change 49 a Transtheoretical Model 51 O Measures of Stages of Change 52 a Stages of Change Readiness and Treatment Eagerness Scale (SOCRATES) 53 b Readiness to Change Questionnaire 53 c Scale for the Multiperspective Assessment of General Change Mechanisms in Counseling (SACiP) d University of Rhode Island Change Assessment (URICA) P Summary 54 54 56 III Chapter 3: Overview of Study 58 A Introduction 58 B Overview of the Method 58 C Research Design 60 D Description of Participants 60 E Sampling Procedures 62 F Data Collection 63 G Instrumentation 63 a Feedback Informed Treatment (FIT) 63 i Outcome Rating Scale (ORS) 64 ii Session Rating Scale (SRS) 66 iii University of Rhode Island Change Assessment ix Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an (URICA) 68 H Variables 69 I Procedures 69 J Research Question 70 K Data Analysis 71 L Statement of Limitations 71 M Summary 73 IV Chapter : Results 74 A Introduction 74 B Explanation of Descriptive Statistics 75 C Descriptive Statistics for Study Sample 76 D Summary of Results 80 V Chapter 5: Discussion 81 A Discussion 81 B Conclusions 83 C Implications for Counselors 87 D Limitations 88 a Threats to Internal Validity 92 b Threats to External Validity 93 E Recommendations for Further Research References 94 97 Appendices A Demographic Form 115 x Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Lutz, W (2007) Enhancing outcome for potential treatment failures: Counselor/client feedback and clinical support tools Counseling Research, 17, 379-392 doi: 10.1080/10503300600702331 Harvard University (2004) Counseling at midlife: Worth the trouble Harvard Harvard Women’s Health Watch, 12(2), 4-6 Retrieved from: http://www.health.harvard.edu/mind-and-mood/counseling-at-midlife Hatchett, G (2011) Training counseling students to work more effectively with shortterm clients International Journal for the Advancement of Counseling, 33(3), 206-215 doi: 10.1007/s10447-011-9124-6 Hawkins, E J., Lambert, M J., Vermeersch, D A., Slade, K., & Tuttle, K (2004) The effects of providing patient progress information to counselors and patients Counseling Research, 14, 308-327 doi: 10.1093/ptr/kph027 Horvath, A O, Del Re, A C., Flückiger, C., & Symonds, D (2011) Alliance in Individual counseling Counseling 48(1), 9-16 doi: 10.1037/a0022186 Hubble, M A., Duncan, B L., Miller, S D & Wampold, B E (2010) Introduction In B L Duncan, S D Miller, B E Wampold, & M A Hubble (Eds.), The heart And soul of change (2nd ed.) (pp 23-46) Washington, DC: American Psychological Association Jacobson, N S., & Truax, P (1991) Clinical significance: A statistical approach to Defining Meaningful change in counseling research Journal of Consulting and Clinical Psychology, 59, 12-19 doi: 10.1037/10109-042 Josefsson, T B (2013) Rate of change in counseling: A matter of patients Retrieved 104 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an from Networked Digital Library of Theses and Dissertations http://liu.divaportal.org/smash/get/diva2:730552/FULLTEXT01.pdf Kliff, S (2012, December 17) Seven facts about America’s health-care system The Washington Post Retrieved from http://www.washingtonpost.com/blogs/wonkblog/wp/2012/12/17/seven-facts-a bout-americas-mental-health-care-system/ BLOG? Kopta, M., Owen, J., & Budge, S (2015) Measuring counseling outcomes with the Behavioral Health Measure-20: Efficient and comprehensive Counseling, 52, 442-448 doi: 10.1037/pst0000035 Lambert, M J (2005) Emerging methods for providing clinicians with timely feedback On treatment effectiveness: An introduction Journal of Clinical Psychology/In Session, 61(2), 141-144 doi: 10.1002/jclp.20106 Lambert, M J (2010) “Yes, it is time for clinicians to routinely monitor treatment outcome.” In B L Duncan, S D Miller, B E Wampold, & M A Hubble (Eds.), The heart and soul of change (2nd ed.) (pp 239-266) Washington, DC: American Psychological Association Lambert, M J (2013) Introduction and historical overview In M J Lambert (Ed.), Bergin and Garfield’s handbook of counseling and behavior change (6th ed.) (pp 3-20) Hoboken, NJ: John Wiley & Sons, Inc Lambert, M J (2015) Progress feedback and the OQ-System: The past and the future Counseling, 52, 381-390 doi: 10.1037/pst0000027 Lambert, M J., Jasper, B W., & White, J (2005) Key principles in the assessment of 105 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an counseling outcome In G Koocher, J Norcross, & S Hill III (Eds.), Psychologists desk reference (2nd ed.) (pp 236-240) New York, NY: Oxford University Press, Inc Lambert, M J & Shimokawa, K (2011) Collecting client feedback Counseling, 48(1), 72-79 doi: 10.1037/a0022238 Lambert, M J., Whipple, J L., Hawkins, E J., Vermeersch, D A., Nielsen, S L., & Smart, D W (2003) Is it time for clinicians to routinely track patient outcome? A meta-analysis Clinical Psychology Science and Practice, 10, 288-301 doi: 10.1093/clipsy/bpg025 Lambert, M J., Whipple, J L., Smart, D W., Vermeersch, D A., Nielsen, S L., & Hawkins, E J (2001) The effects of providing counselors with feedback on client progress during counseling: Are outcomes enhanced? Counseling Research, 11, 49-68 Retrieved from: http://tartarus.ed.utah.edu/users/dan.woltz/EDPS%207400/Assignment%20Materi als/Lambert_2001.pdf Lambert, M J., Whipple, J L., Vermeersch, D A., Smart, D W., Hawkins, E J., Nielsen, S L., & Goates, M K (2002) Enhancing counseling outcomes via providing feedback on client progress: A replication Clinical Psychology and Counseling, 9, 91-103 doi: 10.1002/cpp.324 Luborsky, J P., Barber, J P., Siqueland, L., Johnson, S., Najavits, L M., Frank, A., & Daley, D (1996) The Revised Helping Alliance Questionnaire (HAQ-II) Journal Of Counseling, Practice, and Research, 5, 260-271 Retrieved from: http://www.ncbi.nlm.nih.gov/pubmed/22700294 106 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Mander, J., Schlarb, A., Teufel, M., Hautzinger, M., Zipful, S., Wittorf, A., & Sammet, I (2015) The Individual Counseling Process Questionnaire: Development and validation of a revised measure to evaluate general change mechanisms in counseling Clinical Psychology and Counseling, 22, 328-345 doi: 10.1002/cpp.1892 Mander, J., Wittorf, A., Klingberg, S., Teufel, M., Zipfel, S., & Sammet, I (2014) The patient perspective on therapeutic change: The investigation of associations between stages of change and general mechanisms of change in counseling research Journal of Counseling Integration, 24(2), 122-137 doi: 10.1037/a0036976 McConnaughy, E A., Prochaska, J O., & Velicer, W F (1983) Stages of change in counseling: Measurement and sample profiles Counseling: Theory, Research, and Practice, 20, 368-375 doi: 10.1037/h0090198 Mellor-Clark, J., Barkham, M., Connel, J., & Evans, C (1999) Practice-based evidence And need for standardized evaluation system: Informing the design of the CORE system European Journal of Counseling, Counseling, and Health, 3, 357-374 Retrieved from: http://www.tandfonline.com/doi/abs/10.1080/13642539908400818?src=recsys#.V 1ie0Y-cGuU Merrick, E L., Garnick, D W., Horgan, C M., & Hodgkin, D (2002) Quality measurement and accountability for substance abuse and mental health services in managed care organizations Medical Care, 40, 1238-1248 doi: 10.1097/01.MLR.0000036407.98637.B2 107 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Mertler, C A., & Charles, C M (2005) Introduction to educational research (5th ed.) Boston, MA: Pearson Education Miller, S D (n.d.) The heart and soul of change: What works in counseling [PowerPoint slides] Retrieved from:http://www.scottdmiller.com/wpcontent/uploads/What%20Works%202010.PDF Miller, S D., Duncan, B L., Brown, J., Sparks, J A., & Claud, D A (2003) The Outcome Rating Scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure Journal of Brief Counseling, 2(2), 91100 Retrieved from http://scottdmiller.com/wp-content/uploads/documents/OutcomeRatingScaleJBTv2n2.pdf Miller, S D., Duncan, B L., Sorrell, R., & Brown, G S (2005) The Partners for Change Outcome Management System Journal of Clinical Psychology IN Session, 61(2) doi: 10.1002/jclp.20111 Miller, S D., Hubble, M A., Chow, D., & Seidel, J (2015) Beyond measures and monitoring: Realizing the potential of Feedback-Informed Treatment Counseling, 52, 449-457 doi: 10.1037/pst0000031 Minieri, A M., Reese, R J., Miserocchi, K M., & Pascale- Hague, D (2015) Using client feedback in training of future counseling psychologists: An evidence-based and social justice practice Counseling Psychology Quarterly, 28, 305-323 doi: 10-1080/09515070.2015.1055236 Mojtabai, R., & Jorm, A F (2015) Trends in psychological distress, depressive 108 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an episodes, and mental health treatment-seeking in the United States: 2001-2012 Journal of Affective Disorders, 174, 556-561 doi: 10.1016/j.jad.2014.12.039 National Alliance on Mental Illness (2013) Mental illness facts and numbers Retrieved from http://www2.nami.org/factsheets/mentalillness_factsheet.pdf National Institute of Mental Health (2015) Publication 15-6368 Strategic plan for research Retrieved from: https://www.nimh.nih.gov/about/strategic-planningreports/nimh_strategicplanforresearch_508compliant_corrected_final_149979.pdf Norcross, J C (2010) The therapeutic relationship In B L Duncan, S D Miller, B E Wampold, & M A Hubble (Eds.), The heart and soul of change (2nd ed.) (pp 113-141) Washington, DC: American Psychological Association Norcross, J C., Krebs, P M., & Prochaska, J O (2011) Stages of change Journal of Clinical Psychology in Session, 67(2), 143-154 doi: 10.1002/jclp.20758 Office of Inspector General (2000) Mandatory managed care: Changes in Medicaid mental health services Retrieved from: https://permanent.access.gpo.gov/gpo73527/oei-04-97-00340.pdf Ogrodniczuk, J S., Joyce, A S., & Piper, W E (2005) Strategies for reducing patientinitiated premature termination of counseling Harvard Review of Psychiatry, 13(2), 57-70 doi: 10.1080/10673220590956429 Okiishi, J C., Lambert, M J., Eggett, D., Nielsen, L., & Dayton, D D (2006) An analysis of counselor treatment effects: Toward providing feedback to individual counselors on their clients’ counseling outcome Journal of Clinical Psychology 62, 1157-1172 doi: 10.1002/jclp.20272 Parker, K., & Parikh, S V (2001) Applying Prochaska’s model of change to needs 109 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an assessment, programme planning and outcome measurement Journal of Evaluation in Clinical Practice, 7, 365-371 Retrieved from: http://www.ncbi.nlm.nih.gov/pubmed/11737528 Pilkonis, P.A., Choi, S W., Reise, S P., Stover, A M., Riley, W T., & Cella, D., on behalf of the PROMIS® Cooperative Group (2011) Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, anxiety, and anger Assessment, 18, 263-283 Retrieved from: http://www.ncbi.nlm.nih.gov/pubmed/21697139 Prescott, D (2013) Feedback Informed Treatment [PowerPoint slides] Retrieved from http://www.davidprescott.net/2013FIT-MASOC.pdf Prochaska, J O., Norcross, J C., & DiClemente, C C (2005) Stages of change: Prescriptive guidelines In G Koocher, J Norcross, & S Hill III (Eds.), Psychologists desk reference (2nd ed.) (pp 226-232) New York, NY: Oxford University Press, Inc Reese, R J., Norsworthy, L A., & Rowlands, S R (2009) Does a continuous feedback system improve counseling outcome? Counseling Theory, Research, Practice, Training, 46, 418-431 doi: 10.1037/a0017901 Renk, K & Dinger, T.M (2002) Reasons for counseling termination in a university psychology clinic Journal of Clinical Psychology, 58, 1173-1181 doi: 10.1002/jclp.10075 Rochlen, A B., Rude, S S., & Barόn, A (2005) The relationship of client stages of change to working alliance and outcome in short-term counseling Journal of College Counseling, 8, 52-64 doi: 10.1002/j.2161-1882.2005.tb00072.x 110 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Sapyta, J., Riemer, M., & Bickman, L (2005) Feedback to clinicians: Theory, research, and practice JCLP/In Session, 6(2), 145-153 doi: 10.1002/jclp.20107 Seidel, J A., Andrews, W P., Owen, J., Miller, S D., & Buccino, D L (2017) Preliminary validation of the Rating of Outcome Scale and equivalence of ultrabrief measures of well-being Psychological Assessment, 29(1), 65-75 doi: 10.1037/pas0000311 Shaw, S L., & Murray, K W (2014) Monitoring alliance and outcome with client Feedback measures Journal of Mental Health Counseling, 36, 43-57 doi: 10.17744/mehc.36.1.n5g64t3014231862 Simon, W., Lambert, M J., Harris, M W., Busath, G., & Vazquez, A (2012) Providing patient progress information and clinical support tools to counselors: Effects on patients at risk of treatment failure Counseling Research, 22, 638-647 doi: 10.1080/10503307.2012.698918 Stoltz K B & Kern, R M (2007) Integrating lifestyle, the therapeutic process, and the stages of change The Journal of Individual Psychology, 63(1), 32-47 Retrieved from http://utpress.utexas.edu/index.php/journals/journal-of-individualpsychology Slone, N C., & Owen, J (2015) Counselor alliance activity, counselor comfort, and Systemic alliance on individual counseling outcome Journal of Counseling Integration, 25(4), 275-288 doi: 10.1037/a0039562 Smits, D., Luyckx, K., Smits, D., Stinckens, N., & Claes, L (2015) Structural Characteristics and external correlates of the Working Alliance Inventory- Short Form Psychological Assessment, 27, 545-551 doi: 10.1037/pas0000066 111 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Stoltz K B & Kern, R M (2007) Integrating lifestyle, the therapeutic process, and the stages of change The Journal of Individual Psychology, 63(1), 32-47 Retrieved from: http://utpress.utexas.edu/index.php/journals/journal-of-individualpsychology Substance Abuse and Mental Health Services Administration (2013) Results from the 2012 national survey on drug use and health: Mental health findings Retrieved from http://archive.samhsa.gov/data/NSDUH/2k12MH_FindingsandDetTables/2K12M HF/NSDUHmhfr2012.htm Sutton, S (2001) Back to the drawing board? A review of applications of the transtheoretical model to substance use Addiction, 96(1), 175-186 doi: 10.1046/j.1360-0443.2001.96117513.x Szabo, L (2014, May Twelth) USA Today Cost of not caring: Nowhere to go Retrieved from http://www.usatoday.com/story/news/nation/2014/05/12/mental-healthsystem-crisis/7746535/ Tambling, R B & Ketring, S A (2014) The R-URICA: A confirmatory factor analysis and a revision to the URICA Journal of Contemporary Family Counseling, 36, 108-119 doi: 10.1007/s10591-013-9279Tartakovsky, M (n.d.) Feedback informed treatment: Empowering clients to use their voices Retrieved from http://psychcentral.com/lib/feedback-informed-treatmentempowering-clients-to-use-their-voices/ Tarescavage, A M., & Ben-Porath, Y S (2014) Psychotherapeutic outcomes measures: A critical review for practitioners Journal of Clinical Psychology, 70, 808- 112 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an 830 doi: 10.1002/jclp.22080 Trochim, W M (2006) Research methods knowledge base Retrieved from: socialresearchmethods.net/kb/quasnegd.php URICA Score Sheet (n.d.) University of Rhode Island change assessment (URICA) Retrieved from: http://www.fadaa.org/archive/Annual_Conference/2010/Handouts/Wednesday/Gl ebe_handout4-UnivRI_Change_AssessScale.pdf U.S Department of Health and Human Services (n.d.) Health Insurance and Mental Health Services Retrieved from https://www.mentalhealth.gov/get-help/healthinsurance/index.html U.S Department of Labor (2010) Fact sheet Retrieved from: https://www.dol.gov/sites/default/files/ebsa/about-ebsa/our-activities/resourcecenter/fact-sheets/fsmhpaea.pdf Warren, J S., Nelson, P L., Burlingame, G M., & Mondragon, S A (2012) Predicting patient deterioration in youth mental health services: Community mental health vs managed care settings Journal of Clinical Psychology, 68(1), 24-40 doi: 10.1002/jclp.20831 Wells, M G., Burlingame, G M., Lambert, M J., Hoag, M J., & Hope, C A (1996) Conceptualization and measurement of patient change during counseling: Development of the Outcome Questionnaire and Youth Outcome Questionnaire Counseling: Theory, Research, Practice, Training, 33(2), 275-283 doi: 10.1037/0033-3204.33.2.275 Westmacott, R., Hunsley, J., Best, M., Rumstein-McCean, O., & Schindler, D (2010) 113 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Client and counselor views of contextual factors related to termination from counseling: A comparison between unilateral and mutual terminators Counseling Research, 20, 423-435 doi: 10.1080/10503301003645796 Whipple, J L., Lambert, M J., Vermeersch,, D A., Smart, D W., Nielsen, S L., & Hawkins, E J (2003) Improving the effects of counseling: The use of early identification of treatment failure and problem solving strategies in routine practice Journal of Counseling Psychology, 58, 59-68 doi: 10.1037/00220167.50.1.59 Xu, H., & Tracey, T J G (2015) Reciprocal influence model of working alliance and therapeutic outcome over individual counseling course Journal of Counseling Psychology, 62, 351-359 doi: 10.1037/cou0000089 Zuvekas, S H., Rupp, A E., & Norquist, G S (2005) The impacts of mental health parity and managed care in one large employer group: A Reexamination Health Affairs, 24, 1668-1671 doi: 10.1377/hlthaff.24.6.1668 114 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Appendix A Demographic Form Demographic Information Gender: Male Female Age: Race: Caucasian African-American Native-American Religious Affiliation: Christian Education Level: Hispanic Asian Hindu Other Other Muslim None 8th grade or below Some high school High school graduate Some college Bachelor’s Degree Graduate level 115 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Appendix B Consent Form to Participate in Research Dept of School Psychology, Higher Education, & Counselor Education HSHS Bldg., Room 3100 University of Toledo, Mail Stop 119 2801 W Bancroft St Toledo, Ohio 43606 Phone: 419-530-2718 419-530-7879 ADULT RESEARCH SUBJECT - INFORMED CONSENT FORM Feedback Informed Treatment: Building Strong Alliances Principal Investigator: Christopher Roseman, Ph.D., PC, 419-530-4064 Other Investigators: Tamara Harden, M.A., PC/CR, 419-872-2419 Clancy Yeager, PCC-S, LICDC-S 419-872-2419 Julie Moebius, PC 419-872-2419 Tiffany Sullivan, PC 419-872-2419 Purpose: You are invited to participate in the research project entitled, Feedback Informed Treatment: Building Strong Alliances, which is being conducted at the University of Toledo under the direction of John Laux, Ph.D The purpose of this study is to see if Feedback Informed Treatment empowers the client to provide constructive feedback to the professional counselor which, in turn, produces desired clinical results in a more efficient manner Description of Procedures: This research study will take place in Perrysburg and Bowling Green, Ohio, and will take approximately 3-5 minutes to complete during each counseling session This study will continue for a period of one year You will be asked to complete various questionnaires which you will evaluate After you have completed your participation, the research team will debrief you about the data, theory and research area under study and answer any questions you may have about the research 116 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Potential Risks: There are minimal risks to participation in this study, including loss of confidentiality Answering the questionnaires might cause you to feel upset or anxious If so, you may stop at any time Potential Benefits: The only direct benefit to you if you participate in this research may be that you will learn about how research studies are run and may learn more about Feedback- Informed Treatment Others may benefit by learning about the results of this research Confidentiality: The researchers will make every effort to prevent anyone who is not on the research team from knowing that you provided this information, or what that information is The consent forms with signatures will be kept separate from responses, which will not include names and which will be presented to others only when combined with other responses Although we will make every effort to protect your confidentiality, there is a low risk that this might be breached Voluntary Participation: Your refusal to participate in this study will involve no penalty or loss of benefits to which you are otherwise entitled and will not affect your relationship with Behavioral Connections In addition, you may discontinue participation at any time without any penalty or loss of benefits Contact Information: Before you decide to accept this invitation to take part in this study, you may ask any questions that you might have If you have any questions at any time before, during or after your participation, or psychological distress as a result of this research, you should contact a member of the research team: John Laux, Ph.D., 419530-4705 or Tamara Harden, M.A., 419-872-2419 If you have questions beyond those answered by the research team or your rights as a research subject or research-related injuries, the Chairperson of the SBE Institutional Review Board may be contacted through the Office of Research on the main campus at (419) 530-2844 Before you sign this form, please ask any questions on any aspect of this study that is unclear to you You may take as much time as necessary to think it over SIGNATURE SECTION – Please read carefully You are making a decision whether or not to participate in this research study Your signature indicates that you have read the information provided above, you have had all your questions answered, and you have decided to take part in this research The date you sign this document to enroll in this study, that is, today's date must fall between the dates indicated at the bottom of the page 117 Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn C.33.44.55.54.78.65.5.43.22.2.4 22.Tai lieu Luan 66.55.77.99 van Luan an.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.C.33.44.55.54.78.655.43.22.2.4.55.22 Do an.Tai lieu Luan van Luan an Do an.Tai lieu Luan van Luan an Do an Stt.010.Mssv.BKD002ac.email.ninhd 77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77.77.99.44.45.67.22.55.77.C.37.99.44.45.67.22.55.77t@edu.gmail.com.vn.bkc19134.hmu.edu.vn.Stt.010.Mssv.BKD002ac.email.ninhddtt@edu.gmail.com.vn.bkc19134.hmu.edu.vn