Q Chapter Assessing Leadership and Measuring Its Effects “Only 8% of Fortune 1000 executive directors rate their leadership capacity as excellent, while 47% rated their leadership capacity as fair to poor.” ~The Conference Board Leadership Literature Academic tradition Consists of articles that use data and statistical techniques to make inferences about effective leadership Troubadour Books McGraw-Hill/Irwin tradition and articles usually consisting of opinions 4-3 © 2006 The McGraw-Hill Companies, Inc All rights rese Leadership Research Many times research findings seem contrary to conventional wisdom about leadership It is difficult to provide practitioners with timely, easily digestible, research-grounded advice on how to effectively lead others High quality leadership research is difficult, expensive, and time consuming to conduct McGraw-Hill/Irwin 4-4 © 2006 The McGraw-Hill Companies, Inc All rights rese Leadership Research (continued) Practice-research gap – the tension between discovering the “truth” about a leadership question and being able to apply what is learned “Real” leaders rarely study findings of leadership research, turning instead to popular books and articles This information: Appears to provide timely answers to their practical concerns, however this information is rarely based on sound research Oversimplifies the complexities of the leadership process Many times offers bad advice McGraw-Hill/Irwin 4-5 © 2006 The McGraw-Hill Companies, Inc All rights rese Assessing Leadership Personal opinions about leadership effectiveness can vary substantially across individuals Putting the wrong people into key leadership positions can literally cost stock holders billions of dollars and lead to organizational ruin Many of the most commonly used leadership hiring techniques (application blanks, reference checks, and unstructured interviews) are also the least valid McGraw-Hill/Irwin 4-6 © 2006 The McGraw-Hill Companies, Inc All rights rese Best Practices in Assessing Leadership Potential Determine the leadership level of the position Build a competency model Use a multiple hurdles approach McGraw-Hill/Irwin 4-7 “The best predictor of future leadership behavior is past leadership behavior in similar circumstances.” Personnel Decisions International © 2006 The McGraw-Hill Companies, Inc All rights rese Multiple Hurdles Approach Figure 4-2 McGraw-Hill/Irwin 4-8 © 2006 The McGraw-Hill Companies, Inc All rights rese Multiple Hurdles Approach (continued) Use most inexpensive assessment techniques first Use Internet or paper-and-pencil measures of leadership effectiveness Interview the remaining talent pool Structural interviews Unstructured interviews Put the top three candidates through an assessment center McGraw-Hill/Irwin 4-9 © 2006 The McGraw-Hill Companies, Inc All rights rese Assessment Center Simulations In-Basket exercise Work simulation that requires candidate to actual “paperwork.” Role-Play simulations Actors are trained assessors who observe and rate the performance of each candidate McGraw-Hill/Irwin 4-10 © 2006 The McGraw-Hill Companies, Inc All rights rese Making Sense of the Process Many times having a clearly defined competency model, a biographical form, and structural interview questions linked to the model will a fairly good job of improving the odds of hiring good leaders Research is the only way to determine which assessment techniques are the most valid for which leadership positions Organizations will continue to experience shortfall in leadership talent as long as they continue to use assessment techniques that essentially result in little more than random selection McGraw-Hill/Irwin 4-11 © 2006 The McGraw-Hill Companies, Inc All rights rese Measuring the Effects of Leadership Just as various techniques are used to assess leaders, there are also various ways to measure their effects on subordinates and organizations When making judgment about the relative success of a leader we are examining the consequences or impact of these behaviors and not the behaviors per se McGraw-Hill/Irwin 4-12 © 2006 The McGraw-Hill Companies, Inc All rights rese Common Measures of Successful and Unsuccessful Leadership Superiors’ effectiveness and performance ratings Subordinates’ ratings of satisfaction, organizational climate, morale, motivation, and leadership effectiveness Unit performance indices McGraw-Hill/Irwin 4-13 © 2006 The McGraw-Hill Companies, Inc All rights rese Best Practices in Measuring Leadership Success Ratings by superiors and subordinates generally yield useful information about a leader’s effectiveness Multiple measures often yield the best information about leadership success Practitioners need to think critically about how their behavior affects the measures used to judge leadership success Practitioners need to be aware of leadership success measures being biased McGraw-Hill/Irwin 4-14 © 2006 The McGraw-Hill Companies, Inc All rights rese Methodologies Used to Study Leadership The Qualitative Approach The most common qualitative approach is the case study Quantitative Correlational Approaches studies Experiments McGraw-Hill/Irwin 4-15 © 2006 The McGraw-Hill Companies, Inc All rights rese Some Common and Uncommon Variations of Leadership Studies Table 4-5 McGraw-Hill/Irwin 4-16 © 2006 The McGraw-Hill Companies, Inc All rights rese Maxims and Theories of Leadership Maxims are personal opinions that can give leaders valuable advice about leadership A leadership theory is a framework for conceptualizing relationships between variables and guiding research toward a fuller understanding of phenomena McGraw-Hill/Irwin 4-17 © 2006 The McGraw-Hill Companies, Inc All rights rese Maxims and Theories of Leadership (continued) Theories are central to scientific research due to: Public predictions of how leadership variables are interrelated The systematic gathering and analysis of data Peer review of results Although both leadership maxims and theories are useful for understanding leadership situations, in general only leadership theories add to the body of knowledge concerning the science of leadership and help the development of universal laws of leadership McGraw-Hill/Irwin 4-18 © 2006 The McGraw-Hill Companies, Inc All rights rese Summary Organizations can and use a number of techniques to assess the values, personality, intelligence, and behaviors for any applicant pool Superiors’ ratings, subordinates’ ratings, and unit performance measures can many times paint different pictures about the relative success of a leader Case studies have the advantage of helping practitioners better understand the context in which a leader acts McGraw-Hill/Irwin 4-19 © 2006 The McGraw-Hill Companies, Inc All rights rese Summary (continued) Correlational studies have the advantage of using larger sample sizes and describe the statistical relationships between the results of different assessment techniques and success measures Leadership experiments yield valuable information about the cause and effect relationships between independent and dependent variables Maxims may represent valid advice, but they are ultimately no more than personal opinion Theories are a collection of testable predictions about the relationships between certain variables McGraw-Hill/Irwin 4-20 © 2006 The McGraw-Hill Companies, Inc All rights rese ... only leadership theories add to the body of knowledge concerning the science of leadership and help the development of universal laws of leadership McGraw-Hill/Irwin 4-18 © 2006 The McGraw-Hill... The systematic gathering and analysis of data Peer review of results Although both leadership maxims and theories are useful for understanding leadership situations, in general only leadership. .. linked to the model will a fairly good job of improving the odds of hiring good leaders Research is the only way to determine which assessment techniques are the most valid for which leadership