This PDF document was made available from www.rand.org as a public service of the RAND Corporation. 6 Jump down to document Visit RAND at www.rand.org Explore RAND Project AIR FORCE View document details This document and trademark(s) contained herein are protected by law as indicated in a notice appearing later in this work. This electronic representation of RAND intellectual property is provided for non- commercial use only. Permission is required from RAND to reproduce, or reuse in another form, any of our research documents. Limited Electronic Distribution Rights For More Information CHILD POLICY CIVIL JUSTICE EDUCATIO N ENERGY AND ENVIRONMENT HEALTH AND HEALTH CAR E INTERNATIONAL AFFAIR S NATIONAL SECURIT Y POPULATION AND AGIN G PUBLIC SAFETY SCIENCE AND TECHNOLOGY SUBSTANCE ABUSE TERRORISM AND HOMELAND SECURITY TRANSPORTATION AND INFRASTRUCTURE The RAND Corporation is a nonprofit research organization providing objective analysis and effective solutions that address the challenges facing the public and private sectors around the world. Purchase this document Browse Books & Publications Make a charitable contribution Support RAND This product is part of the RAND Corporation monograph series. RAND monographs present major research findings that address the challenges facing the public and private sectors. All RAND mono - graphs undergo rigorous peer review to ensure high standards for research quality and objectivity. Prepared for the United States Air Force Approved for public release, distribution unlimited Air Force Procurement Work force Transformation Lessons from the Commercial Sector John Ausink, Laura H. Baldwin, Christopher Paul The RAND Corporation is a nonprofit research organization providing objective analysis and effective solutions that address the challenges facing the public and private sectors around the world. RAND’s publications do not necessarily reflect the opinions of its research clients and sponsors. R ® is a registered trademark. © Copyright 2004 RAND Corporation All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from RAND. Published 2004 by the RAND Corporation 1700 Main Street, P.O. Box 2138, Santa Monica, CA 90407-2138 1200 South Hayes Street, Arlington, VA 22202-5050 201 North Craig Street, Suite 202, Pittsburgh, PA 15213-1516 RAND URL: http://www.rand.org/ To order RAND documents or to obtain additional information, contact Distribution Services: Telephone: (310) 451-7002; Fax: (310) 451-6915; Email: order@rand.org Library of Congress Cataloging-in-Publication Data Ausink, John A. Air Force procurement workforce transformation : lessons from the commercial sector / John Ausink, Laura Baldwin, Christopher Paul. p. cm. “MG-214.” Includes bibliographical references. ISBN 0-8330-3648-3 (pbk. : alk. paper) 1. United States. Air Force—Procurement. I. Baldwin, Laura H., 1967– II. Paul, Christopher, 1971– III. Title. UG1123.A85 2004 358.4'16212'0973—dc22 2004015452 The research reported here was sponsored by the United States Air Force under Contract F49642-01-C-0003. Further information may be obtained from the Strategic Planning Division, Directorate of Plans, HqUSAF. iii Preface Ongoing RAND Project AIR FORCE research is supporting the U.S. Air Force’s efforts to change the way it purchases goods and services to improve performance and reduce costs. There is a great deal of in- terest in adopting proven commercial practices such as using cross- functional teams (called commodity councils) to develop corporate- wide strategies for purchasing categories of commodities. The Air Force has begun a procurement transformation effort, focusing on implementation of commodity councils and development of strate- gies for selected types of commodities. A key tenet of the transforma- tion effort is workforce development. This report summarizes RAND Corporation support for the Air Force’s procurement workforce transformation efforts. The purpose of this research is to provide preliminary analyses to aid the Air Force with some of the human-capital-related aspects of its procurement transformation efforts. In this document, we draw on insights from commercial sector experiences with implementation of commodity councils and new purchasing and supply management strategies for procurement of goods and services. We describe skills that Air Force procurement personnel will need for effective participation in com- modity councils and make an initial assessment of new skills that will need to be developed, discuss selected commercial practices on train- ing for purchasing and supply management professionals, and rec- ommend a portfolio of performance metrics the Air Force could use to track the progress of and refine its procurement workforce trans- formation efforts. iv Air Force Procurement Workforce Transformation This research is part of a broader study entitled “Supporting Air Force Procurement Transformation and Laying the Groundwork for Services Acquisition Reform,” sponsored by the Air Force Deputy Assistant Secretary for Contracting (SAF/AQC) and conducted within the Resource Management Program of RAND Project AIR FORCE. Other RAND Project AIR FORCE research is supporting the Air Force Materiel Command’s purchasing and supply management demonstration efforts within its Air Logistics Centers, as well as the restructuring of the command’s headquarters organizations around the principles of purchasing and supply management. This document should be of interest to all federal agency per- sonnel concerned with significant changes in workforce activities and skills, particularly changes associated with implementation of pur- chasing and supply management activities. For the last decade, RAND Project AIR FORCE has been helping the Air Force reshape its sourcing policies and practices. The reader may also be interested in the following related RAND Corpo- ration reports (which are available on the web, see www.rand.org/ Abstracts): • Using a Spend Analysis to Help Identify Prospective Air Force Pur- chasing and Supply Initiatives: Summary of Selected Findings, Nancy Y. Moore, Cynthia Cook, Charles Lindenblatt, and Clifford Grammich, DB-434-AF, 2004. • Measuring Changes in Service Costs to Meet the Requirements of the 2002 National Defense Authorization Act, Chad Shirley, John Ausink, and Laura H. Baldwin, MR-1821-AF, 2004. • Defining Needs and Managing Performance of Installation Support Contracts: Perspectives from the Commercial Sector, Laura H. Baldwin and Sarah Hunter, MR-1812-AF, 2004. • Implementing Performance-Based Services Acquisition (PBSA): Perspectives from an Air Logistics Center and a Product Center, John Ausink, Laura H. Baldwin, Sarah Hunter, and Chad Shirley, DB-388-AF, 2002. Preface v • Implementing Best Purchasing and Supply Management Practices: Lessons from Innovative Commercial Firms, Nancy Y. Moore, Laura H. Baldwin, Frank Camm, and Cynthia R. Cook, DB- 334-AF, 2002. • Federal Contract Bundling: A Framework for Making and Justify- ing Decisions for Purchased Services, Laura H. Baldwin, Frank Camm, and Nancy Y. Moore, MR-1224-AF, 2001. • Performance-Based Contracting in the Air Force: A Report on Expe- riences in the Field, John Ausink, Frank Camm, and Charles Cannon, DB-342-AF, 2001. • Strategic Sourcing: Measuring and Managing Performance, Laura H. Baldwin, Frank Camm, and Nancy Y. Moore, DB-287-AF, 2000. • Incentives to Undertake Sourcing Studies in the Air Force, Laura H. Baldwin, Frank Camm, Edward G. Keating, and Ellen M. Pint, DB-240-AF, 1998. • Strategic Sourcing: Theory and Evidence from Economics and Busi- ness Management, Ellen M. Pint and Laura H. Baldwin, MR- 865-AF, 1997. RAND Project AIR FORCE RAND Project AIR FORCE (PAF), a division of the RAND Corpo- ration, is the U.S. Air Force’s federally funded research and develop- ment center for studies and analyses. PAF provides the Air Force with independent analyses of policy alternatives affecting the development, employment, combat readiness, and support of current and future aerospace forces. Research is conducted in four programs: Aerospace Force Development; Manpower, Personnel, and Training; Resource Management; and Strategy and Doctrine. Additional information about PAF is available on our web site at http://www.rand.org/paf. vii Contents Preface iii Figures xi Tables xiii Summary xv Acknowledgments xxi Abbreviations and Acronyms xxiii CHAPTER ONE Introduction 1 Background 1 Research Approach 5 Preview of Findings 6 Organization of the Report 7 CHAPTER TWO An Analysis of Activities and Skills for the Air Force’s Future Procurement Workforce 9 Information Sources 10 Commodity Councils and Their Activities 10 Skills Needed for Commodity Council Members 14 Sufficiency of Current Air Force and DoD Training for Commodity Council Skills 15 DAU Curriculum 15 AFIT Curriculum 16 Assessment of Current Training 17 viii Air Force Procurement Workforce Transformation CHAPTER THREE Commercial Sector Training for Purchasing and Supply Management Professionals 21 Guiding Principles for Purchasing and Supply Management Training Programs 21 Examples from the Literature 24 SmithKline Beecham 24 Harley-Davidson 25 United Technologies Corporation 26 Examples from Interviews 27 Firm A 27 Firm B 28 Synthesis of Findings 30 CHAPTER FOUR Metrics for Air Force Procurement Workforce Transformation 33 Metrics Framework 34 Metrics for Level Two: Contracting Outcomes 35 Contract-Level Outcomes 36 Effectiveness and Efficiency of the Contracting Organization 40 Metrics for Level Three: Application Outcomes 41 Implementation of Purchasing and Supply Management Activities 42 Metrics for Level Four: Individual Learning Outcomes 45 Standardized Testing 45 Subjective Evaluation 46 Metrics for Level Five: Training Outcomes 47 Training Quality 47 Provision of Training 49 Overarching Considerations 49 CHAPTER FIVE Summary and Directions for Future Research 51 Summary 51 Topics for Future Research 52 [...]... developed a Procurement Transformation Strategy that outlines a roadmap for changing the Air 4 Air Force Procurement Workforce Transformation Force s procurement policies, processes, personnel, and related technologies to meet the changing needs of a transforming Air Force (U.S Air Force Deputy Assistant Secretary for Contracting, 2002, p.2) The trans formation “vision” is as follows: The Air Force contracting... conducted in-depth interviews with three well-respected commercial sector purchasing professionals regarding 1 We referred to these analyses as “preliminary” in the Preface because of the short timelines for their completion 6 Air Force Procurement Workforce Transformation their assessments of valuable skills, their firms’ workforce development programs, and the metrics they use to manage their purchasing... 2004) The other effort focused on the broader issues associated with corporate-wide purchasing and 1 2 Air Force Procurement Workforce Transformation supply management strategies The research described in this document is an extension of this latter work Moore et al (2002) documents the findings of an extensive literature review and numerous in-depth interviews with well-respected commercial sector. .. Implementation 70 xiii Summary Air Force Procurement Transformation The Air Force is in the process of significantly changing the way it purchases goods and services, with the goals of reducing costs and increasing performance to better support its missions During spring 2002, SAF/AQC developed a Procurement Transformation Strategy that outlines a roadmap for changing the Air Force s procurement policies, processes,... analyses to assist with these efforts: • Review ongoing research, industry publications, and other available sources on the transformation of commercial purchasing and supply management practices and organizations to identify the xv xvi Air Force Procurement Workforce Transformation skill set needed by Air Force procurement personnel to successfully implement commodity councils Then conduct a preliminary... training programs from industry 8 Air Force Procurement Workforce Transformation Chapter Four presents a framework of performance metrics the Air Force could use to facilitate evaluation of its workforce transformation efforts It begins by describing a five-level hierarchical framework that links Air Force outcomes of mission performance to training outcomes and then proposes metrics for measuring... of Activities and Skills for the Air Force s Future Procurement Workforce As noted above, the Air Force is moving toward using a commodity council approach, modeled after commercial sector practices, to manage selected categories of purchased goods and services Air Force contracting officers will be key members of the new councils SAF/AQC asked PAF to examine commercial sector commodity council practices... of the Air Force s new Information Technology Commodity Council to learn which skills they are finding valuable for their efforts and their assessments of current training gaps Additionally, we reviewed curricula and had discussions with personnel from the Defense Acquisition University (DAU) and the Air Force Institute of Technology (AFIT) to learn about the training currently available to Air Force. .. to late 1990s, when the Air Force was under pressure to reduce spending to make room in the budget for investments in new weapon systems, force structure, and personnel Because purchased goods and services are a significant and growing portion of the Air Force s budget, the Air Force Deputy Assistant Secretary for Contracting (SAF/AQC) asked RAND Project AIR FORCE (PAF) to examine the purchasing and... while others use more- xviii Air Force Procurement Workforce Transformation applied forms of learning such as formal on -the- job training and mentoring programs to develop more-sophisticated capabilities and high levels of expertise (see pp 82–84) Finally, we note that different types of training are appropriate for developing different levels of expertise (see pp 22–23) All of our findings from the literature . the United States Air Force Approved for public release, distribution unlimited Air Force Procurement Work force Transformation Lessons from the Commercial. support for the Air Force s procurement workforce transformation efforts. The purpose of this research is to provide preliminary analyses to aid the Air Force with