performance evaluation and benchmarking

[...]... This book presents various topics in microprocessor and computer performance evaluation An overview of modern performance evaluation techniques is presented in Chapter 2 This chapter presents a brief look at prominent 1 2 Performance Evaluation and Benchmarking methods of performance estimation and measurement Various simulation methods and hardware performance- monitoring techniques are described as... performance modeling and performance measurement Performance modeling is typically used in early stages of the design process, when actual systems are not available for measurement or if the actual systems do not have test points to measure every detail of interest Performance modeling may further be divided into 5 6 Performance Evaluation and Benchmarking Table 2.1 A Classification of Performance Evaluation. .. Noonburg and Shen [37] and Sorin et al [38] and Karkhanis and Smith [39] Those interested in modeling superscalar processors using analytical models should read these references Noonburg and Shen 16 Performance Evaluation and Benchmarking used a Markov model to model a pipelined processor Sorin et al used probabilistic techniques to model a multiprocessor composed of superscalar processors Karkhanis and. .. is required • Models and tools should handle multiprocessor systems and multithreaded applications Dual- and quad-processor systems are very common nowadays Applications are becoming increasingly multithreaded, especially with the advent of Java, and it is important that the tool handles these • It will be desirable for a performance evaluation technique to be able to evaluate the performance of systems... prototypes for early design-stage evaluation Hence one would need to resort to some kind of modeling in order 8 Performance Evaluation and Benchmarking to study systems yet to be built Performance modeling can be done using simulation models or analytical models 2.1.1 Simulation Simulation has become the de facto performance- modeling method in the evaluation of microprocessor and computer architectures There... sufficient for accurate performance analysis Later on, performance evaluation was done largely with small benchmarks such as kernels extracted from applications (e.g., Lawrence Livermore Loops), Dhrystone and Whetstone benchmarks, Linpack, Sort, Sieve of Eratosthenes, 8-Queens problem, Tower of Hanoi, and so forth The Standard Performance Evaluation Cooperative (SPEC) consortium and the Transactions Processing... be conclusively evaluated by performance models 2.2.1 On-chip performance monitoring counters All state-of-the-art, high -performance microprocessors, including Intel’s Pentium 3 and Pentium 4, IBM’s POWER4 and POWER5 processors, AMD’s Athlon, Compaq’s Alpha, and Sun’s UltraSPARC processors, incorporate on-chip performance- monitoring counters that can be used to understand performance of these microprocessors... Ki Hwan Yum and Chita R Das Chapter 11 Performance Monitoring Hardware and the Pentium 4 Processor 219 Brinkley Sprunt Chapter 12 Performance Monitoring on the POWER5™ Microprocessor 247 Alex Mericas Chapter 13 Performance Monitoring on the Itanium® Processor Family .267 Rumi Zahir, Kishore Menezes, and Susith Fernando Index .285 Chapter One Introduction and Overview... cluster networks and Internet, performance evaluation, and fault-tolerant computing She is a member of the IEEE Computer Society and of the ACM David J Lilja received Ph.D and M.S degrees, both in electrical engineering, from the University of Illinois at Urbana-Champaign, and a B.S in computer engineering from Iowa State University at Ames He is currently a professor of electrical and computer engineering... interval, and then skip again It may also be needed to leave a warm-up period after the skip interval, to let the caches and other such structures 10 Performance Evaluation and Benchmarking warm up [5] Several trace sampling techniques are discussed by Crowley and Baer [6–8] The QPT trace collection system [9] solves the trace size issue by splitting the tracing process into a trace record generation step and . and honor for us to present you this book titled Perfor- mance Evaluation and Benchmarking . Performance evaluation and benchmark- ing is at the heart of computer architecture research and. and so forth. The Standard Performance Evaluation Cooperative (SPEC) consortium and the Transactions Processing Council (TPC) formed in 1988 have made available several benchmark suites and benchmarking. microprocessor and computer perfor- mance evaluation. An overview of modern performance evaluation techniques is presented in Chapter 2. This chapter presents a brief look at prominent 2 Performance Evaluation