RECENT ADVANCES ON VIDEO CODING Edited by Javier Del Ser Recent Advances on Video Coding Edited by Javier Del Ser Published by InTech Janeza Trdine 9, 51000 Rijeka, Croatia Copyright © 2011 InTech All chapters are Open Access articles distributed under the Creative Commons Non Commercial Share Alike Attribution 3.0 license, which permits to copy, distribute, transmit, and adapt the work in any medium, so long as the original work is properly cited. After this work has been published by InTech, authors have the right to republish it, in whole or part, in any publication of which they are the author, and to make other personal use of the work. Any republication, referencing or personal use of the work must explicitly identify the original source. Statements and opinions expressed in the chapters are these of the individual contributors and not necessarily those of the editors or publisher. No responsibility is accepted for the accuracy of information contained in the published articles. The publisher assumes no responsibility for any damage or injury to persons or property arising out of the use of any materials, instructions, methods or ideas contained in the book. Publishing Process Manager Natalia Reinic Technical Editor Teodora Smiljanic Cover Designer Jan Hyrat Image Copyright Chepe Nicoli, 2010. Used under license from Shutterstock.com First published June, 2011 Printed in Croatia A free online edition of this book is available at www.intechopen.com Additional hard copies can be obtained from orders@intechweb.org Recent Advances on Video Coding, Edited by Javier Del Ser p. cm. ISBN 978-953-307-181-7 free online editions of InTech Books and Journals can be found at www.intechopen.com Contents Preface IX Part 1 Tutorials and Reviews 1 Chapter 1 A Tutorial on H.264/SVC Scalable Video Coding and its Tradeoff between Quality, Coding Efficiency and Performance 3 Iraide Unanue, Iñigo Urteaga, Ronaldo Husemann, Javier Del Ser, Valter Roesler, Aitor Rodríguez and Pedro Sánchez Chapter 2 Complexity/Performance Analysis of a H.264/AVC Video Encoder 27 Hajer Krichene Zrida, Ahmed Chiheb Ammari, Mohamed Abid and Abderrazek Jemai Chapter 3 Recent Advances in Region-of-interest Video Coding 49 Dan Grois and Ofer Hadar Part 2 Rate Control in Video Coding 77 Chapter 4 Rate Control in Video Coding 79 Zongze Wu, Shengli Xie, Kexin Zhang and Rong Wu Chapter 5 Rate-Distortion Analysis for H.264/AVC Video Statistics 117 Luis Teixeira Chapter 6 Rate Control for Low Delay Video Communication of H.264 Standard 141 Chou-Chen Wang and Chi-Wei Tung Part 3 Novel Algorithms and Techniques for Video Coding 163 Chapter 7 Effective Video Encoding in Lossless and Near-lossless Modes 165 Grzegorz Ulacha VI Contents Chapter 8 Novel Video Coder Using Multiwavelets 181 Sudhakar Radhakrishnan Chapter 9 Adaptive Entropy Coder Design Based on the Statistics of Lossless Video Signal 201 Jin Heo and Yo-Sung Ho Chapter 10 Scheduling and Resource Allocation for SVC Streaming over OFDM Downlink Systems 223 Xin Ji, Jianwei Huang, Mung Chiang, Gauthier Lafruit and Francky Catthoor Chapter 11 A Hybrid Error Concealment Technique for H.264/AVC Based on Boundary Distortion Estimation 243 Shinfeng D. Lin, Chih-Cheng Wang, Chih-Yao Chuang and Kuan-Ru Fu Chapter 12 FEC Recovery Performance for Video Streaming Services Based on H.264/SVC 259 Kenji Kirihara, Hiroyuki Masuyama, Shoji Kasahara and Yutaka Takahashi Chapter 13 Line-based Intra Coding for High Quality Video Using H.264/AVC 273 Jung-Ah Choi and Yo-Sung Ho Chapter 14 Swarm Intelligence in Wavelet Based Video Coding 289 M. Thamarai and R. Shanmugalakshmi Part 4 Advanced Implementations of Video Coding Systems 307 Chapter 15 Variable Bit-Depth Processor for 8×8 Transform and Quantization Coding in H.264/AVC 309 Gustavo A. Ruiz and Juan A. Michell Chapter 16 MJPEG2000 Performances Improvement by Markov Models 333 Khalil hachicha, David Faura, Olivier Romain and Patrick Garda Part 5 Semantic-based Video Coding 349 Chapter 17 What Are You Trying to Say? Format-Independent Semantic-Aware Streaming and Delivery 351 Joseph Thomas-Kerr, Ian Burnett and Christian Ritz Chapter 18 User-aware Video Coding Based on Semantic Video Understanding and Enhancing 377 Yu-Tzu Lin and Chia-Hu Chang Preface In the last decade, video has turned to be one of the most widely transmitted information sources, due to the extraordinary upsurge of new techniques, protocols and communication standards of increased bandwidth, computational performance, resilience and efficiency. Disruptive technologies, standards, services and applications – as exemplified by on-demand digital video broadcasting, interactive DVB, mobile TV, Bluray ® or Youtube ® – have undoubtedly benefited from significant advances on aspects belonging to the whole set of OSI layers, ranging from new video semantic models and context-aware video processing, to peer-to-peer information networking and enhanced physical-layer techniques allowing for a better exploitation of the available communication resources. As a result, this trend has given rise to a plethora of video coding standards such as H.261, H.263, ISO IEC MPEG-1, MPEG-2 and MPEG-4, which has progressively met the video quality requirements (e.g. bit rate, visual quality, error resilience, compres- sion ratios and/or encoding delay) demanded by applications of ever-growing complexity. Research on video coding is foreseen to spread over the following years, in light of recent developments on three-dimensional and multi-view video coding. Motivated by this flurry of activity at both industry and academia, this book aims at providing the reader with a self-contained review of the latest advances and techniques gravitating on video coding, with a strong emphasis in what relates to architectures, algorithms and implementations. In particular, the contents of this compilation are mainly focused on technical advances in the video coding procedures involved in recently coined video coding standards such as H.264/AVC or H.264/SVC. Readers may also find in this work a useful overview on how video coding can benefit from cross-disciplinary tools (e.g. combinatorial heuristics) to attain significant end-to- end performance improvements. On this purpose, the book is divided in 5 different yet related sections. First, three introductory chapters to H.264/SVC, H.264/AVC and region of interest video coding are presented to the reader. Next, Section II concentrates on reviewing and analysing different methods for controlling the rate of video encoding schemes, whereas the X Preface third section is devoted to novel algorithms and techniques for video coding. Section IV is dedicated to the design and hardware implementation of video coding schemes. Finally, Section V concludes the book by outlining recent research on semantic video coding. The editor would like to eagerly thank the authors for their contribution to this book, and especially the editorial assistance provided by the INTECH publishing process managers Ms. Natalia Reinic and Ms. Iva Lipovic. Last but not least, the editor’s gratitude extends to the anonymous manuscript processing team for their arduous formatting work. Javier Del Ser Senior Research Scientist TECNALIA RESEARCH & INNOVATION 48170 Zamudio, Spain [...]... 10-second video sample), encoding efficiency (defined as the size of the encoded video sequence), decoding complexity (as the number of seconds to decode a 10-second encoded video sequence) and, finally, the objective video- quality resulting from the encoding and decoding process (i.e the PSNR value of the luma component of the video sequence) The description, results and conclusions of the 12 10 Recent Advances. .. This subsection analyzes the performance of both video encoder and decoder, emphasizing on distinct relations between screen resolutions of consecutive video layers Two main algorithms are supported by H.264/SVC: the traditional dyadic solution (only when a resolution ratio of 2:1 among consecutive layer is used) or non-dyadic solution (when any other resolution ratio is possible) • Subsection 3.3, which... of 4 2 Recent Advances on Video Coding Will-be-set-by-IN-TECH Fig 1 Adaptation in scalable video encoding the aforementioned base layer The adaptation is based on a combination within the set of selected strategies for the spatial, temporal and quality scalability (Ohm, 2005) In the last years, several specific scalable video profiles have been included in video codecs such as MPEG-2 (MPEG-2 Video, 2000),... configurations First, the fidelity of the H.264/SVC codec is examined by focusing on the influence of the quantization parameter and the relationship between quality enhancement layers Besides, the evaluation of the coding efficiency of the H.264/SVC prediction structure between quality layers is also covered This subsection A Tutorial on H.264/SVC Scalable Video Coding and its Tradeoff betweenVideo Coding. .. compression techniques are applied to information contained only inside the current picture, not using references to any other picture On the contrary, both P and B frames do have interrelation with different pictures, as they explore directly the dependencies between them While in P frames inter-picture predictive coding is performed based on (at least) one preceding reference 8 6 Recent Advances on Video. .. phones, or to high-performance equipments, e.g HDTV workstations In addition, the stream should adapt to wireless lossy networks (Ohm, 2005) Based on this reasoning, these heterogeneous and non-deterministic networks represent a great problem for traditional video encoders which do not allow for on- the-fly video streaming adaptation To circumvent this drawback, the concept of scalability for video coding. .. dyadic and non-dyadic solutions for non-integer resolution ratios On the other hand, when addressing non-dyadic cases the encoder complexity increases significantly, as shown in Figure 12(b) In other words, dyadic configurations can be processed with significant lower encoding time than the non-dyadic ones, e.g the non-dyadic approach increases the encoding load up to approximately 18% for the CREW video sequence... on H.264/SVC Scalable Video Coding and its Tradeoff betweenVideo Coding and Its Tradeoff between Quality, Coding Efficiency and Performance A Tutorial on H.264/SVC Scalable Quality, Coding Efficiency and Performance 19 17 block-search function can also be tweaked However, the exhaustive block-searching function demands a high computational complexity in the encoding process, while its repercussion on. .. high-quality configuration is designed so as to provide a quality improvement with respect to the basic-reference configuration The key parameters modified for the proposed high-quality configuration are the use of A Tutorial on H.264/SVC Scalable Video Coding and its Tradeoff betweenVideo Coding and Its Tradeoff between Quality, Coding Efficiency and Performance A Tutorial on H.264/SVC Scalable Quality, Coding. .. HARBOUR (b) Encoding time Fig 20 Comparative between basic-reference and high-quality configurations 4.2 High-performance configuration For real-time performance-demanding applications such as widespread video conference systems or video- surveillance systems, the time spent in encoding a video sequence is critical In such cases, the computational performance of the codec is considered decisive as long as the . evaluation of the coding efficiency of the H.264/SVC prediction structure between quality layers is also covered. This subsection 6 Recent Advances on Video Coding A Tutorial on H.264/SVC Scalable Video. Part 2 Rate Control in Video Coding 77 Chapter 4 Rate Control in Video Coding 79 Zongze Wu, Shengli Xie, Kexin Zhang and Rong Wu Chapter 5 Rate-Distortion Analysis for H.264/AVC Video Statistics. implementation of video coding schemes. Finally, Section V concludes the book by outlining recent research on semantic video coding. The editor would like to eagerly thank the authors for their contribution