EFFECTIVE VIDEO CODING FOR MULTIMEDIA APPLICATIONS doc

EFFECTIVE VIDEO CODING FOR MULTIMEDIA APPLICATIONS Edited by Sudhakar Radhakrishnan Effective Video Coding for Multimedia Applications Edited by Sudhakar Radhakrishnan Published by InTech Janeza Trdine 9, 51000 Rijeka, Croatia Copyright © 2011 InTech All chapters are Open Access articles distributed under the Creative Commons Non Commercial Share Alike Attribution 3.0 license, which permits to copy, distribute, transmit, and adapt the work in any medium, so long as the original work is properly cited. After this work has been published by InTech, authors have the right to republish it, in whole or part, in any publication of which they are the author, and to make other personal use of the work. Any republication, referencing or personal use of the work must explicitly identify the original source. Statements and opinions expressed in the chapters are these of the individual contributors and not necessarily those of the editors or publisher. No responsibility is accepted for the accuracy of information contained in the published articles. The publisher assumes no responsibility for any damage or injury to persons or property arising out of the use of any materials, instructions, methods or ideas contained in the book. Publishing Process Manager Ivana Lorkovic Technical Editor Teodora Smiljanic Cover Designer Martina Sirotic Image Copyright Terence Mendoza, 2010. Used under license from Shutterstock.com First published March, 2011 Printed in India A free online edition of this book is available at www.intechopen.com Additional hard copies can be obtained from orders@intechweb.org Effective Video Coding for Multimedia Applications, Edited by Sudhakar Radhakrishnan p. cm. ISBN 978-953-307-177-0 free online editions of InTech Books and Journals can be found at www.intechopen.com Part 1 Chapter 1 Chapter 2 Part 2 Chapter 3 Chapter 4 Chapter 5 Part 3 Chapter 6 Chapter 7 Chapter 8 Preface IX Scalable Video Coding 1 Scalable Video Coding 3 Z. Shahid, M. Chaumont and W. Puech Scalable Video Coding in Fading Hybrid Satellite-Terrestrial Networks 21 Georgios Avdiko Coding Strategy 37 Improved Intra Prediction of H.264/AVC 39 Mohammed Golam Sarwer and Q. M. Jonathan Wu Efficient Scalable Video Coding Based on Matching Pursuits 55 Jian-Liang Lin and Wen-Liang Hwang Motion Estimation at the Decoder 77 Sven Klomp and Jörn Ostermann Video Compression and Wavelet Based Coding 93 Asymmetrical Principal Component Analysis Theory and its Applications to Facial Video Coding 95 Ulrik Söderström and Haibo Li Distributed Video Coding: Principles and Evaluation of Wavelet-Based Schemes 111 Riccardo Bernardini, Roberto Rinaldo and Pamela Zontone Correlation Noise Estimation in Distributed Video Coding 133 Jürgen Slowack, Jozef Škorupa, Stefaan Mys, Nikos Deligiannis, Peter Lambert, Adrian Munteanu and Rik Van de Walle Contents Contents VI Non-Predictive Multistage Lattice Vector Quantization Video Coding 157 M. F. M. Salleh and J. Soraghan Error Resilience in Video Coding 179 Error Resilient Video Coding using Cross-Layer Optimization Approach 181 Cheolhong An and Truong Q. Nguyen An Adaptive Error Resilient Scheme for Packet-Switched H.264 Video Transmission 211 Jian Feng, Yu Chen, Kwok-Tung Lo and Xudong Zhang Hardware Implementation of Video Coder 227 An FPGA Implementation of HW/SW Codesign Architecture for H.263 Video Coding 229 A. Ben Atitallah, P. Kadionik, F. Ghozzi, P.Nouel, N. Masmoudi and H. Levi Chapter 9 Part 4 Chapter 10 Chapter 11 Part 5 Chapter 12 Pref ac e Information has become one of the most valuable assets in the modern era. Recent tech- nology has introduced the paradigm of digital information and its associated benefi ts and drawbacks. Within the last 5-10 years, the demand for multimedia applications has increased enormously. Like many other recent developments, the materialization of image and video encoding is due to the contribution from major areas like good net- work access, good amount of fast processors e.t.c. Many standardization procedures were carrried out for the development of image and video coding. The advancement of computer storage technology continues at a rapid pace as a means of reducing storage requirements of an image and video as most situation warrants. Thus, the science of digital image and video compression has emerged. For example, one of the formats defi ned for High Defi nition Television (HDTV) broadcasting is 1920 pixels horizon- tally by 1080 lines vertically, at 30 frames per second. If these numbers are multiplied together with 8 bits for each of the three primary colors, the total data rate required would be 1.5 GB/sec approximately. Hence compression is highly necessary. This stor- age capacity seems to be more impressive when it is realized that the intent is to deliver very high quality video to the end user with as few visible artifacts as possible. Current methods of video compression such as Moving Pictures Experts Group (MPEG) stan- dard provide good performance in terms of retaining video quality while reducing the storage requirements. Even the popular standards like MPEG do have limitations. Video coding for telecommunication applications has evolved through the develop- ment of the ISO/IEC MPEG-1, MPEG-2 and ITU-T H.261, H.262 and H.263 video coding standards (and later enhancements of H.263 known as H.263+ and H.263++) and has diversifi ed from ISDN and T1/E1 service to embrace PSTN, mobile wireless networks, and LAN/Internet network delivery. SCOPE OF THE BOOK: Many books are available for video coding fundamentals.This book is the research out- come of various Researchers and Professors who have contributed a might in this fi eld. This book suits researchers doing their research in the area of video coding.The book revolves around three diff erent challenges namely (i) Coding strategies (coding effi - ciency and computational complexity), (ii) Video compression and (iii) Error resilience The complete effi cient video system depends upon source coding, proper inter and intra frame coding, emerging newer transform, quantization techniques and proper error concealment.The book gives the solution of all the challenges and is available in diff erent sections. X Preface STRUCTURE OF THE BOOK: The book contains 12 chapters, divided into 5 sections. The user of this book is expect- ed to know the fundamentals of video coding, which is available in all the standard video coding books. Part 1 gives the introduction to scalable video coding containing two chapters.Chapter 1 deals with scalable video coding, which gives some fundamental ideas about scalable funtionallity of H.264/AVC, comparison of scalable extensions of diff erent video co- decs and adaptive scan algorithms for enhancement layers of subband/wavelet based architecture. Chapter 2 deals with the modelling of wireless satellite channel and scal- able video coding components in the context of terrestrial broadcasting/Multicasting systems. Part 2 describes the Intraframe coding (Motion estimation and compensation) orga- nized into three chapters. Chapter 3 deals with the intra prediction scheme in H.264/ AVC, which is done in spatial domain by refering to the neighbouring samples of the previously coded blocks which are to the le and/or above the block to be predicted. Chapter 4 describes the effi cient scalable video coding based on matching pursuits, in which the scalability is supported by a two layer video scheme. The coding effi ciency available is found to be be er than the scalabilty.Chapter 5 deals with motion estima- tion at the decoder, where the compression effi ciency is increased to a larger extent because of the omission of the motion vectors from the transmi er. Part 3 deals with Video compression and Wavelet based coding consisting of 4 chap- ters. Chapter 6 deals with the introduction to Asymmetrical Principal Component analysis and its role in facial video coding.Chapter 7 deals with the introduction to distributed video coding along with the role of Wavelet based schemes in video cod- ing. Chapter 8 focuses on the accurate correlation modelling in distributed video cod- ing.Chapter 9 presents video coding scheme that utilizes Multistage La ice Vector Quantization(MLVQ) algorithm to exploit the spatial-temporal video redundancy in an eff ective way. Part 4 concentrates on error resilience categorized into 2 chapters. Chapter 10 deals with error concealment using cross layer optimization approach, where the trade-off is made between rate and reliability for a given information bit energy per noise power spectral density with proper error resilient video coding scheme.Chapter 11 describes a low redundancy error resilient scheme for H.264 video transmission in packet-swith- ched environment. Part 5 discusses the hardware/so ware implementation of the video coder organized into a single chapter. Chapter 12 deals with the FPGA Implementation of HW/SW Code- sign architecture for H.263 video Coding.The H.263 standard includes several blocks such as Motion Estimation (ME), Discrete Cosine Transform (DCT), quantization (Q) and variable length coding (VLC). It was shown that some of these parts can be opti- mized with parallel structures and effi ciently implemented in hardware/so ware (HW/ SW) partitioned system. Various factors such as fl exibility, development cost, power consumption and processing speed requirement should be taken into account for the design. Hardware implementation is generally be er than so ware implementation in [...]... Multimedia Applications XXX Fig 13 Comparison of JSVM, DWTSB and DWTSB-AS: (a) Global comparison for two layer scalable bitstreams, (b) HL subband comparison, (c) LH subband comparison, (d) HH subband comparison Scalable Video Coding Scalable Video Coding 17 15 18 16 Effective Video Coding for Multimedia Applications XXX Fig 14 Performance comparison of JSVM, DWTSB and DWTSB-AS for mobile video sequence... scalability as compared to scalable extensions of prior video coding standards The call for proposals for efficient scalable video coding technology was made in October 2003 12 of the 14 submitted proposals represented scalable video codecs based on a 3-D wavelet Scalable Video Coding Scalable Video Coding 5 3 Fig 2 SNR scalable architecture of SVC transform, while the remaining two proposals were extension... values for the three subbands HL, LH and HH respectively To summarize, we have presented a new adaptive scanning methodology for DWTSB scalable architecture of dyadic intra frames in Section 5.4 We have described in detail the DWTSB-AS scheme DWTSB-AS has done a significant file size reduction without any computation load Scalable Video Coding Scalable Video Coding 15 13 16 14 Effective Video Coding for Multimedia. .. Experimental results For the experimental results, nine standard video sequences have been used for the analysis in CIF and QCIF format To apply our approach we have compressed 150 frames of each sequence at 30 fps 14 12 Effective Video Coding for Multimedia Applications XXX fH fV Fig 12 Analysis of HH subband: (a) Dominant frequencies in QTCs of this subband, (b) Inverse zigzag scan proposed for such type... over whole QP range: (a) Global comparison for two layer scalable bitstreams, (b) HL subband, (c) LH subband, (d) HH subband Scalable Video Coding Scalable Video Coding 19 17 for the same quality as compared to DWTSB coding Effectiveness of subband-specific scan for DWTSB scalable video has been elaborated by showing experimental results on several benchmark video sequences containing diverse content... Video Coding for Multimedia Applications XXX Wien, M., Schwarz, H & Oelbaum, T (2007) Performance Analysis of SVC, IEEE Transactions on Circuits and Systems for Video Technology 17(9): 1194 –1203 Wu, M., Joyce, R & Kung, S (2000) Dynamic Resource Allocation via Video Content and Short-Term Traffic Statistics, Proc IEEE International Conference on Image Processing, Vol 3, pp 58–61 2 Scalable Video Coding. .. redundancies in enhancement layer cannot be properly removed For SNR scalability coding in MPEG2, the other extreme case was specified The highest enhancement layer reconstruction is used in motion compensated prediction as shown in 8 6 Effective Video Coding for Multimedia Applications XXX Fig 5.b This ensures a high coding efficiency as well as low complexity for the enhancement layer However, any loss or modification... that the performance of adaptive scan is consistent over the whole curve for all the benchmark sequences Rather adaptive scans perform at high QP values times Hence our scan performs better for all high frequency subbands over the whole R-D curve Fig 14.a gives the performance analysis overall 2-layer video mobile at different QP values since Fig 14.b-d give the performance analysis for the video mobile... to 5% or more 22 Effective Video Coding for Multimedia Applications can be tolerated at times) Consequently, unlike file transfers, real time multimedia applications do not require a complete insulation from packet losses, but rather require the application layer to cooperate with the lower layers to select the optimal wireless transmission strategy that maximizes the multimedia performance Thus, to... scalable video coding Wiegand et al (April 2007) for intra frame In dyadic scalable intra frame coding, the image is transformed to wavelet subbands and then the subbands are encoded by base-layer H.264/AVC Since each wavelet subband possesses a certain range of frequencies, zigzag scan is not equally efficient for scanning the transform coefficients in all the subbands Fig 7 Different scalable video coding . EFFECTIVE VIDEO CODING FOR MULTIMEDIA APPLICATIONS Edited by Sudhakar Radhakrishnan Effective Video Coding for Multimedia Applications Edited by Sudhakar Radhakrishnan Published. video codecs based on a 3-D wavelet 4 Effective Video Coding for Multimedia Applications Scalable Video Coding 3 Fig. 2. SNR scalable architecture of SVC. transform, while the remaining two proposals. increasing 6 Effective Video Coding for Multimedia Applications Scalable Video Coding 5 Fig. 4. Temporal scalable architecture of Scalable extension of H.264/AVC. the granularity for SNR scalability