Tài liệu hạn chế xem trước, để xem đầy đủ mời bạn chọn Tải xuống
1
/ 172 trang
THÔNG TIN TÀI LIỆU
Thông tin cơ bản
Định dạng
Số trang
172
Dung lượng
1,37 MB
Nội dung
RATE-DISTORTIONANALYSISANDTRAFFIC MODELING
OF SCALABLEVIDEO CODERS
A Dissertation
by
MIN DAI
Submitted to the Office of Graduate Studies of
Texas A&M University
in partial fulfillment of the requirements for the degree of
DOCTOR OF PHILOSOPHY
December 2004
Major Subject: Electrical Engineering
RATE-DISTORTION ANALYSISANDTRAFFIC MODELING
OF SCALABLEVIDEO CODERS
A Dissertation
by
MIN DAI
Submitted to Texas A&M University
in partial fulfillment of the requirements
for the degree of
DOCTOR OF PHILOSOPHY
Approved as to style and content by:
Andrew K. Chan
(Co-Chair of Committee)
Dmitri Loguinov
(Co-Chair of Committee)
Karen L. Butler-Purry
(Member)
Erchin Serpedin
(Member)
Chanan Singh
(Head of Department)
December 2004
Major Subject: Electrical Engineering
iii
ABSTRACT
Rate-Distortion Analysisand Traffic Modeling
of ScalableVideo Coders. (December 2004)
Min Dai, B.S., Shanghai Jiao Tong University;
M.S., Shanghai Jiao Tong University
Co–Chairs of Advisory Committee: Dr. Andrew K. Chan
Dr. Dmitri Loguinov
In this work, we focus on two important goals of the transmission ofscalable video
over the Internet. The first goal is to provide high quality video to end users and the
second one is to properly design networks and predict network performance for video
transmission based on the characteristics of existing video traffic. Rate-distortion
(R-D) based schemes are often applied to improve and stabilize video quality; how-
ever, the lack of R-D modelingofscalablecoders limits their applications in scalable
streaming.
Thus, in the first part of this work, we analyze R-D curves ofscalable video
coders and propose a novel operational R-D model. We evaluate and demonstrate
the accuracy of our R-D function in various scalable coders, such as Fine Granular
Scalable (FGS) and Progressive FGS coders. Furthermore, due to the time-constraint
nature of Internet streaming, we propose another operational R-D model, which is
accurate yet with low computational cost, and apply it to streaming applications for
quality control purposes.
The Internet is a changing environment; however, most quality control approaches
only consider constant bit rate (CBR) channels and no specific studies have been con-
ducted for quality control in variable bit rate (VBR) channels. To fill this void, we
examine an asymptotically stable congestion control mechanism and combine it with
iv
our R-D model to present smooth visual quality to end users under various network
conditions.
Our second focus in this work concerns the modelingandanalysisofvideo traffic,
which is crucial to protocol design and efficient network utilization for video trans-
mission. Although scalablevideo traffic is expected to be an important source for
the Internet, we find that little work has been done on analyzing or modeling it. In
this regard, we develop a frame-level hybrid framework for modeling multi-layer VBR
video traffic. In the proposed framework, the base layer is modeled using a combi-
nation of wavelet and time-domain methods and the enhancement layer is linearly
predicted from the base layer using the cross-layer correlation.
v
To my parents
vi
ACKNOWLEDGMENTS
My deepest gratitude and respect first go to my advisors Prof. Andrew Chan
and Prof. Dmitri Loguinov. This work would never have been done without their
support and guidance.
I would like to thank my co-advisor Prof. Chan for giving me the freedom to
choose my research topic and for his continuous support to me during all the ups and
downs I went through at Texas A&M University. Furthermore, I cannot help feeling
lucky to b e able to work with my co-advisor Prof. Loguinov. I am amazed and
impressed by his intelligence, creativity, and his serious attitude towards research.
Had it not been for his insightful advice, encouragement, and generous support, this
work could not have been completed.
I would also like to thank Prof. Karen L. Butler-Purry and Prof. Erchin Serpedin
for taking their precious time to serve on my committee.
In addition to my committee members, I benefited greatly from working with
Mr. Kourosh Soroushian and the research group members at LSI Logic. It was Mr.
Soroushian’s projects that first attracted me into this field ofvideo communication.
Many thanks to him for his encouragement and support during and even after my
internship.
In addition, I would like to take this opportunity to express my sincerest appre-
ciation to my friends and fellow students at Texas A&M University. They provided
me with constant support and a balanced and fulfilled life at this university. Zigang
Yang, Ge Gao, Beng Lu, Jianhong Jiang, Yu Zhang, and Zhongmin Liu have been
with me from the very beginning when I first stepped into the Department of Elec-
trical Engineering. Thanks for their strong faith in my research ability and their
encouragement when I need some boost of confidence. I would also like to thank
vii
Jun Zheng, Jianping Hua, Peng Xu, and Cheng Peng, for their general help and the
fruitful discussions we had on signal processing. I am especially grateful to Jie Rong,
for always being there through all the difficult time.
I sincerely thank my colleagues, Seong-Ryong Kang, Yueping Zhang, Xiaoming
Wang, Hsin-Tsang Lee, and Derek Leonard, for making my stay at the Internet
Research lab an enjoyable experience. In particular, I would like to thank Hsin-Tsang
for his generous provision of office snacks and Seong-Ryong for valuable discussions.
I owe special thanks to Yuwen He, my friend far away in China, for his constant
encouragement and for being very responsive whenever I called for help.
I cannot express enough of my gratitude to my parents and my sister. Their
support and love have always been the source of my strength and the reason I have
come this far.
viii
TABLE OF CONTENTS
CHAPTER Page
I INTRODUCTION . . . . . . . . . . . . . . . . . . . . . . . . . . 1
A. Problem Statement . . . . . . . . . . . . . . . . . . . . . . 1
B. Objective and Approach . . . . . . . . . . . . . . . . . . . 2
C. Main Contributions . . . . . . . . . . . . . . . . . . . . . . 3
D. Dissertation Overview . . . . . . . . . . . . . . . . . . . . 5
II SCALABLEVIDEO CODING . . . . . . . . . . . . . . . . . . . 7
A. Video Compression Standards . . . . . . . . . . . . . . . . 7
B. Basics in Video Coding . . . . . . . . . . . . . . . . . . . . 10
1. Compression . . . . . . . . . . . . . . . . . . . . . . . 11
2. Quantization and Binary Coding . . . . . . . . . . . . 12
C. Motion Compensation . . . . . . . . . . . . . . . . . . . . 16
D. ScalableVideo Coding . . . . . . . . . . . . . . . . . . . . 20
1. Coarse Granular Scalability . . . . . . . . . . . . . . . 21
a. Spatial Scalability . . . . . . . . . . . . . . . . . . 21
b. Temporal Scalability . . . . . . . . . . . . . . . . 22
c. SNR/Quality Scalability . . . . . . . . . . . . . . 23
2. Fine Granular Scalability . . . . . . . . . . . . . . . . 23
III RATE-DISTORTIONANALYSIS FOR SCALABLECODERS . 25
A. Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
B. Preliminaries . . . . . . . . . . . . . . . . . . . . . . . . . 28
1. Brief R-D Analysis for MCP Coders . . . . . . . . . . 28
2. Brief R-D Analysis for ScalableCoders . . . . . . . . . 30
C. Source AnalysisandModeling . . . . . . . . . . . . . . . . 31
1. Related Work on Source Statistics . . . . . . . . . . . 32
2. Proposed Model for Source Distribution . . . . . . . . 34
D. Related Work on Rate-DistortionModeling . . . . . . . . . 36
1. R-D Functions of MCP Coders . . . . . . . . . . . . . 36
2. Related Work on R-D Modeling . . . . . . . . . . . . 40
3. Current Problems . . . . . . . . . . . . . . . . . . . . 42
E. Distortion AnalysisandModeling . . . . . . . . . . . . . . 45
1. Distortion Model Based on Approximation Theory . . 45
ix
CHAPTER Page
a. Approximation Theory . . . . . . . . . . . . . . . 46
b. The Derivation of Distortion Function . . . . . . 47
2. Distortion Modeling Based on Coding Process . . . . . 50
F. Rate AnalysisandModeling . . . . . . . . . . . . . . . . . 54
1. Preliminaries . . . . . . . . . . . . . . . . . . . . . . . 54
2. Markov Model . . . . . . . . . . . . . . . . . . . . . . 56
G. A Novel Op erational R-D Model . . . . . . . . . . . . . . . 61
1. Experimental Results . . . . . . . . . . . . . . . . . . 65
H. Square-Root R-D Model . . . . . . . . . . . . . . . . . . . 66
1. Simple Quality (PSNR) Model . . . . . . . . . . . . . 67
2. Simple Bitrate Model . . . . . . . . . . . . . . . . . . 69
3. SQRT Model . . . . . . . . . . . . . . . . . . . . . . . 72
IV QUALITY CONTROL FOR VIDEO STREAMING . . . . . . . 76
A. Related Work . . . . . . . . . . . . . . . . . . . . . . . . . 76
1. Congestion Control . . . . . . . . . . . . . . . . . . . 76
a. End-to-End vs. Router-Supported . . . . . . . . . 77
b. Window-Based vs. Rate-Based . . . . . . . . . . 78
2. Error Control . . . . . . . . . . . . . . . . . . . . . . . 78
a. Forward Error Correction (FEC) . . . . . . . . . 79
b. Retransmission . . . . . . . . . . . . . . . . . . . 80
c. Error Resilient Coding . . . . . . . . . . . . . . . 80
d. Error Concealment . . . . . . . . . . . . . . . . . 85
B. Quality Control in Internet Streaming . . . . . . . . . . . . 85
1. Motivation . . . . . . . . . . . . . . . . . . . . . . . . 86
2. Kelly Controls . . . . . . . . . . . . . . . . . . . . . . 88
3. Quality Control in CBR Channel . . . . . . . . . . . . 92
4. Quality Control in VBR Networks . . . . . . . . . . . 94
5. Related Error Control Mechanism . . . . . . . . . . . 98
V TRAFFICMODELING . . . . . . . . . . . . . . . . . . . . . . 100
A. Related Work on VBR Traffic Modeling . . . . . . . . . . . 102
1. Single Layer Video Traffic . . . . . . . . . . . . . . . . 102
a. Autoregressive (AR) Models . . . . . . . . . . . . 102
b. Markov-modulated Models . . . . . . . . . . . . . 104
c. Models Based on Self-similar Process . . . . . . . 104
d. Other Models . . . . . . . . . . . . . . . . . . . . 105
2. ScalableVideo Traffic . . . . . . . . . . . . . . . . . . 106
x
CHAPTER Page
B. Modeling I-Frame Sizes in Single-Layer Traffic . . . . . . . 107
1. Wavelet Models and Preliminaries . . . . . . . . . . . 107
2. Generating Synthetic I-Frame Sizes . . . . . . . . . . 110
C. Modeling P/B-Frame Sizes in Single-layer Traffic . . . . . 114
1. Intra-GOP Correlation . . . . . . . . . . . . . . . . . 115
2. Modeling P and B-Frame Sizes . . . . . . . . . . . . . 117
D. Modeling the Enhancement Layer . . . . . . . . . . . . . . 121
1. Analysisof the Enhancement Layer . . . . . . . . . . 123
2. Modeling I-Frame Sizes . . . . . . . . . . . . . . . . . 126
3. Modeling P and B-Frame Sizes . . . . . . . . . . . . . 127
E. Model Accuracy Evaluation . . . . . . . . . . . . . . . . . 129
1. Single-layer and the Base Layer Traffic . . . . . . . . . 132
2. The Enhancement Layer Traffic . . . . . . . . . . . . . 133
VI CONCLUSION AND FUTURE WORK . . . . . . . . . . . . . . 137
A. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
B. Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . 139
1. Supplying Peers Cooperation System . . . . . . . . . . 140
2. Scalable Rate Control System . . . . . . . . . . . . . . 141
REFERENCES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 142
VITA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
[...]... other hand, present the author’s own contributions to this field In Chapter II, we provide a brief overview ofvideo compression standards and some basics ofvideo coding schemes In addition, we discuss the importance and advantages ofscalable coding in video transmission and also describe several popular scalablecoders In Chapter III, we give a detailed rate-distortionanalysis for scalablecoders and. .. investigation of source statistical features The objectives of this chapter are not only to propose a novel R-D model for scalablevideo coders, 6 Background on ScalableVideo Coding Ch II Part I Rate-distortion Analysis andModeling Quality Control for Video Streaming Ch III Ch IV Part II TrafficModeling Ch V Conclusion Ch VI Fig 1 Structure of this proposal but also to gain some insight into scalable. .. are few studies done on the R-D analysis of scalable coders, which limits the applicability of R-D based algorithms in scalablevideo streaming Thus, we analyze R-D curves ofscalablecodersand derive an accurate R-D model that is applicable to network applications Notice that in order to provide end users high quality video, it is not sufficient to only improve video standards Instead, we also need to... accurate, mathematically tractable, and with low computational complexity • Give a detailed R-D analysis and propose novel R-D models for scalablevideocoders To better understand scalable coders, we examine distortion and bitrate ofscalablecoders separately, which have not been done in prior studies Unlike distortion, which only depends on the statistical properties of the signal, bitrate is also related... to the analysis and characterization of network traffic and network performance While multi-layer (scalable) video traffic has become an important source of the Internet, most existing approaches are proposed to model single-layer VBR video traffic and less work has been done on the analysis of multi-layer video traffic Therefore, we propose a model that is able to capture the statistical properties of both... new generation of highly 9 interactive multimedia applications and to provide tools for object-based coding of natural and synthetic audio andvideo [49] MPEG-4 includes properties such as object-based coding, synthetic content, and interactivity The most recent video standard H.264 is capable of providing even higher coding efficiency than MPEG-4 This is a joint work of ITU and MPEG, and it is expected... ITU and MPEG, and it is expected to be a subset of MPEG-4 standard In Table I, we list main applications and target bitrate range of these standards in the order of the proposed date Table I A Brief Comparison of Several Video Compression Standards [2] Standard Application Bit Rate H.261 Video telephony/teleconferencing over ISDN Multiple of 64 kb/s MPEG-1 Video on digital storage media (CD-ROM) 1.5 Mb/s... Silence of the Lambs coded at Q = 4, 24, 30 (b) The correlation between {εP (n)} and {φP (n)} in The Silence of the Lambs coded at Q = i i 30, for i = 1, 2, 3 124 62 (a) The ACF of {εI (n)} and that of {φI (n)} in Star Wars IV (b) The ACF of {εP (n)} and that of {φP (n)} in The Silence of 1 1 the Lambs 125 63 The ACF of {A3 (ε)} and {A3 (φ)}... consecutive frames of a sequence usually show same physical scenes and objects To reduce the data rate of a video sequence, compression techniques should exploit spatial and temporal correlation The current RGB (i.e., red, green, and blue) system is highly correlated and mixes the luminance and chrominance attributes of a light Since it is often desirable to describe a color in terms of its luminance and chrominance...xi LIST OF TABLES TABLE Page I A Brief Comparison of Several Video Compression Standards [2] 9 II The Average Values of χ2 in Test Sequences 36 III Estimation Accuracy of (3.40) in CIF Foreman 54 IV Advantage and Disadvantages of FEC and Retransmission 80 V Relative Data Loss Error e in Star Wars IV 133 xii LIST OF FIGURES FIGURE Page 1 Structure of this . RATE-DISTORTION ANALYSIS AND TRAFFIC MODELING
OF SCALABLE VIDEO CODERS
A Dissertation
by
MIN DAI
Submitted to the Office of Graduate Studies of
Texas. Singh
(Head of Department)
December 2004
Major Subject: Electrical Engineering
iii
ABSTRACT
Rate-Distortion Analysis and Traffic Modeling
of Scalable Video Coders.