http //www netlibrary com/nlreader/nlreader dll?bookid=40411&fi Page iii Multimedia Database Management Systems Guojun Lu Page 1 of 1Document 2/29/2004http //www netlibrary com/nlreader/nlreader dll?b[.]
Document Page of Page iii Multimedia Database Management Systems Guojun Lu http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document Page of Page iv Library of Congress Cataloging-in-Publication Data Lu, Guojun, 1963Multimedia database management systems / Guojun Lu P cm — (Artech House computing library) Includes bibliographical references and index ISBN 1-89006-342-7 (alk paper) Mulitimedia systems Database management I Title QA76.575.L84 1999 99-41773 CIP 006.7—dc21 British Library Cataloguing in Publication Data Lu, Guojun, 1963Multimedia database management systems — (Artech House computing library) Multimedia systems Database management I Title 005.7'4 ISBN 0-89006-342-7 Cover design by Elaine K Donnelly © 1999 ARTECH HOUSE, INC 685 Canton Street Norwood, MA 02062 All rights reserved Printed and bound in the United States of America No part of this book may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system, without permission in writing from the publisher All terms mentioned in this book that are known to be trademarks or service marks have been appropriately capitalized Artech House cannot attest to the accuracy of this information Use of a term in this book should not be regarded as affecting the validity of any trademark or service mark International Standard Book Number: 0-89006-342-7 Library in Congress Catalog Card Number: 99-41773 10 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document Page of Page v To Fengxia, James, and Colin http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document Page of Page vii Contents Preface xix Chapter Introduction 1.1 Some Important Definitions 1 1.1.1 Media Types and Multimedia 1.1.2 Databases and DBMSs 1.1.3 Text Document Information Retrieval 1.1.4 Multimedia Indexing and Retrieval 1.1.5 Feature Extraction, Content Representation, and Indexing 1.2 Need for MIRS 1.2.1 Proliferation of Multimedia Data and Its Characteristics 1.2.2 DBMSs and Their Role in Handling Multimedia Data 1.2.3 IR Systems and Their Role in Multimedia Retrieval 1.2.4 Integrated Approach to Multimedia Information Indexing and Retrieval 1.3 An Overview of Multimedia Indexing and Retrieval System 1.4 Expected Capabilities and Common Applications of MIRS http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document Page of 1.5 Organization of Subsequent Chapters 10 Problems 11 References 11 Chapter Multimedia Data Types and Formats 13 2.1 Introduction 13 2.2 Text 14 2.2.1 Plain Text 14 2.2.2 Structured Text 15 2.2.3 Text Compression 15 Huffman Coding 15 Run-Length Coding 16 Lempel-Ziv-Welch (LZW) Coding 17 2.3 Vector Graphics and Animation 17 2.4 Audio 18 2.4.1 Basic Characteristics of Audio Signal 18 2.4.2 Digital Representation of Audio 18 Sampling 19 Quantization 20 Coding 20 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document Page of Page viii Determination of Sampling Rate 21 Determining the Number of Quantization Levels 22 2.4.3 Musical Instrument Digital Interface (MIDI) 24 2.4.4 Audio Compression 24 Nonlinear Quantization 24 Predictive Coding 25 Compression Technique Using Masking Property: MPEG-Audio 27 2.5 Digital Images 2.5.1 Digital Image Representation 28 28 Representation of Grayscale Images 28 Representation of Color Images 28 2.5.2 Main Parameters of Digital Images 29 2.5.3 Image Compression 29 Spatial Subsampling 30 Predictive Coding 30 Transform Coding 31 Vector Quantization 31 Fractal Image Coding 32 Wavelet Compression 33 Practical Coding Systems 33 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document Page of The JPEG-Still Image Compression Standard 33 JBIG 34 JPEG-2000 36 2.6 Digital Video 36 2.6.1 Digital Video Representation 36 2.6.2 Video Compression 37 2.6.2.1 Motion Estimation and Compensation 37 2.6.2.2 MPEG 38 MPEG-1 39 MPEG-2 40 MPEG-4 41 MPEG-7 42 Other Standards 43 2.7 Standards for Composite Multimedia Documents 43 2.8 Major Characteristics and Requirements of Multimedia Data and Applications 44 2.8.1 Storage and Bandwidth Requirements 44 2.8.2 Semantic Structure of Multimedia Information 46 2.8.3 Delay and Delay Jitter Requirements 46 2.8.4 Temporal and Spatial Relationships among Related Media 47 2.8.5 Subjectiveness and Fuzziness of the Meaning of 47 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document Page of Multimedia Data 2.9 Summary 47 Problems 48 Further Reading 50 References 50 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document Page of Page ix Chapter Multimedia Database Design Issues 53 3.1 Introduction 53 3.2 MIRS Architecture 54 3.3 Data Models 55 3.3.1 Data Model Requirements 55 3.3.2 A General Multimedia Data Model 56 Object Layer 56 Media Type Layer 57 Media Format Layer 57 Remaining Issues 57 3.3.3 Example Data Models 58 VIMSYS Data Model 58 A General Video Model 59 Virage Image Schema Structure 60 3.4 User Interface Design 61 3.4.1 Database Population 61 3.4.2 Query Support 62 Search 62 Browsing 62 Query Refinement 63 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document 3.4.3 Result Presentation 3.5 Feature Extraction, Indexing, and Similarity Measure Page of 63 64 3.5.1 Feature Extraction 64 3.5.2 Indexing Structure 66 3.5.3 Similarity Measurement 66 3.6 QoS Guarantees in Clients, Servers, and Communication Systems 66 3.7 Other Issues 67 3.7.1 Multimedia Data Compression 67 3.7.2 Data Representation Standardization 68 3.7.3 Query Processing and Retrieval 69 3.8 Summary 69 Problems 69 Further Reading 71 References 71 Chapter Text Document Indexing and Retrieval 73 4.1 Introduction 73 4.2 Differences between IR Systems and DBMS 74 4.3 Automatic Text Document Indexing and Boolean Retrieval Model 75 4.3.1 Basic Boolean Retrieval Model 75 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 2/29/2004 Document Page of contiguous 267 interleaving 269 scattered 268 stripping 269 Database Database management systems http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of Page 370 DCT 31 Decibel 18 Desk area network (DAN) 283 Digital image 28 color 29 grey scale 28 parameters 29 Digital libraries 349 Directionality 155 Disk scheduling earliest deadline first (EDF) 270 first-come-first-served (FCFS) 270 group sweeping 272 round-robin 271 scan 270 scan-earliest deadline first (Scan-EDF) 271 shortest-seek time first (SSTF) 270 Distributed multimedia management system (DMDBMS) 253 Distributed queue dual bus (DQDB) 299 Domain switch 289 Dynamic media E Earliest deadline first (EDF) 292 Eccentricity 143 Elastic template matching (ETM) 147 Ethernet 297, 299 F Feature extraction 64 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of Fiber distributed data interface (FDDI) 299 Field 37 File allocation table (FAT) 268 Fixed-grid (FG) access structure 241 Fourier descriptors (FD) 145 Fractal dimension 155 G Gamma correction 140 Graceful quality degradation 256, 326 Graphics 17 Grid file 241 H Heidelberg transport protocol (HeiTP) 316-?? Hidden Markov Models (HMMs) 119-121 Hierarchical video browser 194 High-speed digital subscriber line (HDSL) 353 Histogram 134 Huffman coding 15 Hybrid fibre coax (HFC) 352 Hypermedia 89 Hypertext 89 Hypertext markup language (HTML) 91 Hypertext transport protocol (HTTP) 91 HyTime 44 I Image and video compression 29-43 fractal based coding 32 motion compensation 37 predictive coding 30 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of transform coding 31 vector quantization 31 Image bitmap 43 Image indexing and retrieval 132-161, 204 based on color 133 based on compressed image data 156 based on DCT coefficients 156 based on shape 142 based on text 132 based on texture 155 based on VQ compressed data 157 based on wavelet coefficients 157 color-based 133 integrated approach 159 main approaches 132 other methods 159 ImageRover 161 Index Information retrieval performance measurement 86 precision 86 recall 86 Information retrieval (IR) Boolean model 2, 76 differences from DBMS indexing 78, 81 inverted file 76 relevance feedback 82 term position constraint 77 term weight 80 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of I-node 268 Integrated WWW Image Search Engine (IWISE) 211 Invariant moments 143 IR model Boolean 75 Cluster-based model 84 Probabilistic model 84 vector space 81 IR systems and DBMSs differences 74 Isochronous media J JBIG 34 Joint Photographic Expert Group (JPEG) 33-34 baseline mode 34 JPEG-2000 36 K k nearest neighbour query 224 k-d tree 239 L L-1 metric 134 Latent semantic indexing (LSI) 228 Lempel-Ziv-Welch (LZW) Coding 16 Limitations of traditional transport protocols 307-310 data copying 308 lack of QoS support 310 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of Page 371 positioning of control information 309 retransmission 309 slide window flow control 308 Line-likeness 155 Local area networks (LAN) 299 LZW coding 17 M Major axis 143 Media Media translation 205 Mel-frequency cepstral coefficients (MFCCs) 117 Metasearch engines 214 MetaSEEk 215 Metropolitan area network (MAN) 299 Minor axis 143 MIRS capability overview MIRS architecture 54 MMX 280 Moment 143 Mosaicing 195 Motion icon 192 Moving Picture Experts Group (MPEG) 38-43 MPEG-1 39, 43 MPEG-2 40 MPEG-7 357 Multidimensional B+ tree (MB+ tree) 235-239 building of 237 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of overview 235 search in 238 Multimedia Multimedia And Hypermedia Information Encoding Expert Group (MHEG) 44 Multimedia data compression 67 Multimedia data model 55-69 general 56, 61 video model 59 VIMSYS data model 58 Virage image schema 60 Multimedia delay and delay jitter requirements 46 Multimedia information indexing and retrieval 125, 201-218 architecture 205 merging of results 204 reasons for integrated approach 201 Multimedia networks bandwidth requirement 295 criteria 295, 298 network utilization 296 performance guarantee 297 scalability 298 Multimedia server admission control 269 configuration 276 data placement 267 model 262 QoS issues 275 requirements 262 storage hierarchy 266 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of user interaction 273 Multimedia storage requirements 44 Multimedia synchronization 46 Multimedia systems design goals 260 Multimedia transport protocol requirements 306-307 QoS management 307 throughput 307 Multimedia virtual circuit (MVC) 323 Music indexing and retrieval 122-125 based on a set of features 123 based on pitch 124 structured music and sound effects 122 N Natural language processing (NLP) 86 Network synchronous clock 324 O Object composition petri net (OCPN) 320 Object-oriented database management systems Office Document Architecture (ODA) 43 Operating system QoS support 290-294 admission control 290 graceful degradation 293 policing 291 QoS specification 290 schedulability test 290 scheduling disciplines 291 OSI Reference Model 294 P http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of Packet reorder 325 Percentage of similarity rankings 339 Percentage of weighted hits 338 Perceptually weighted color histograms (PWH) 213 Perceptually weighted histogram (PWH) 136 Petri net 320 Pixel based graphics 17 Point query 223 Precision 86, 338 Preemptive kernel 286 Priority inheritance 286 Priority inversion 286 Privacy 355 Public-key encryption 355 Q Quality of service (QoS) 66 Quality of service (QoS) 256-260 architecture 258 general framework 66, 257 hard guarantee 259 negotiation 258 renegotiation 258 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of Page 372 soft guarantee 259 specification 258 working example 260 Query By Image Content (QBIC) 160, 210, 348 R R* tree 245 R+ tree 245 Range query 223 Rate monotonic (RM) 292 Real-time transport protocol (RTP) 315 Recall 86, 338 Redundant array of inexpensive disks (RAID) 264 Region-based shape representation 147 Regularity 155 Relevance feedback 82 Representative frame (r-frame) 187 Resource discovery 92 Resource reservation protocols 310 Roughness 155 RSVP 313-315 R-tree 242-245 deletion 244 overview 242 search in 244 Run length coding 16 S Scene transition graph (STG) 195 Script 318 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of Search engines 349 Secret-key encryption 355 Security 354 Set-top-box (STB) 353 Shot boundary 182 Signal-to-noise ratio 23 Similarity among colors 135 Similarity Search trees (SS-trees) 246 Single copy architecture 288 Single instruction multiple data (SIMD) 278 Singular value decomposition (SVD) 228 Smoothing buffer 322 Solaris 286, 287 SONET 353 Sound spectrum 108 Spatial redundancy 30 Spatial subsampling 30 Speaker identification 122 Spectrogram 111 Speech recognition 116-122 artificial neural networks(ANNs) 121 basic concepts 116 dynamic time warping 118 HMMs 119 performance 121 SS+ trees 246 Standard Generalized Markup Language (SGML) 43 Static media Statistical multiplexing 296 ST-II 311-313 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of connection setup 311 differences from RSVP 314 flow specification 312 Storage devices 263 Storyboard 195 Strong law of large numbers 297 Structured Query Language Subject test 336 Synchronization 317 interaction 317 intermedia 317 intramedia 317 Synchronization marker (SM) 323 Synchronization requirements ??-322 Synchronous time division multiplexing (STDM) 296, 301 T TCP 307 Temporal redundancy 37 Tenet real-time communication protocol suite 317 Texture 155 Thread 289 Timbre 112 Time driven resource management (TDRM) 293 Time-line based temporal specification 319 Token bus local area network 299 Token ring local area network 299 TP4 307 Traffic priorities 297 Triangle inequality 225 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of TV-tree 247 U Uniform resource locator (URL) 92 UNIX 286 User interface query refinement 63 User interface 61, 61-64 browsing 62 database population 61 query support 61, 62 result presentation 63 search 62 User interfaces 208 V VAMSplit R-tree 246 Vector graphics 17 Vector quantization 31 Very long instruction word (VLIW) 278 Video abstraction 191 Video indexing and retrieval 179-196, 204 based on annotation 190 based on metamata 190 based on motion information 188 based on objects 189 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of Page 373 based on R-frames 186 integrated approach 190 main approaches 179 shot-based 180 Video on demand (VOD) 350-354 Video retrieval 181 Video segmentation 181 compressed video 185 twin-comparison technique 182 Video shot 180 Video shot indexing 186 Video skimming 196 Video streamer 193 Video-on-demand 350 Virage 348 Virage Image Search Engine 160 W Watermark 357 Wavelet compression 33 WebSEEK 160 Wide area networks (WAN) 299 World Wide Web (WWW) 89 WWW search engine 89-100 crawler 99 differences from IR 93 general structure 96 Google 97 X http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004 Document Page of Xpress transfer protocol (XTP) 310 Z Zero copy architecture 288 http://www.netlibrary.com/nlreader/nlreader.dll?bookid=40411&filena 3/29/2004