METHODS AND APPLICATIONS EDITED BY RASTISLAV LUKAC METHODS AND APPLICATIONS Visual perception is a complex process requiring interaction between the recep- tors in the eye that sense the stimulus and the neural system and the brain that are responsible for communicating and interpreting the sensed visual informa- tion. This process involves several physical, neural, and cognitive phenomena whose understanding is essential to design effective and computationally efficient imaging solutions. Building on advances in computer vision, image and video processing, neuroscience, and information engineering, perceptual digital imaging greatly enhances the capabilities of traditional imaging methods. Filling a gap in the literature, Perceptual Digital Imaging: Methods and Appli- cations comprehensively covers the system design, implementation, and application aspects of this emerging specialized area. It gives readers a strong, fundamental understanding of theory and methods, providing a foundation on which solutions for many of the most interesting and challenging imaging problems can be built. The book features contributions by renowned experts who present the state of the art and recent trends in image acquisition, processing, storage, display, and visual quality evaluation. They detail advances in the field and explore human visual system-driven approaches across a broad spectrum of applications. These include image quality and aesthetics assessment, digital camera imaging, white balancing and color enhancement, thumbnail generation, image restoration, super-resolution imaging, digital halftoning and dithering, color feature extraction, semantic multimedia analysis and processing, video shot characterization, image and video encryption, display quality enhancement, and more. This is a valuable resource for readers who want to design and implement more effective solutions for cutting-edge digital imaging, computer vision, and multimedia applications. Suitable as a graduate-level textbook or stand-alone reference for researchers and practitioners, it provides a unique overview of an important and rapidly developing research field. Electrical Engineering K13123K13123K13123 ISBN: 978-1-4398-6856-0 9 781439 868560 9 0 0 0 0 METHODS AND APPLICATIONS LUKACLUKAC METHODS AND APPLICATIONS K13123_FM.indd 1 8/24/12 10:35 AM Digital Imaging and Computer Vision Series Series Editor Rastislav Lukac Foveon, Inc./Sigma Corporation San Jose, California, U.S.A. Computational Photography: Methods and Applications, by Rastislav Lukac Super-Resolution Imaging, by Peyman Milanfar Digital Imaging for Cultural Heritage Preservation: Analysis, Restoration, and Reconstruction of Ancient Artworks, by Filippo Stanco, Sebastiano Battiato, and Giovanni Gallo Visual Cryptography and Secret Image Sharing, by Stelvio Cimato and Ching-Nung Yang Image Processing and Analysis with Graphs: Theory and Practice, by Olivier Lézoray and Leo Grady Image Restoration: Fundamentals and Advances, by Bahadir Kursat Gunturk and Xin Li Perceptual Digital Imaging: Methods and Applications, by Rastislav Lukac K13123_FM.indd 2 8/24/12 10:35 AM CRC Press is an imprint of the Taylor & Francis Group, an informa business Boca Raton London New York METHODS AND APPLICATIONS EDITED BY RASTISLAV LUKAC K13123_FM.indd 3 8/24/12 10:35 AM CRC Press Taylor & Francis Group 6000 Broken Sound Parkway NW, Suite 300 Boca Raton, FL 33487-2742 © 2013 by Taylor & Francis Group, LLC CRC Press is an imprint of Taylor & Francis Group, an Informa business No claim to original U.S. Government works Version Date: 20120822 International Standard Book Number-13: 978-1-4398-6893-5 (eBook - PDF) This book contains information obtained from authentic and highly regarded sources. Reasonable efforts have been made to publish reliable data and information, but the author and publisher cannot assume responsibility for the valid- ity of all materials or the consequences of their use. The authors and publishers have attempted to trace the copyright holders of all material reproduced in this publication and apologize to copyright holders if permission to publish in this form has not been obtained. If any copyright material has not been acknowledged please write and let us know so we may rectify in any future reprint. Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmitted, or uti- lized in any form by any electronic, mechanical, or other means, now known or hereafter invented, including photocopy- ing, microfilming, and recording, or in any information storage or retrieval system, without written permission from the publishers. For permission to photocopy or use material electronically from this work, please access www.copyright.com (http:// www.copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400. CCC is a not-for-profit organization that provides licenses and registration for a variety of users. For organizations that have been granted a photocopy license by the CCC, a separate system of payment has been arranged. Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are used only for identification and explanation without intent to infringe. Visit the Taylor & Francis Web site at http://www.taylorandfrancis.com and the CRC Press Web site at http://www.crcpress.com All our knowledg e has its origins in our perceptions. —Leonardo da Vinci (1452–1519) This page intentionally left blankThis page intentionally left blank Dedication T o my supporters and friends This page intentionally left blankThis page intentionally left blank Contents Pr eface xi The Editor xv Contrib utors xvii 1 Characteristics of Human Vision 1 Stefan Winkler 2 An Analysis of Human Visual Perception Based on Real-Time Constraints of Ecological Vision 37 Haluk ¨ O ˘ gmen 3 Image and Video Quality Assessment: Perception, Psychophysical Models, and Algorithms 55 Anush K. Moorthy, Kalpana Seshadrinathan, and Alan C. Bovik 4 Visual Aesthetic Quality Assessment of Digital Images 91 Congcong Li and Tsuhan Chen 5 Perceptually Based Image Processing Algorithm Design 123 James E. Adams, Jr., Aaron T. Deever, Efra ´ ın O. Morales, and Bruce H. Pillman 6 Joint White Balancing and Color Enhancement 167 Rastislav Lukac 7 Perceptual Thumbnail Generation 193 Wei Feng, Liang Wan, Zhouchen Lin, Tien-Tsin Wong, and Zhi-Qiang Liu 8 Patch-Based Image Processing: From Dictionary Learning to Structural Clustering 223 Xin Li 9 Perceptually Driven Super-Resolution Techniques 251 Nabil Sadaka and Lina Karam 10 Methods of Dither Array Construction Employing Models of Visual Perception 287 Daniel L. Lau, Gonzalo R. Arce, and Gonzalo J. Garateguy ix [...]... editor of the books Perceptual Digital Imaging: Methods and Applications (October 2012), Computational Photography: Methods and Applications (October 2010), Single-Sensor Imaging: Methods and Applications for Digital Cameras (September 2008), and Color Image Processing: Methods and Applications (October 2006), all published by CRC Press / Taylor & Francis He is a guest editor of Real-Time Imaging, Special...x Perceptual Digital Imaging: Methods and Applications 11 Perceptual Color Descriptors Serkan Kiranyaz, Murat Birinci, and Moncef Gabbouj 12 Concept-Based Multimedia Processing Using Semantic and Contextual Knowledge Evaggelos Spyrou, Phivos Mylonas, and Stefanos Kollias 319 359 13 Perceptually Driven Video Shot Characterization Gaurav Harit and Santanu Chaudhury 399 14 Perceptual Encryption of Digital. .. frequency and orientation, and essentially represent oriented bandpass filters There is still a lot of discussion about the exact tuning shape and bandwidth, and different experiments have led to different results For the achromatic visual pathways, most studies give estimates of approximately one to two octaves for the spatial frequency bandwidth and 20 to 14 Perceptual Digital Imaging: Methods and Applications. .. exclusively from M-type ganglion cells The four outer layers, the parvocellular layers, receive input mainly from P- 12 Perceptual Digital Imaging: Methods and Applications type ganglion cells As mentioned in Section 1.3.2, the M- and P-cells respond to different types of stimuli, namely, motion and spatial detail, respectively This functional specialization continues in the lateral geniculate nucleus and the... L-cones 0.4 M-cones 0.2 0 400 450 500 550 600 w avelength [nm ] FIGURE 1.5 Normalized absorption spectra of L-, M-, and S-cones [15], [16] 650 700 8 Perceptual Digital Imaging: Methods and Applications 200 cones 160 140 rod s 120 100 optic d isc receptor d ensity [1000/m m 2] 180 80 60 40 20 0 -6 0 -4 0 -2 0 0 20 eccentricity [d egrees] 40 60 FIGURE 1.6 The distribution of photoreceptors on the retina [17]... bipolar and amacrine cells There are about 1.6 million ganglion cells in the retina Their axons form the optic nerve that leaves the eye through the optic disc and carries the output signal of the retina to other processing centers in the brain (see Section 1.4) 10 Perceptual Digital Imaging: Methods and Applications on-center m ixed response m ixed response off-su rrou nd (a) off-center on-su rrou... associate editor for the IEEE Transactions on Circuits and Systems for Video Technology and the Journal of Real-Time Image xv xvi Perceptual Digital Imaging: Methods and Applications Processing He is an editorial board member for Encyclopedia of Multimedia (2nd Edition, Springer, September 2008) He is a Digital Imaging and Computer Vision book series founder and editor for CRC Press / Taylor & Francis He serves... manuscript preparation, Jim McGovern for handling the final production, Andre Barnett for proofreading the book, and John Gandour for designing the book cover Rastislav Lukac Foveon, Inc / Sigma Corp., San Jose, CA, USA E-mail: lukacr@colorimageprocessing.com Web: www.colorimageprocessing.com The Editor Rastislav Lukac (www.colorimageprocessing.com) received M.S (Ing.) and Ph.D degrees in telecommunications... is, the Weber-Fechner law holds in this range This is indeed the luminance range typically encountered in most image processing applications Outside of this range, inten- 16 lu m inance [cd /m 2] Perceptual Digital Imaging: Methods and Applications 100 80 L m ax 60 40 20 0 -1 L m in -0 .5 0 visual angle [d egrees] 0.5 1 FIGURE 1.12 Sinusoidal grating with Michelson contrast of CM = 0.6 and its luminance... support of graduate courses in computer vision, digital imaging, visual data processing, computer graphics, and visual communication, or as stand-alone reference for graduate students, researchers, and practitioners This book provides a strong, fundamental understanding of theory and methods, and a foundation on which solutions for many of today’s most interesting and challenging imaging problems can be built . important and rapidly developing research field. Electrical Engineering K13123K13123K13123 ISBN: 97 8-1 -4 39 8-6 85 6-0 9 781439 868560 9 0 0 0 0 METHODS AND APPLICATIONS LUKACLUKAC METHODS AND APPLICATIONS K13123_FM.indd. Imaging: Meth- ods and Applications (October 2012), Computational Photography: Methods and Applica- tions (October 2010), Single-Sensor Imaging: Methods and Applications for Digital Cam- eras (September. engineering, perceptual digital imaging greatly enhances the capabilities of traditional imaging methods. Filling a gap in the literature, Perceptual Digital Imaging: Methods and Appli- cations