... in Section 53. 4.3. Adaptive restoration for ringing suppression and blind restoration are covered in Sections 53. 4.4 and 53. 4.5,respectively. Restoration of multispectral images and space-varyingblurred ... LLCImageandVideoRestorationA.MuratTekalpUniversityofRochester 53. 1Introduction 53. 2ModelingIntra-FrameObservationModel•MultispectralObserva-tionModel•MultiframeObservationModel•RegularizationModels 53. 3ModelParameterEstimationBlurIdentification•EstimationofRegularizationParameters•EstimationoftheNoiseVariance 53. 4Intra-FrameRestorationBasicRegularizedRestorationMethods•RestorationofIm-agesRecordedbyNonlinearSensors•RestorationofImagesDegradedbyRandomBlurs•AdaptiveRestorationforRing-ingReduction•BlindRestoration(Deconvolution)•Restora-tionofMultispectralImages•RestorationofSpace-VaryingBlurredImages 53. 5MultiframeRestorationandSuperresolutionMultiframeRestoration•Superresolution•SuperresolutionwithSpace-VaryingRestoration 53. 6ConclusionReferences 53. 1 IntroductionDigitalimagesandvideo,acquiredbystillcameras,consumercamcorders,orevenbroadcast-qualityvideocameras,areusuallydegradedbysomeamountofblurandnoise.Inaddition,mostelectroniccamerashavelimitedspatialresolutiondeterminedbythecharacteristicsofthesensorarray.Commoncausesofblurareout-of-focus,relativemotion,andatmosphericturbulence.Noisesourcesincludefilmgrain,thermal,electronic,andquantizationnoise.Further,manyimagesensorsandmediahaveknownnonlinearinput-outputcharacteristicswhichcanberepresentedaspointnonlinearities.Thegoalofimageandvideo(imagesequence)restorationistoestimateeachimage(frameorfield)asitwouldappearwithoutanydegradations,byfirstmodelingthedegradationprocess,andthenapplyinganinverseprocedure.Thisisdistinctfromimageenhancementtechniqueswhicharedesignedtomanipulateanimageinordertoproducemorepleasingresultstoanobserverwithoutmakinguseofparticulardegradationmodels.Ontheotherhand,superresolutionreferstoestimatinganimageataresolutionhigherthanthatoftheimagingsensor.Imagesequencefiltering (restoration andsuperresolution)becomesespeciallyimportantwhenstillimagesfromvideoaredesired.Thisisbecausetheblurandnoisecanbecomeratherobjectionablewhenobservinga“freeze-frame”,althoughtheymaynotbevisibletothehumaneyeattheusualframerates.Sincemanyvideosignalsencounteredinpracticeareinterlaced,weaddressthecasesofbothprogressiveandinterlacedvideo.c1999byCRCPressLLCTheproblemofimagerestorationhassparkedwidespreadinterestinthesignalprocessingcommu-nityoverthe ... Y.,Recursivehigh-resolutionreconstructionofblurredmultiframeimages,IEEE Trans. Image Proc., 2(4), 534 539 , 1993.[84] Irani, M. and Peleg, S., Improving resolutionbyimage registration,CVGIP: Graphical Models and Image Proc., 53, 231–239,...