VII InverseProblemsand SignalReconstruction RichardJ.Mammone RutgersUniversity 25SignalRecoveryfromPartialInformation ChristinePodilchuk Introduction • FormulationoftheSignalRecoveryProblem • LeastSquaresSolutions • Signal RecoveryusingProjectionontoConvexSets(POCS) • Row-BasedMethods • Block-BasedMethods • ImageRestorationUsingPOCS 26AlgorithmsforComputedTomography GaborT.Herman Introduction • TheReconstructionProblem • TransformMethods • FilteredBackprojection(FBP) • TheLinogramMethod • SeriesExpansionMethods • AlgebraicReconstructionTechniques(ART) • ExpectationMaximization(EM) • ComparisonofthePerformanceofAlgorithms 27RobustSpeechProcessingasanInverseProblem RichardJ.MammoneandXiaoyu Zhang Introduction • SpeechProductionandSpectrum-RelatedParameterization • Template-Based SpeechProcessing • RobustSpeechProcessing • AffineTransform • TransformationofPredic- torCoefficients • AffineTransformofCepstralCoefficients • ParametersofAffineTransform • CorrespondenceofCepstralVectors 28InverseProblems,StatisticalMechanicsandSimulatedAnnealing K.Venkatesh Prasad Background • InverseProblemsinDSP • AnalogieswithStatisticalMechanics • TheSimulated AnnealingProcedure 29ImageRecoveryUsingtheEMAlgorithm JunZhangandAggelosK.Katsaggelos Introduction • TheEMAlgorithm • SomeFundamentalProblems • Applications • Experimental Results • SummaryandConclusion 30InverseProblemsinArrayProcessing KevinR.Farrell Introduction • BackgroundTheory • NarrowbandArrays • BroadbandArrays • InverseFormula- tionsforArrayProcessing • SimulationResults • Summary 31ChannelEqualizationasaRegularizedInverseProblem JohnF.Doherty Introduction • Discrete-TimeIntersymbolInterferenceChannelModel • ChannelEqualization Filtering • Regularization • Discrete-TimeAdaptiveFiltering • NumericalResults • Conclusion 32InverseProblemsinMicrophoneArrays A.C.Surendran Introduction:DereverberationUsingMicrophoneArrays • SimpleDelay-and-SumBeamformers • MatchedFiltering • DiophantineInverseFilteringUsingtheMultipleInput-Output(MINT) Model • Results • Summary c 1999byCRCPressLLC 33SyntheticApertureRadarAlgorithms ClayStewartandVicLarson Introduction • ImageFormation • SARImageEnhancement • AutomaticObjectDetectionand ClassificationinSARImagery 34IterativeImageRestorationAlgorithms AggelosK.Katsaggelos Introduction • IterativeRecoveryAlgorithms • SpatiallyInvariantDegradation • Matrix-Vector Formulation • Matrix-VectorandDiscreteFrequencyRepresentations • Convergence • Useof Constraints • ClassofHigherOrderIterativeAlgorithms • OtherFormsof(x) • Discussion T HEREAREMANYSITUATIONSwhereadesiredsignalcannotbemeasureddirectly.The measurementmightbedegradedbyphysicallimitationsofthesignalsourceand/orbythe measurementdeviceitself.Theacquiredsignalisthusatransformationofthedesiredsignal. Theinversionofsuchtransformationsisthesubjectofthepresentchapter.Inthefollowingsections wewillreviewseveralinverseproblemsandvariousmethodsofimplementationoftheinversionor recoveryprocess.Themethodsdifferintheabilitytodealwiththespecificlimitationspresentineach application.Forexample,theaprioriconstraintofnon-negativityisimportantforimagerecovery, butnotsoforadaptivearrayprocessing.Thegoalofthefollowingsectionsistopresentthebasic approachesofinversionandsignalrecovery.Eachsectionfocusesonaparticularapplicationarea anddescribestheappropriatemethodsforthatarea. Thefirstchapter,25,isentitled“SignalRecoveryfromPartialInformation”byChristinePodilchuk. Thissectionreviewsthebasicproblemofsignalrecovery.Theideaofprojectionontoconvexsets (POCs)isintroducedasanelegantsolutiontothesignalrecoveryproblem.Theinclusionoflinear andnon-linearconstraintsareaddressed.ThePOCsmethodisshowntobeasubsetoftheset theoreticapproachtosignalestimation.Theapplicationofimageofrestorationisdescribedin detail. Chapter26isentitled“AlgorithmsforComputedTomography”byGaborT.Herman.Thissection presentsmethodstoreconstructtheinteriorsofobjectsfromdatacollectedbasedontransmittedor emittedradiation.Theproblemoccursinawiderangeofapplicationareas.Thecomputeralgorithms usedforachievingthereconstructionsarediscussed.Thebasictechniquesofimagereconstruction fromprojectionsareclassifiedinto“TransformMethods”(includingFilteredBackprojectionandthe LinogramMethods)and“SeriesExpansionMethods”(including,inparticular,theAlgebraicRecon- structionTechniquesandthemethodofExpectationMaximization).Inaddition,aperformance comparisonofthevariousalgorithmsforcomputedtomographyisgiven. Chapter27isentitled“RobustSpeechProcessingasanInverseProblem”byRichardJ.Mammone andXiaoyuZhang.Theperformanceofspeechandspeakerrecognitionsystemsissignificantly affectedbytheacousticenvironment.Thebackgroundnoiselevel,thefilteringeffectsintroducedby themicrophoneandthecommunicationchanneldramaticallyaffecttheperformanceofrecognition systems.Itisthereforecriticalthatthesespeechrecognitionsystemsbecapableofdetectingthe ambientacousticenvironmentcontinueandinversetheireffectsfromthespeechsignal.Thisis theinverseprobleminrobustspeechprocessingthatwillbeaddressedinthissection.Ageneral approachtosolvingthisinverseproblemispresentedbasedonanaffinetransformmodelinthe cepstrumdomain. Chapter28isentitled“InverseProblems,StatisticalMechanicsandSimulatedAnnealing”byK. VenkateshPrasad.Inthissection,acomputationalapproachto3-Dcoordinaterestorationispre- sented.Theproblemistoobtainhigh-resolutioncoordinatesof3-Dvolume-elements(voxels)from observationsoftheircorresponding2-Dpicture-elements(pixels).Theproblemisposedasacom- binatorialoptimizationproblemandborrowingfromourunderstandingofstatisticalmechanics, weshowhowtoadaptthetoolofsimulatedannealingtosolvethisproblem.Thismethodishighly amenabletoparallelanddistributedprocessing. Chapter29isentitled“ImageRecoveryUsingtheEMAlgorithm”byJunZhangandAggelosK. c 1999byCRCPressLLC Katsaggelos. Inthissection, theimagerecovery/reconstruction problemisformulatedasamaximum- likelihood (ML) problem in which the image is recovered by maximizing an appropriately defined likelihood function. These likelihood functions are often highly non-linear and when some of the variables involved are not directly observable, they can only be specified in integral form (i.e., aver- aging over the “hidden variables”). The EM (expectation-maximization) algorithm is revised and applied to some typical image recovery problems. Examples include image restoration using the Markov random field model and single and multiple channel image restoration with blur identifica- tion. Chapter 30 is entitled “InverseProblems In Array Processing” by Kevin R. Farrell. Array processing uses multiple sensors to improve signal reception by reducing the effects of interfering signals that originate from different spatial locations. Array processing algorithms are generally implemented via narrowband and broadband arrays, both of which are discussed in this chapter. Two classical approaches, namely sidelobe canceler and Frost beam formers, are reviewed. These algorithms are formulated as an inverse problem and an iterative approach for solving the resulting inverse problem is provided. Chapter 31 is entitled “Channel Equalization as a RegularizedInverse Problem” by JohnF. Doherty. In this section, the relationship between communication channel equalization and the inversion of a linear system of equations is examined. A regularized method of inversion is an inversion process in which the noise dominated modes of the restored signal are attenuated. Channel equalization is the process that reduces the effects of a band-limited channel at the receiver of a communication system. A regularized method of channel equalization is presented in this section. Although there are many ways to accomplish this, the method presented uses linear and adaptive filters, which makes the transition to matrix inversion possible. Chapter 32 is entitled “Inverse Problems in Microphone Arrays” by A.C. Surendran. The response of an acoustic enclosure is, in general, a non-minimum phase function and hence not invertible. In this section, we discuss techniques using microphone arrays that attempt to recover speech signals degraded by the filtering effect of acoustic enclosures by either approximately or exactly “inverting” the room response. The aim of such systems is to force the impulse response of the overall system, after de-reverberation, to be an impulse function. Beamforming and matched-filtering techniques (that approximate this ideal case) and the Diophantine inverse filtering method (a technique that provides an exact inverse) are discussed in detail. Chapter 33 is entitled “Synthetic Aperture Radar Algorithms” by Clay Stewart and Vic Larson. A synthetic aperture radar (SAR) is a radar sensor that provides azimuth resolution superior to that achievable with its real beam by synthesizing a long aperture by platform motion. This section presents an overview of the basics of SAR phenomenology and the associated algorithms that are used to form the radar image and to enhance it. The section begins with an overview of SAR applications, historical development, fundamental phenomenology, and a survey of modern SAR systems. It also presents examples of SAR imagery. This is followed by a discussion of the basic principles of SAR image formation that begins with side looking radar, progresses to unfocused SAR, and finishes with focused SAR.A discussion ofSAR image enhancement techniques, such as thepolarimetric whitening filters, follows. Finally, a brief discussion of automatic target detection and classification techniques is offered. Chapter 34 is entitled “Iterative Image Restoration Algorithms” by Aggelos K. Katsaggelos. In this section, a class of iterative restoration algorithms is presented. Such algorithms provide solutions to the problem of recovering an original signal or image from a noisy and blurred observation of it. This situation is encountered in a number of important applications, ranging from the restoration c 1999 by CRC Press LLC of images obtained by the Hubble space telescope, to the restoration of compressed images. The successive approximation methods form the basis of the material presented in this section. The sample of applications and methods described in this chapter are meant to be representative of the large volume of work performed in this field. There is no claim of completeness, any omissions of significant contributors or other errors are solely the responsibility of the section editor, and all praiseworthy contributions are due solely to the chapter authors. c 1999 by CRC Press LLC . butnotsoforadaptivearrayprocessing.Thegoalofthefollowingsectionsistopresentthebasic approachesofinversionandsignalrecovery.Eachsectionfocusesonaparticularapplicationarea. Theinversionofsuchtransformationsisthesubjectofthepresentchapter.Inthefollowingsections wewillreviewseveralinverseproblemsandvariousmethodsofimplementationoftheinversionor