Digital Signal Processing Lecture 1 Introduction to DSP Monson H. Hayes mhh3gatech.edu This material is the property of the author and is for the sole and exclusive use of his students. It is not for publication, nor is it to be sold, reproduced, or generally distributed. M.Hayes (CAUGT) Lecture 1 September 1, 2011 1 21 Coordinates and Resources My office is in Room 1002, Building 305. My email address is mhh3gatech.edu. Course notes, homework assignments, solutions to problems, handouts, and other useful resources are available on the Digital Signal Processing Web Page, http:cau.ac.kr~mhhgtxcoursesdsp This page is accessible from my CAU web page http:cau.ac.kr~mhhgtx where you may find information about my research, recent papers, seminars, and other courses. Textbook: A. Oppenheim and R. Schafer, Digital Signal Processing, PrenticeHall. An optional reference is a collection of solved problems with brief summaries of the concept for the course, M. Hayes, Schaum’s Outline on Digital Signal Processing, McGrawHill, 1999. M.Hayes (CAUGT) Lecture 1 September 1, 2011 2 21 Announcements 1 There will be no class on Wednesday. The next class will be on September 10. 2 Start reading Chapter 2 in your textbook. 3 Print and read and start working on the first problem set that is posted on the web. M.Hayes (CAUGT) Lecture 1 September 1, 2011 3 21 Structure of the Course 1 Lectures I Goal: To introduce concepts in digital signal processing and filtering, and illustrate these concepts through interesting problems and applications. I Note: I cannot cover everything in 2.5 hours a week. It is up to you to supplement lectures with reading and outside classwork. 2 Assignments I Purpose: To give you a chance to exercise your mind, and to solidify the concepts introduced to you in class. I Structure: Some simple drill problems, some more challenging thought problems. I Importance: Extremely important (but only if you want to succeed in this course, learn something, and get a good grade). 3 Exams (Midterm plus a final) I Reason: I need to give you a grade for the course. I Benefits: It will give you the chance to perform an assessment of your understanding of the course. These exams will not be plug in an equation and solve problems. 4 A weekly 10 minute inclass quiz. M.Hayes (CAUGT) I Purpose: To encourage you to keep up with your work and studies. Lecture 1 September 1, 2011 4 21Lecture Notes Before each class (hopefully two days before, but I cannot guarantee this), I will post the lecture slides for the next lecture. I It is highly recommended that you reviewread the lecture slides before class so that you are better prepared. I Personally, I do not believe in lecturing using wellchoreographed PowerPoint slides, but ... Sometimes the slides that are presented will differ from those that have been posted for two reasons: 1 We may not have finished some of the slides from the previous class, 2 Some ideas for some other material may come to mind after I have posted the slides. I will not repost the lecture slides, it is up to you to take the appropriate notes. Sometimes, I will leave parts of the slide blank and fill it in during class, and many times I will create a new slide, in realtime, during lecture to answer a question or add some additional explanations. Again, it will be your responsibility to take notes M.Hayes (CAUGT) Lecture 1 September 1, 2011 5 21 Grading and Class Attendance Midterm 30% Final 40% Assignments 10% Weekly Quizzes 10% Class Participation 10% Elements that will enter into your Class Participation Grade 1 Your participation in class in askinganswering questions, 2 Your performance on the 10 minute quizzes, and 3 Your outofclass discussions with me, after class or during office hours. M.Hayes (CAUGT) Lecture 1 September 1, 2011 6 21 Grading and Class Attendance Midterm 30% Final 40% Assignments 10% Weekly Quizzes 10% Class Participation 10% Some notes on the Assignments 1 These are for you and for your benefit. 2 If I believed that you would work hard and put in the time to complete these assignments, I would not collect them for grading. 3 Discussing the problems with each other is encouraged, 4 Copying each others assignments or submitting solutionsanswers on the web is strictly prohibited (I am very good at determining when this has been done). M.Hayes (CAUGT) Lecture 1 September 1, 2011 7 21 Phones, Texting, and Newspapers There are a few very simple rules in this course, and they are based on the following premise, which I hope is true: You are coming to class to learn and to participate in classroom discussions So, 1 Turn your phones off and put them away. I never want to hear a phone ring during class, and I never want to see anyone playing with their phone. 2 No Texting: If you feel the urge to text someone are read a text message form someone else, leave the room and don’t come back. 3 Nothing in your Ears. I do not want to see anything plugged in your ears. If I do, I will assume that whatever is in your ear is intended as a gift for me and I will come to your desk and gladly accept it. M.Hayes (CAUGT) Lecture 1 September 1, 2011 8 21Goals I have four goals for this course 1 To teach you something this term. 2 To have you appreciate the importance of dsp in today’s digital world. 3 To help you break an unfortunate pattern in today’s world of looking for the answer on the internet. You have a brain, and I want to give you the confidence to use it. 4 To have some fun. By the end of the term I hope that you can say I really enjoyed this course. What are your goals (besides getting a passing grade or an A?) I This is a very important question to think about, because there is a lot more to learning then getting the grade you want, and it is not a very good recipe for success. M.Hayes (CAUGT) Lecture 1 September 1, 2011 9 21 Objectives of the Course 1 To develop methods for processing discretetime signals. These signals include waveforms that originate as discretetime signals as well as those that originate from sampling continuoustime signals. 2 To understand the processes of AD and DA conversion. 3 To acquire some familiarity with digital filters in terms design and implementation and to become familiar with how various types of filters affect signal characteristics. 4 To understand the discrete Fourier transform and discrete spectral analysis. To become familiar with some applications of digital processing. Topics may include speech processing, image processing, multidimensional digital signal processing, adaptive filtering, spectrum estimation, and adaptive filtering. M.Hayes (CAUGT) Lecture 1 September 1, 2011 10 21 Course Prerequisites There are NO prerequisites for this course except: 1 A willingness to work hard and to think independently. 2 A commitment to put a time, outside of class, reading and working problems. 3 A desire to learn and to not be afraid to ask questions. M.Hayes (CAUGT) Lecture 1 September 1, 2011 11 21 Some Important Things to Understand About This Course DSP is Applied Mathematics, and Math is Not a Spectator Sport You cannot learn DSP by just going to class and watching the instructor lecture and work problems. You need to get involved in the learning process. If you aren’t willing to be actively involved in the process of learning, both inside and outside of the class room, then you will have trouble passing any class. M.Hayes (CAUGT) Lecture 1 September 1, 2011 12 21Some Important Things to Understand About This Course Work to Understand the Principles You can pass a history class by simply memorizing a set of dates, names and events. You will find, however, that in order to pass this class you will need to do more than just memorize a set of formulas. You need to understand how to USE the formulas and that is often far different from just memorizing them. You also need to understand WHAT formula to use and WHEN. You may have to modify the formula to fit the problem. M.Hayes (CAUGT) Lecture 1 September 1, 2011 13 21 Some Important Things to Understand About This Course DSP an Applied Mathematics is Cumulative This course, as well as most other courses in engineering, is cumulative. Most everything that you learn will depend on subjects that you’ve previously learned. M.Hayes (CAUGT) Lecture 1 September 1, 2011 14 21 How Do I StudyLearn DSP? There are many things that are important for you to do in order to succeed. A few of the more important things, and ones that are most often not done are: 1 Do the homework in a manner that is conducive to learning. 2 Use the Internet as a resource for learning, but never as a place to look for answers to problems. 3 Do not wait until the last minute to do your homework, read the book, study your notes, or get ready for an exam. 4 Ask questions, seek help from your professor (it is his job and responsibility to help you learn that is what (s)he is paid to do), discuss the course with classmates. M.Hayes (CAUGT) Lecture 1 September 1, 2011 15 21 Objectives of the Course 1 To develop methods for processing discretetime signals. These signals include waveforms that originate as discretetime signals as well as those that originate from sampling continuoustime signals. 2 To understand the processes of AD and DA conversion. 3 To acquire some familiarity with digital filters in terms design and implementation and to become familiar with how various types of filters affect signal characteristics. 4 To understand what is meant by a discretetime random process, to understand the effect of digital filters on random signals, and the importance of noise in digital systems. 5 To understand the discrete Fourier transform and discrete spectral analysis. 6 To become familiar with some applications of digital processing, and to implement signal processing functions in Matlab and Simulink. Applications include: speech processing, image processing, multidimensional digital signal processing, and spectrum estimation. M.Hayes (CAUGT) Lecture 1 September 1, 2011 16 21Prerequisites for the Course 1 A willingness to work hard and to think independently. 2 A commitment to put a significant amount of time, outside of class, reading and working problem. 3 A desire to learn and to not be afraid to ask questions. M.Hayes (CAUGT) Lecture 1 September 1, 2011 17 21 Course Topics Discretetime signals and systems 1 Basic signal manipulations. 2 System analysis and description: F Linearity and shiftinvariance. F Difference equations. F Stability and causality. F Convolution Frequency analysis of signals and systems. 1 The DiscreteTime Fourier transform { definition and properties. 2 The use and application of Fourier transforms. 3 Frequency response of systems. M.Hayes (CAUGT) Lecture 1 September 1, 2011 18 21 Course Topics (cont.) Sampling { AD and DA conversion The ztransform. 1 Definition and properties. 2 Poles and zeros. 3 The system function. The Discrete Fourier Transform (DFT) 1 Fourier series and Periodic convolution 2 Circular convolution and the DFT 3 Introduction to the FFT M.Hayes (CAUGT) Lecture 1 September 1, 2011 19 21 Course Topics (cont.) Filter Structures and Flowgraphs 1 Direct Form, Cascade and Parallel forms 2 Transposed structures 3 The Lattice filter 4 FIR Structures Filter Design 1 FIR filter design 2 IIR filter design 3 Least squares inverse design M.Hayes (CAUGT) Lecture 1 September 1, 2011 20 21Course Topics (cont.) DiscreteTime Random Signals 1 Mean, correlation, and widesense stationarity 2 noise 3 Random signals through discretetime LSI systems 4 Minimum meansquare error estimation 5 Power spectrum M.Hayes (CAUGT) Lecture 1 September 1, 2011 21 21
Coordinates and Resources Digital Signal Processing Lecture # Introduction to DSP My office is in Room 1002, Building 305 My email address is mhh3@gatech.edu Course notes, homework assignments, solutions to problems, handouts, and other useful resources are available on the Digital Signal Processing Web Page, Monson H Hayes http://cau.ac.kr/~mhhgtx/courses/dsp/ mhh3@gatech.edu This page is accessible from my CAU web page http://cau.ac.kr/~mhhgtx/ where you may find information about my research, recent papers, seminars, and other courses Textbook: A Oppenheim and R Schafer, Digital Signal Processing, Prentice-Hall An optional reference is a collection of solved problems with brief summaries of the concept for the course, M Hayes, Schaum’s Outline on Digital Signal Processing, McGraw-Hill, 1999 This material is the property of the author and is for the sole and exclusive use of his students It is not for publication, nor is it to be sold, reproduced, or generally distributed M.Hayes (CAU-GT) Lecture # September 1, 2011 / 21 Announcements M.Hayes (CAU-GT) September 1, 2011 / 21 Structure of the Course 1 Lecture # Goal: To introduce concepts in digital signal processing and filtering, and illustrate these concepts through interesting problems and applications Note: I cannot cover everything in 2.5 hours a week It is up to you to supplement lectures with reading and outside classwork There will be no class on Wednesday The next class will be on September 10 Start reading Chapter in your textbook Print and read and start working on the first problem set that is posted on the web Lectures Assignments Purpose: To give you a chance to exercise your mind, and to solidify the concepts introduced to you in class Structure: Some simple ”drill problems,” some more challenging ”thought problems.” Importance: Extremely important (but only if you want to succeed in this course, learn something, and get a good grade) Exams (Midterm plus a final) Reason: I need to give you a grade for the course Benefits: It will give you the chance to perform an ”assessment” of your understanding of the course These exams will not be ”plug in an equation and solve” problems M.Hayes (CAU-GT) Lecture # September 1, 2011 / 21 A weekly 10 minute in-class quiz Lecture September 2011 / 21 Purpose: To encourage you to #keep up with your work and 1,studies M.Hayes (CAU-GT) Lecture Notes Grading and Class Attendance Before each class (hopefully two days before, but I cannot guarantee this), I will post the lecture slides for the next lecture Midterm Final Assignments Weekly Quizzes Class Participation It is highly recommended that you review/read the lecture slides before class so that you are better prepared Personally, I not believe in lecturing using well-choreographed PowerPoint slides, but Sometimes the slides that are presented will differ from those that have been posted for two reasons: We may not have finished some of the slides from the previous class, Some ideas for some other material may come to mind after I have posted the slides I will not repost the lecture slides, it is up to you to take the appropriate notes Sometimes, I will leave parts of the slide blank and fill it in during class, and many times I will create a new slide, in real-time, during lecture to answer a question or add some additional explanations Again, it will be your responsibility to take notes M.Hayes (CAU-GT) Lecture # September 1, 2011 / 21 Grading and Class Attendance Midterm Final Assignments Weekly Quizzes Class Participation 30% 40% 10% 10% 10% Elements that will enter into your Class Participation Grade Your participation in class in asking/answering questions, Your performance on the 10 minute quizzes, and Your out-of-class discussions with me, after class or during office hours M.Hayes (CAU-GT) Lecture # September 1, 2011 / 21 Phones, Texting, and Newspapers There are a few very simple rules in this course, and they are based on the following premise, which I hope is true: 30% 40% 10% 10% 10% You are coming to class to learn and to participate in classroom discussions So, Some notes on the Assignments These are for you and for your benefit If I believed that you would work hard and put in the time to complete these assignments, I would not collect them for grading Discussing the problems with each other is encouraged, Copying each others assignments or submitting solutions/answers on the web is strictly prohibited (I am very good at determining when this has been done) M.Hayes (CAU-GT) Lecture # September 1, 2011 / 21 Turn your phones off and put them away! I never want to hear a phone ring during class, and I never want to see anyone playing with their phone No Texting: If you feel the urge to text someone are read a text message form someone else, leave the room and don’t come back Nothing in your Ears I not want to see anything plugged in your ears If I do, I will assume that whatever is in your ear is intended as a gift for me and I will come to your desk and gladly accept it M.Hayes (CAU-GT) Lecture # September 1, 2011 / 21 Goals Objectives of the Course To develop methods for processing discrete-time signals These signals include waveforms that originate as discrete-time signals as well as those that originate from sampling continuous-time signals To understand the processes of A-D and D-A conversion To acquire some familiarity with digital filters in terms design and implementation and to become familiar with how various types of filters affect signal characteristics To understand the discrete Fourier transform and discrete spectral analysis To become familiar with some applications of digital processing Topics may include speech processing, image processing, multidimensional digital signal processing, adaptive filtering, spectrum estimation, and adaptive filtering I have four goals for this course To teach you something this term To have you appreciate the importance of dsp in today’s digital world To help you break an unfortunate pattern in today’s world of ”looking for the answer on the internet.” You have a brain, and I want to give you the confidence to use it To have some fun By the end of the term I hope that you can say ”I really enjoyed this course.” What are your goals (besides getting a passing grade or an ”A”?) This is a very important question to think about, because there is a lot more to learning then ”getting the grade you want,” and it is not a very good recipe for success M.Hayes (CAU-GT) Lecture # September 1, 2011 / 21 Course Prerequisites M.Hayes (CAU-GT) Lecture # September 1, 2011 10 / 21 Some Important Things to Understand About This Course DSP is Applied Mathematics, and Math is Not a Spectator Sport There are NO prerequisites for this course except: A willingness to work hard and to think independently A commitment to put a time, outside of class, reading and working problems A desire to learn and to not be afraid to ask questions M.Hayes (CAU-GT) Lecture # September 1, 2011 You cannot learn DSP by just going to class and watching the instructor lecture and work problems You need to get involved in the learning process If you aren’t willing to be actively involved in the process of learning, both inside and outside of the class room, then you will have trouble passing any class 11 / 21 M.Hayes (CAU-GT) Lecture # September 1, 2011 12 / 21 Some Important Things to Understand About This Course Some Important Things to Understand About This Course Work to Understand the Principles DSP an Applied Mathematics is Cumulative You can pass a history class by simply memorizing a set of dates, names and events You will find, however, that in order to pass this class you will need to more than just memorize a set of formulas This course, as well as most other courses in engineering, is cumulative You need to understand how to USE the formulas and that is often far different from just memorizing them Most everything that you learn will depend on subjects that you’ve previously learned You also need to understand WHAT formula to use and WHEN You may have to modify the formula to fit the problem M.Hayes (CAU-GT) Lecture # September 1, 2011 13 / 21 How Do I Study/Learn DSP? M.Hayes (CAU-GT) There are many things that are important for you to in order to succeed A few of the more important things, and ones that are most often not done are: Do the homework in a manner that is conducive to learning Use the Internet as a resource for learning, but never as a place to look for answers to problems Do not wait until the last minute to your homework, read the book, study your notes, or get ready for an exam Ask questions, seek help from your professor (it is his job and responsibility to help you learn - that is what (s)he is paid to do), discuss the course with classmates Lecture # September 1, 2011 14 / 21 Objectives of the Course M.Hayes (CAU-GT) Lecture # September 1, 2011 15 / 21 To develop methods for processing discrete-time signals These signals include waveforms that originate as discrete-time signals as well as those that originate from sampling continuous-time signals To understand the processes of A-D and D-A conversion To acquire some familiarity with digital filters in terms design and implementation and to become familiar with how various types of filters affect signal characteristics To understand what is meant by a discrete-time random process, to understand the effect of digital filters on random signals, and the importance of noise in digital systems To understand the discrete Fourier transform and discrete spectral analysis To become familiar with some applications of digital processing, and to implement signal processing functions in Matlab and Simulink Applications include: speech processing, image processing, multidimensional digital signal processing, and spectrum estimation M.Hayes (CAU-GT) Lecture # September 1, 2011 16 / 21 Prerequisites for the Course Course Topics Discrete-time signals and systems A willingness to work hard and to think independently A commitment to put a significant amount of time, outside of class, reading and working problem A desire to learn and to not be afraid to ask questions Basic signal manipulations System analysis and description: Linearity and shift-invariance Difference equations Stability and causality Convolution Frequency analysis of signals and systems M.Hayes (CAU-GT) Lecture # September 1, 2011 17 / 21 Definition and properties Poles and zeros The system function Fourier series and Periodic convolution Circular convolution and the DFT Introduction to the FFT M.Hayes (CAU-GT) September 1, 2011 18 / 21 Lecture # September 1, 2011 20 / 21 Direct Form, Cascade and Parallel forms Transposed structures The Lattice filter FIR Structures Filter Design The Discrete Fourier Transform (DFT) Lecture # Filter Structures and Flowgraphs Sampling – A/D and D/A conversion The z-transform M.Hayes (CAU-GT) Course Topics (cont.) Course Topics (cont.) The Discrete-Time Fourier transform – definition and properties The use and application of Fourier transforms Frequency response of systems September 1, 2011 19 / 21 FIR filter design IIR filter design Least squares inverse design M.Hayes (CAU-GT) Lecture # Course Topics (cont.) Discrete-Time Random Signals Mean, correlation, and wide-sense stationarity noise Random signals through discrete-time LSI systems Minimum mean-square error estimation Power spectrum M.Hayes (CAU-GT) Lecture # September 1, 2011 21 / 21