(Đồ án hcmute) application of image processing in the identification of people falling

MINISTRY OF EDUCATION AND TRAINING HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION GRADUATION PROJECT AUTOMATION AND CONTROL ENGINEERING APPLICATION IMAGE PROCESSING IN THE IDENTIFICATION OF PEOPLE FALLING LECTURER: PhD VU VAN PHONG STUDENT: PHAM DUC THIEN TRAN DAI LOC SKL 010346 Ho Chi Minh City, February 2023 HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING GRADUATION PROJECT APPLICATION IMAGE PROCESSING IN THE IDENTIFICATION OF PEOPLE FALLING PHAM DUC THIEN TRAN DAI LOC Student ID: 17151033 17151018 Major : AUTOMATION AND CONTROL ENGINEERING Advisor : VU VAN PHONG, PhD Ho Chi Minh City, January 2023 THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness -Ho Chi Minh City, January 7, 2023 GRADUATION PROJECT ASSIGNMENT Student name: _ Student ID: _ Student name: Student name: Major: Advisor: Student ID: _ Date of assignment: _ Date of submission: _ Student ID: _ Class: Phone number: _ Project title: _ Initial materials provided by the advisor: _ Content of the project: _ Final product: CHAIR OF THE PROGRAM ADVISOR (Sign with full name) (Sign with full name) THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness -Ho Chi Minh City, January 7, 2023 ADVISOR’S EVALUATION SHEET Student name: Student ID: Student name: Student ID: Student name: Student ID: Major: Project title: Advisor: EVALUATION Content of the project: Strengths: Weaknesses: Approval for oral defense? (Approved or denied) Overall evaluation: (Excellent, Good, Fair, Poor) Mark: ……………… (In words: .) Ho Chi Minh City, January 7, 2023 ADVISOR (Sign with full name) THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness -Ho Chi Minh City, January 7, 2023 PRE-DEFENSE EVALUATION SHEET Student name: Student ID: Student name: Student ID: Student name: Student ID: Major: Project title: Name of Reviewer: EVALUATION Content and workload of the project Strengths: Weaknesses: Approval for oral defense? (Approved or denied) Overall evaluation: (Excellent, Good, Fair, Poor) Mark: ……………… (In words: ) Ho Chi Minh City, January 7, 2023 REVIEWER (Sign with full name) THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness EVALUATION SHEET OF DEFENSE COMMITTEE MEMBER Student name: Student ID: Student name: Student ID: Student name: Student ID: Major: Project title: Name of Defense Committee Member: EVALUATION Content and workload of the project Strengths: Weaknesses: Overall evaluation: (Excellent, Good, Fair, Poor) Mark:……………….(in words: ) Ho Chi Minh City, January 7, 2023 COMMITTEE MEMBER (Sign with full name) Acknowledgements To begin with, we would like to express our deepest gratitude and respect to Ph.D Vu Van Phong, who gave us many important perspectives during the time we worked on our business project We truly thank you for working together and directing all of us during the time we have learned and completed this venture Although there are many difficulties and errors, we still try to overcome and appreciate Ph.D Vu Van Phong meets a lot and has accurate information so that our team can progress and complete extended time We would also like to express our deep gratitude to the Board of Directors of Ho Chi Minh City University of Innovation and Training and the instructors in the force of Electrical - Electronic Design and Quality Training Human Resources high, who taught and created all favorable conditions conditions and environment help us in the process of studying and implementing the project Student Contents Chapter 1: INTRODUCTION 1.1 Problem Statement 1.2 Objective 1.3 Constraints 1.4 Jobs to 1.5 Plan 1.6 Estimated Expense Chapter 2: LITERATURE REVIEW 2.1 Introduction 2.2 System review 2.3 GAUSSIAN FILTER 2.3.1 PROCESS TO APPLY A GAUSS FILTER 2.3.2 Fourier Spectrum- Quick Refresh 2.3.3 Filtering 2.3.4 Gaussian Filter 2.3.5 Gaussian Filter and low pass filtering 2.4 Gaussian blurring 2.4.1 When to use Gaussian blur 2.4.2 The aspects of a Gaussian blur filter 2.4.3 How Gaussian blur works in image filtering 2.5 SOFTWARE 2.5.1 RASPBERRY PI 2.5.2 PYTHON 11 Chapter 3: HARDWARE DESIGN 14 3.1 System Requirement 14 3.2 System Design 14 3.3 Device Selection 14 3.3.1 Raspberry Pi 14 3.3.2 C920s PRO HD WEBCAM 17 3.4 Algorithm Flowchart 19 Chapter 4: METHODOLOGY 21 4.1 System Overview 21 4.2 OpenCV 21 4.3 Method 22 4.4 Function in code: 24 4.5 Image Progessing- Smoothing 27 4.6 Gaussianblur 28 4.7 Threshold 30 4.8 Morphological Processing 32 4.8.1 Morphology Introduction 32 4.8.2 Morphological Transformation 32 4.9 Contours: 36 4.10 Application System 38 4.11 Python HTTP Server 40 Chapter 5: EXPERIMENT RESULTS/ FINDINGS AND ANALYSIS 43 5.1 Hardware Result 43 5.2 Testing Result 44 Chapter 6: CONCLUSION AND RECOMMENDATIONS 51 6.1 Conclusion 51 6.2 Future works 51 References 52 Appendices 55 List of Figures Figure 1.1.1Among geriatric and adult patients hospitalized for the treatment of trauma injuries, the etiology of trauma [1] Figure 2.3.1Two Dimensional gaussian function Figure 2.3.2 A 3x3 mask Figure 2.5.1 Raspberry Pi [13] Figure 2.5.2 Some types of Raspberry Pi [14] 10 Figure 3.3.1 Raspberry pi4 [17] 14 Figure 3.3.2 Raspberry Pi diagram [18] 17 Figure 3.3.3 C920 PRO HD WEBCAM [19] 17 Figure 3.4.1 Flow chart 19 Figure 4.2.1 Open CV [20] 21 Figure 4.3.1Human body position with respect to ellipse while falling [22] 23 Figure 4.3.2 Symbols used in our algorithm [22] 23 Figure 4.4.1 resize 2x2 mask to 2x4 24 Figure 4.4.2 resize 2x2 mask to 3x2 24 Figure 4.4.3 Result 27 Figure 4.5.1 Salt and pepper Noise 27 Figure 4.5.2 Gauss Noise 28 Figure 4.6.1 Result 29 Figure 4.6.2 Result 30 Figure 4.7.1 Result 31 Figure 4.8.1 The three-step process of erosion 32 Figure 4.8.2 Image has been fully processed 33 Figure 4.8.3 Result of process 33 Figure 4.8.4 Steps are used to divide the operations 34 Figure 4.8.5 Image has been fully processed 34 Figure 4.8.6 Result of process 34 Figure 4.8.7 Result 36 Figure 4.9.1 Result 38 Figure 4.10.1 Specification of web server [23] 38 Figure 5.2.4 notification from mobile device When an elderly person falls, the circular frame will change from vertical to horizontal, through which the recognition system will know that the person being tracked is falling Code to detect people falling if (abs(originalAngleP) > minAngle and abs(originalAngleH) < maxAngle and abs(originalAngleP)+abs(originalAngleH)>89 and abs(originalAngleP)+abs(originalAngleH) 18): count_fall+=1 #print("Fall detected") list_falls.append((time.time())) if(count_fall>1): if(list_falls[len(list_falls)-1]-list_falls[len(list_falls)2]