(Đồ án hcmute) research, design and fabrication of a sport performance tracking system

MINISTRY OF EDUCATION AND TRAINING HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING GRADUATION PROJECT MECHATRONICS ENGINEERING RESEARCH, DESIGN AND FABRICATION OF A SPORT PERFORMANCE TRACKING SYSTEM LECTURER: PH.D BUI HA DUC STUDENT: NGUYEN DINH MINH PHUOC NGUYEN VIET HOANG NGUYEN MINH CONG SKL010452 Ho Chi Minh City, February 2023 HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING -      - GRADUATION THESIS RESEARCH, DESIGN AND FABRICATION OF A SPORT PERFORMANCE TRACKING SYSTEM NGUYỄN ĐÌNH MINH PHƯỚC Student ID: 18146054 NGUYỄN VIẾT HỒNG Student ID: 18146019 NGUYỄN MINH CƠNG Student ID: 18146414 Major: MECHATRONICS ENGINEERING Advisor: PH.D BÙI HÀ ĐỨC Ho Chi Minh City, February 2023 HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING -      - GRADUATION THESIS RESEARCH, DESIGN AND FABRICATION OF A SPORT PERFORMANCE TRACKING SYSTEM NGUYỄN ĐÌNH MINH PHƯỚC Student ID: 18146054 NGUYỄN VIẾT HỒNG Student ID: 18146019 NGUYỄN MINH CƠNG Student ID: 18146414 Major: MECHATRONICS ENGINEERING Advisor: PH.D BÙI HÀ ĐỨC Ho Chi Minh City, February 2023 THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness Ho Chi Minh City, February 1, 2023 GRADUATION PROJECT ASSIGNMENT Student name: NGUYỄN ĐÌNH MINH PHƯỚC Student ID:18146054 Student name: NGUYỄN VIẾT HỒNG Student ID:18146019 Student name: NGUYỄN MINH CƠNG Student ID:18146414 Major: MECHATRONICS ENGINEERING Class: 18146CLA Advisor: PH.D BÙI HÀ ĐỨC Phone number: 0966955459 Date of assignment: _ Date of submission: _ Project title: _ Initial materials provided by the advisor: _ Content of the project: _ Final product: CHAIR OF THE PROGRAM ADVISOR (Sign with full name) (Sign with full name) THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness Ho Chi Minh City, February 1, 2023 ADVISOR’S EVALUATION SHEET Student name: NGUYỄN ĐÌNH MINH PHƯỚC Student ID: 18146054 Student name: NGUYỄN VIẾT HOÀNG Student ID: 18146019 Student name: NGUYỄN MINH CÔNG Student ID: 18146414 Major: MECHATRONICS ENGINEERING Project title: RESEARCH, DESIGN, AND FABRICATION OF A SPORT PERFORMANCE TRACKING SYSTEM Advisor: PH.D BỦI HÀ ĐỨC EVALUATION Content of the project: Strengths: Weaknesses: Approval for oral defense? (Approved or denied) Overall evaluation: (Excellent, Good, Fair, Poor) Mark:……………….(in words: ) Ho Chi Minh City, February 1, 2023 ADVISOR (Sign with full name) THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness Ho Chi Minh City, February 1, 2023 PRE-DEFENSE EVALUATION SHEET Student name: NGUYỄN ĐÌNH MINH PHƯỚC Student ID: 18146054 Student name: NGUYỄN VIẾT HOÀNG Student ID: 18146019 Student name: NGUYỄN MINH CÔNG Student ID: 18146414 Major: MECHATRONICS ENGINEERING Project title: RESEARCH, DESIGN, AND FABRICATION OF A SPORT PERFORMANCE TRACKING SYSTEM Name of Reviewer: EVALUATION Content and workload of the project Strengths: Weaknesses: Approval for oral defense? (Approved or denied) Overall evaluation: (Excellent, Good, Fair, Poor) Mark:…………….(in words: ) Ho Chi Minh City, February 1, 2023 REVIEWER (Sign with full name) THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness Ho Chi Minh City, February 1, 2023 EVALUATION SHEET OF DEFENSE COMMITTEE MEMBER Student name: NGUYỄN ĐÌNH MINH PHƯỚC Student ID: 18146054 Student name: NGUYỄN VIẾT HOÀNG Student ID: 18146019 Student name: NGUYỄN MINH CÔNG Student ID: 18146414 Major: MECHATRONICS ENGINEERING Project title: RESEARCH, DESIGN, AND FABRICATION OF A SPORT PERFORMANCE TRACKING SYSTEM Name of Defense Committee Member: EVALUATION Content and workload of the project Strengths: Weaknesses: Overall evaluation: (Excellent, Good, Fair, Poor) Mark:……………….(in words: ) Ho Chi Minh City, , 2023 COMMITTEE MEMBER (Sign with full name) ACKNOWLEDGEMENTS The completion of this project is an important milestone of our education process in the University of Technology and Education Thanks to this thesis, we could brave ourselves to deal with significant difficulties and obstacles throughout our career path in the future We would like to send our best gratefulness to the teachers at the Department of Mechatronics and the Faculty for High Quality Training for their excellent knowledge transmission, and our sincerest gratitude Dr Bùi Hà Đức who gave us a lot of profound wisdom and comprehensive vision as well as strong motivation to keep our works finished successfully We also would like to give thankfulness to our supportive friends, without their assistance it could be much harder for us to fully finish the thesis Most importantly, deeply thanks to our parents, who have been providing us their endless love, constant encouragement, and sacrificing their whole life to our happiness Finally, we desire to send our appreciation to the Ho Chi Minh city University of Technology and Education, which provided us such significant background knowledge and friendly environment to employ and practice our graduation project TABLE OF CONTENTS LIST OF TABLES 11 LIST OF FIGURES 12 ABBREVIATIONS 16 ABSTRACT 18 TÓM TẮT 19 CHAPTER 1: INTRODUCTION 20 1.1 Motivation 20 1.2 Objectives 22 1.3 Scope 22 1.4 Thesis organization 22 CHAPTER 2: LITERATURE REVIEW 24 2.1 Integrated devices in sport industry 24 2.2 Existing commercial products 24 2.3 Technologies implemented on wearable devices 26 2.3.1 Heart Rate Monitoring 26 2.3.2 Temperature / Heat Flux Sensors 29 2.3.3 Pedometers 30 2.3.4 Accelerometers, Gyroscopes and Magnetometer 30 2.3.5 Global Positioning Satellite sensors 31 2.4 Digital signal processing 32 2.4.1 Definition 33 2.4.2 DSP Block Diagram 33 2.5 Communication 34 2.5.1 Wired Communication 34 2.5.2 Wireless Communication 35 CHAPTER 3: HARDWARE DESIGN 38 3.1 Technical requirements 38 3.2 Sensor specifications 39 3.2.1 GPS/GNSS sensor module 39 3.2.1.1 GNSS working principle 39 3.2.1.2 GNSS module 40 3.2.2 IMU sensor module 41 3.2.2.1 Accelerometer 42 3.2.2.2 Gyroscope 43 3.2.2.3 Magnetometer 43 3.2.2.4 IMU module 44 3.2.3 ECG sensor module 45 3.2.3.1 Electrocardiogram working principles 45 3.2.3.2 ECG module 46 As being illustrated above, the signal now is much cleaner and clearer All the high frequency components were attenuated and eliminated All segments and waves in a cardiac cycle was perfectly preserved, facilitating in the next processing stage Finally, using MATLAB as a programming platform, we found out all the R peaks in the signal by applying Pan-Tompkins’ technique, then calculated the heart rate of person in BPM The Figure 6.2.3.d shows that the heart rate is 91.2 BPM after circling red all the R peaks detected from the signal Figure 6.2.3.d Heart beat detection by MATLAB Based on this final calculation, we could conclude that the heart rate of 91.2 BPM is on warming up stage of athletes All the peaks, like R peak and T wave, are totally normal, showing that health condition is in good status 102 6.3 Connectivity Results Figure 6.3.a Connection testing progression Currently, we have successfully created a mesh with active devices and sent the signal back to the client As can be seen in the Figure 6.3, all data is transmitted to the client and fully displayed But after operating for a while, the system had lost some messages, which can be resulted from publish unacknowledged message, which did not guarantee them, so this information could not be delivered to the client all the time Besides that, by combining GPS sensor, we could examine the connectivity of our device Figure 6.3.b below shows the testing scenario where BLE devices were employed to create a mesh in order to receive position data from GPS sensor As being illustrated, the red and blue path is firstly intended to be rectangular and triangular shape However, the loss data when being transferred resulted in a crooked and deformed shapes on the football field 103 Figure 6.3.b BLE connection testing using GPS data 104 CHAPTER 7: CONCLUSION AND RECOMMENDATION 7.1 Conclusion GPS module conclusion: the data signal received from our tracking system functioned quite well on the open space without too much buildings and blocking objects Although it still had some position errors, it is suitable enough to be employed in any football fields that have little blocking obstacles, making our GPS device functionally operating appropriate to be implemented in real life situations ECG conclusion: the device can receive signal from human body and make some mathematic calculations for observing a better-quality result Therefore, this module is suitable enough to be employed IMU conclusion: although we could compute the speed parameters from the sensor, but these data still had a lot of errors that makes the information unreliable As a result, this sensor should be carefully examined for further applications Connectivity conclusion: our device had some significant improvements related to transferring data through a mesh protocol Nevertheless, our mesh protocol used in this system still cannot be employed in real life situations, and only be in testing and developing stages In general conclusion, our device system cannot satisfy the professional usage in football Therefore, it needs to be developed further in the future 7.2 Recommendations and future developments For future developments, our system should have some more improvements related to hardware components The device should have a housing part that can cover and protect all the inside components from being damaged, and can make it neat enough for being wearable for athletes, such as the Catapult Vector in Figure 7.2.a below 105 Figure 7.2.a Catapul Vector Furthermore, a holding medium such as Sport Bras or wearable belts should have been designed for attaching this device on athletes’ body while participating in a football match, making it appropriate to be used in real-life competitions Figure 7.2.b Adidas Football Sport Bra 106 REFERENCES [1] “The Global Sports Technology Market size is expected to reach $48.7 billion by 2028, rising at a market growth of 16.8% CAGR during the forecast period” Author: ReportLinker September 29, 2022 [2] “History and FIFA Regulations of EPTS” Author: Noor Tasnim, December 19, 2022 [3] “Approval of Electronic Performance and Tracking System (EPTS) devices” Author: FIFA July 8, 2015 [4] “Manchester City launches a new wearable performance tracker” Author: Victoria Song November 4, 2022 [5] “Newcastle United Turns to Wearable Technology for Safe Premier League Return” Author: Robert Kidd June 16, 2020 [6] “Premier League Club Fulham FC Expands Playermaker Wearable to Academy” Author: Andrew Cohen May 28, 2022 [7] “Manchester City launches a new wearable performance tracker” Author: Victoria Song November 4, 2022 [8] “Giải mã áo công nghệ đặc biệt góp cơng lớn giúp đội tuyển Việt Nam thắng Indonesia” Author: Anh Việt June, 2019 [9] “Áo đồng phục gắn chip GPS đội tuyển bóng đá Việt Nam” June, 2019 [10] “Catapult Debuts New GPS Wearable for Amateur Athletes” Author: Joe Lemire August 18, 2021 [11] “In Depth Review of the 4iiii Sport-iiiis ANT + Heads Up Display System” Author: DC RAINMAKER September 14, 2021 107 [12] “In Depth Review of the 4iiii Sport-iiiis ANT + Heads Up Display System” Author: DC RAINMAKER September 14, 2021 [13] “10 REASON WHY CATAPULT VECTOR IS THE MOST ADVANCED ATHLETE TRACKING TECHNOLOGY IN SPORT” Author: catapultsports.com March 14, 2019 [14] “Fitness Vest Helps Amateur Athletes Track & Train Like a Pro” Author: JOSEPH SCOTTING August 18, 2021 [15] “Moov HR Sweat review” Author: Michael Sawh July 3, 2017 [16] “10 Most Innovative Wearables for Fitness and Sport” Author: APAC BUSINESS headlines [17] “Relationship Between Heart Rate & VO2 Max” Author: Emily Alvers MS, CSN, CPT [18] “Muscle Oxygen Training” Author: BJRMD September 20, 2019 [19] “Optical Heart Rate Monitoring: What you need to know” Author: pinnacle LIFESCIENCE [20] “Wearable Performance Devices in Sports Medicine” Author: James E Voos, MD, Department of Orthopaedic Surgery, University Hospitals Case Medical Center, 11100 Euclid Avenue, Cleveland, OH 44106 January, 2016 [21] “Holter Monitor” Author: JOHNS HOPKINS MEDICINE [22] “This wearable constantly does a temperature-screening of your body so you don’t have to” Author: SARANG SHETH August 31, 2020 [23] “Pedometer for Weight Loss – How a Pedometer can help you to Lose Weight” [24] “MEMS Accelerometers” Author: SILICON SENSING 108 [25] “What is a Gyroscope Sensor: Working & Its Applications” Author: WatElectronics May 16, 2020 [26] “An introduction to magnetometers, where they are used and how they work” Author: Team YoungWonks February 16, 2021 [27] “Zepp Labs outs 3D swing analysis systems for baseball, golf and tennis”, Author: Mike Hanlon November 14, 2013 [28] “Principles of GPS” Author: Carl Carter February, 1997 [29] “Global Positioning System and GPS Devices” Author: Rashid Faridi August 8, 2014 [30] “GPS Tracking Creates More Competitive Players” Author: SPT [31] “An Introduction to Digital Signal Processing” Author: Steve Arar June 30, 2021 [32] “Wired Communication Protocols in IoT” Author: Aparna Chaurasia [33] “Differences between Bluetooth and Zigbee” Author: MKS075 July 12, 2022 [34] “Embedded Provisioner for BLE Mesh Network” Author: Michal October 20, 2021 [35] “Difference Between Zigbee and Bluetooth” Author: Sandeep Bhandari [36] “What is GNSS” Author: EUSPA December 3, 2021 [37] “SAM-M8Q module Product summary” Author: U-Blox [38] “GPS MODULE SAM-M8Q” Available: mateksys.com [39] “WHAT IS AN INERTIAL MEASUREMENT UNIT” Author: vectornav.com [40] “MEMS OPERATION” Author: vectornav.com [41] “TDK InvenSense MPU-9255” Available: utmel.com 109 [42] “MPU-9255 Product Specification” Author: InvenSense Inc September 14, 2014 [43] “Hướng dẫn sử dụng module cảm biến gia tốc góc – MPU9255” Author: mlab.vn [44] “Basic Principles of Electrocardiography” Author: Johnson Francis, MBBS, MD, DM, Former Professor of Cardiology, Calicut Govt, Medical Kozhikode, Kerala, India December 27, 2022 [45] “Electrocardiogram (ECG or EKG)” Author: American Heart Association (AHA) December 7, 2022 [46] “Electrocardiography” Author: Britannica December 9, 2022 [47] AD8232 datasheet [48] “ECG Lead positioning” Author: Mike Cadogan January 30, 2022 [49] “Batter Life Calculator” Source: digikey.com [50] Source: hshop.vn [51] TP4056 datasheet [52] Mạch tăng áp DC-DC HT016 Source: hshop.vn [53] AMS1117 datasheet [54] E73-2G4M08S1C User manual v1.9 Source: ebyte.com [55] E73-2G4M08S1C datasheet Source: ebyte.com [56] “Global Navigation Satellite Systems” Author: Hemisphere January 23, 2022 [57] “What exactly is GPS NMEA data?” Author: Eric Gakstatter February 4, 2015 [58] “Read data from GPS receiver” Source: mathworks.com 110 [59] “The Electrocardiogram – A Brief Background” Author: Leif Sörnmo and Pablo Laguna December 2005 [60] “An ECG T-wave Anomalies Detection Using a Lightweight Classification Model for Wireless Body Sensors” Author: Medina Hadjem and Farid Naït-Abdesselam September 2, 2015 [61] “Review of noise removal techniques in ECG signals” Author: Shubhojeet Chatterjee, Rini Smita Thakur, Ram Narayan Yadav, Lalita Gupta, Deepak Kumar Raghuvanshi December 01, 2020 [62] “Butterworth Filter Design” Source: electronics-tutorials.ws [63] “Butterworth Filters” Author: Pieter P July 15, 2021 [64] “Swarm Intelligence Approach to QRS Detection” Author: Mohamed Belkadi and Abdelhamid Daamouche July 4, 2020 [65] “MPU Hardware Offset Registers Application Note” Source: InvenSense [66] “How to Calibrate a Magnetometer” Author: ShawnHymel [67] “Magnetometer Calibration” Source: mathworks.com [68] “Madgwick Orientation Filter” Author: Mario Garcia 2019 [69] “Bluetooth Wireless Technology” Source: bluetooth.com [70] “Resources for Bluetooth Low Energy” Author: Junqing Zhang November 7, 2020 [71] “Point to Point Topology” Author: Pooja Gupta [72] “A Bluetooth Low Energy real-time protocol for Industrial Wireless mesh Networks” Author: G Patti, L Leonardi and L Lo Bello 2016 111 [73] “SELF-ORGANIZING ROUTING PROTOCOL FOR BLUETOOTH LOW ENERGY SENSOR NETWORKS” Author: Marko Haatanen 2012 [74] “Devices need multiple ways to connect” Source: Bluetooth.com [75] “An auto-configuring mesh protocol with proactive source routing for Bluetooth Low Energy” Author: Julio León 2018 [76] “A survey on Bluetooth multi-hop networks” Author: Nicole Todtenberg and Rolf Kraemer June 8, 2019 112 APPENDIX Appendix Figure Device schematic 113 Appendix Figure nRF52840 schematic Appendix Figure AD8232 schematic 114 Appendix Figure SAM-M8Q schematic Appendix Figure MPU9255 schematic 115