FINAL PROJECT INTERNET OF THINGS face recognition door lock system

HCMC University of Technology and Education FACULTY OF HIGH QUALITY TRAINING FINAL PROJECT INTERNET OF THINGS Face Recognition Door Lock System Instructor: Mr Dinh Cong Doan Participants – Group 4: Huỳnh Thị Mỹ Duyên - 18110009 Nguyễn Tấn Thành - 18110046 Phan Ngọc Bảo Tuyền - 18110062  -HO CHI MINH CITY, April 30, 2022 Contents ACKNOWLEDGEMENTS .3 CHAPTER 1: OVERVIEW OF THE TOPIC Give out the problem .4 Research Content CHAPTER 2: THEORETICAL BASIS Hardware 1.1 ESP 32 ( Board ESP-EYE ) 1.2 12V Solenoid Lock 1.3 Module Relay 5V 1.4 FTDI Board 10 FT232RL Features and Specifications 11 1.5 Charging data cable 12 1.6 Jump wire 12 1.7 Buzzer 13 Arduino IDE Software 15 Principle of operation 16 CHAPTER 3: DESIGN AND BUILD THE SYSTEM 16 Design 16 Build the System 17 CHAPTER 4: CONCLUSION 19 Result 19  Difficulties encountered: Due to illness, we couldn't buy electronic components easily, communication with team members was also limited but our team tried our best to 19 Pros and cons 19 2.1 Pros .19 2.2 Cons .19 Future Development Direction 19 ACKNOWLEDGEMENTS During the implementation of this project, we have received a lot of help, suggestions and enthusiastic guidance from teachers and friends, so we would like to sincerely thank: - The management board of Ho Chi Minh City University of Technology and Education has created the best conditions for students to study and research - The school's teachers have enthusiastically enjoyed the guide and the school library has provided textbooks and reference materials throughout the student's learning process - Especially, the guidance and dedicated help of teacher Dinh Cong Doan has taught, helped and clearly analyzed the problems students still have We have tried our best in the process of researching and implementing it, but because my limited knowledge makes this project unsatisfactory, I hope to receive suggestions, comments and evaluations on the content and presentation form from teacher to be able to complete the report better Sincerely thank! CHAPTER 1: OVERVIEW OF THE TOPIC Give out the problem Currently, our country is developing in the direction of industrialization and modernization, people's demand for convenience in life is increasing, along with the use of smart technologies is also increasing One of them is the Face Recognition Door Lock System It helps to make your house modern, convenient and especially effective against theft Home security systems have become important to every home in Viet Nam In the past, most doors could be opened by traditional means, such as a key, security card, password, or pattern However, incidents like lost keys have led to many disturbing cases such as theft and identity fraud This has become an important issue To overcome this problem, facial recognition using deep learning techniques has been introduced, and the Internet of Things (IoT) is also used to implement an effective access control system Raspberry Pi is a small computer board that is programmable and is used as the main controller for facial recognition, youth system, and locking system The camera is used to record the image of the person in front of the door The IoT system allows the user to control the entrance to the door Therefore, Face Recognition Door Lock System is a topic that my group researches 2 Research Content  Study the documentation about Arduino & ESP32  Design the identification camera, transmission block, power block, reader and central processing block  Design, calculate and build hardware  Write code for Arduino  Assemble and connect the central processing unit and other units  Display data  Run system tests  Fix control errors, programming errors and errors of devices  Write project report CHAPTER 2: THEORETICAL BASIS Hardware 1.1 ESP 32 ( Board ESP-EYE )  Overview: ESP-EYE is a development board for image recognition and audio processing, which can be used in various IoT applications It features an ESP32 chip, a 2-Megapixel camera and a microphone ESP-EYE offers plenty of storage, with an Mbyte PSRAM and a Mbyte flash It also supports image transmission via Wi-Fi and debugging through a MicroUSB port  Block Diagram:  Parameters: Manufavturer Espressif Product category Video IC Development Tools Product Development Boards Type Camera Chip camera on board OV2640 For use with ESP32 Datasheet ESP32_DevKitC  Features:  Evaluates image recognition and audio processing used in various AIoT applications  Features an ESP32 chip, a 2-Megapixel camera and a microphone  8Mbyte PSRAM and a 4Mbyte flash storage  Supports image transmission via Wi-Fi  Supports debugging through a Micro-USB port 1.2 12V Solenoid Lock  Product image:  Specifitcations:  Material: Stainless Steel  Power supply: 12VDC  Working current: 1.2A  Power: 14.5W  Power Requirements: 12VDC/2A  Dimensions: L54 x D38 x H28  Power supply time: Less than 5s  Weight: 150g  Product dimensions 1.3 Module Relay 5V Picture of Relay 5V No Pinout of Relay 5V Parameter Operating voltage Current Consumption Relay Current Trigger Size Circuit of Relay 5V Value VDC 80mA 5mA 43mm x 17.3mm x 17mm Relay 5V Spectifications Sheet Input:  Supply voltage: 5VDC  Control input signal: 0V + Signal is 0V: the relay is closed + The signal is 5V: the relay is open Output:  NC: Normally closed  NO: Normally open  COM: Common pins  Source symbol:  VCC, GND are power supplies for Relay  In is the control signal pin 1.4 FTDI Board Leg type Function Description DTR Data Terminal Ready status pin, used to control signal flow RX Serial data receive pin TX Serial data pin VCC Power supply pins CTS Input pin clears data to send, used to control data GND GND pins FT232RL Features and Specifications  Operating voltage: 5V / 3.3V DC  Maximum current: 5V – 500mA; 3.3V – 50mA  Connection: Mini USB port  Built-in 1024bit EEPROM storage and CBUS I/O configuration  Data transfer rate from 300 baud to Mbaud (RS422, RS485, RS232) at TTL signal level  128byte receive buffer and 256 byte transmit buffer  Transmit and receive LED control signal  Built-in clock without an external quartz oscillator The FTDI Basic Breakout (5V) is a basic breakout board for the FTDI FT232RL USB to serial IC The pinout of this board matches the FTDI cable to work with official Arduino and cloned 5V Arduino boards It can also be used for general serial applications The DTR pin allows an Arduino target to auto-reset when a new Sketch is downloaded This board will auto reset any Arduino board that has the reset pin brought out to a 6-pin connector 1.5 Charging data cable  Transfer rate: 480MMbps  Material: Aluminum shell + TPE + thick nylon braid  Product features: Full protection SR  Current:100cm: 2.4A 1.6 Jump wire Fiber optic patch cord is used for patch cord from device to fiber link It has a thicker layer in use in optical transceivers and connections between terminal boxes 1.7 Buzzer Pinout of Buzzer Circuit of Buzzer No Parameter Operating voltage Current Consumption Resonance frequency Sound amplitude Value 3.5 - 5.5 VDC < 25 mA 2300Hz  ± 500Hz > 80 dB Arduino IDE Software The Arduino IDE (Arduino Integrated Development Environment) is a text editor help write code to load into arduino board Arduino can run on Windows, MAC OS and Linux A program written by the Arduino IDE is called sketch, the sketch is saved in ino format After starting the Arduino IDE, we get the interface as shown below: Arduino IDE User Interface Arduino programs are written in C or C++ The Arduino IDE comes with a software library called 'Wiring'.The user needs to define two functions to execute a program:  Setup () : function run only once at the start of a program used to initialize the settings  Loop() : the function is called repeatedly until the board is turned off 3 Principle of operation FACE RECOGNITION ENGINEERING EVENT Once the correct face recognition has been learned, the RelayPin pin will be pulled to the HIGH level After seconds have passed, if there is no recognition face, the pin is set to LOW The code in the rzoCheckForFace() function can be changed to whatever function you require when it comes to face detection CHAPTER 3: DESIGN AND BUILD THE SYSTEM Design o Feature:  Face recognition  Automatic unlock o Design: The Circuit Diagram for ESP32-CAM Face Recognition Door Lock System is given below: Build the System 2.1 Implementation In this tutorial we will explain how to save the registered image (eroll face) in memory, and then we can use these saved identifiers to compare with the image obtained from the ESP32 There are three steps:  Create a new partition scheme to enable persistent storage  Modify CameraWebServer example sketch to save face data to new partition  Use these saved identities to control devices connected to the ESP32 2.2 repartition ESP32 memory 2.3 Add the following three lines below the available partitioning options for the esp32wrover board in this board.txt file 2.4 Collect face data for storage 2.5 Delete face data from memory CHAPTER 4: CONCLUSION Result  After researching and manufacturing, our face recognize lock door sytem has been working stably  About design: Compact, simple and accurate  About purpose: high versatility  Difficulties encountered: Due to illness, we couldn't buy electronic components easily, communication with team members was also limited but our team tried our best to Pros and cons 2.1 Pros  Suitable for all ages  Suitable for forgetful people  Use quickly  Convenient 2.2 Cons  Lack of security should only be used for unlocking bedroom doors or locking applications for things of moderate importance  High price  Requires skilled workers  Use existing images for identification Future Development Direction  Use high precision components to improve system stability and guarantee  Integrate more fingerprint processing for the system, enhancing security  Incorporating more alarm bells when false identification, in order to detect thieves early  Combined with high-strength doors  ... facial recognition, youth system, and locking system The camera is used to record the image of the person in front of the door The IoT system allows the user to control the entrance to the door. .. convenience in life is increasing, along with the use of smart technologies is also increasing One of them is the Face Recognition Door Lock System It helps to make your house modern, convenient... Diagram for ESP32-CAM Face Recognition Door Lock System? ?is given below: Build the System 2.1 Implementation In this tutorial we will explain how to save the registered image (eroll face) in memory,