Design automatic vehicle toll system through scanning qr code using camera

MINISTRY OF EDUCATION AND TRAINING HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING GRADUATION THESIS ELELECTRONICS AND COMMUNICATION ENGINEERING TECHNOLOGY DESIGN AUTOMATIC VEHICLE TOLL SYSTEM THROUGH SCANNING QR CODE USING CAMERA LECTURER: M.Eng NGUYEN THANH NGHIA SONSTUDENT: NGUYEN DANG KHOA PHAM VIET ANH SKL 0 Ho Chi Minh City, May 2022 HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING GRADUATION THESIS MAJOR: ELECTRONICS AND COMMUNICATION ENGINEERING TECHNOLOGY DESIGN AUTOMATIC VEHICLE TOLL SYSTEM THROUGH SCANNING QR CODE USING CAMERA ADVISOR: NGUYEN THANH NGHIA, M.Eng STUDENTS: NGUYEN DANG KHOA Student ID: 17141013 PHAM VIET ANH Student ID: 17141001 HO CHI MINH CITY, MAY 2022 HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION FACULTY FOR HIGH QUALITY TRAINING GRADUATION THESIS MAJOR: ELECTRONICS AND COMMUNICATION ENGINEERING TECHNOLOGY DESIGN AUTOMATIC VEHICLE TOLL SYSTEM THROUGH SCANNING QR CODE USING CAMERA ADVISOR: NGUYEN THANH NGHIA, M.Eng STUDENTS: NGUYEN DANG KHOA Student ID: 17141013 PHAM VIET ANH Student ID: 17141001 HO CHI MINH CITY, MAY 2022 THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness Ho Chi Minh City, July 29th, 2022 ADVISOR’S EVALUATION SHEET Student name: Pham Viet Anh Student ID: 17141001 Student name: Nguyen Dang Khoa Student ID: 17141013 Major: Electronics and Communication Engineering Technology Project title: Design automatic vehicle toll system through scanning QR code using camera Advisor: Nguyen Thanh Nghia, M.Eng EVALUATION Content of the project: The content of the project is highly suitable for an undergraduate student’s final project Strengths: Weaknesses: Overall evaluation: (Excellent, Good, Fair, Poor): Mark: Ho Chi Minh City, July 29th, 2022 ADVISOR (Sign with full name) Nguyễn Thanh Nghĩa THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness *** -Ho Chi Minh City, July 29th, 2022 PRE-DEFENSE EVALUATION SHEET Student name: Pham Viet Anh Student ID: 17141001 Student name: Nguyen Dang Khoa Student ID: 17141013 Major: Electronics Communication Engineering Thesis title: Design automatic vehicle toll system through scanning QR code using camera Name of Reviewer: EVALUATION Content and workload of the thesis: Strengths: Weaknesses: Approval for oral defense? (Approved or denied) Overall evaluation: (Excellent, Good, Fair, Poor): Mark: ………… (in words: ………….………….………….………….……………) REVIEWER ii THE SOCIALIST REPUBLIC OF VIETNAM Independence – Freedom– Happiness -Ho Chi Minh City, July 29th, 2022 EVALUATION SHEET OF DEFENSE COMMITTEE MEMBER Student name: Pham Viet Anh Student ID: 17141001 Student name: Nguyen Dang Khoa Student ID: 17141013 Major: Electronics and Communication Engineering Technology Project title: Design automatic vehicle toll system through scanning QR code using camera Advisor: M.Eng Nguyen Thanh Nghia Name of Defense Committee Member: EVALUATION Content and workload of the project Strengths: Weaknesses: Overall evaluation: (Excellent, Good, Fair, Poor) 5.Mark:……………….(in words: .) Ho Chi Minh City, August , 2022 COMMITTEE MEMBER (Sign with full name) ii HCMC University of Technology and Education Faculty for High Quality training Socialist Republic of Vietnam Independence - Liberty – Happiness Ho Chi Minh City, July 29th, , 2022 PROJECT ASSIGNMENT Name of Members: Pham Viet Anh Nguyen Dang Khoa Student ID: 17141001 Student ID: 17141013 Training system: Regular university Major: Electronics and communication engineering technology Class: 17141CLA I NAME OF PROJECT: DESIGN AUTOMATIC VEHICLE TOLL SYSTEM THROUGH SCANNING QR CODE USING CAMERA II ASSIGNMENT Original data - Automatic road toll collection without stopping is very popular in the world, many countries in the region with similar transport and social infrastructure to Vietnam (such as Malaysia, Indonesia, the Philippines) have implemented it before The volume of implementation and the content of the topic - Study and learn C# language, sensor, Arduino - Learn and research applied models for solving current recognition-related problems - Create a model of a whole application system - Write a report III DATE OF RECEIVING TASK: IV DATE OF TASK COMPLETION: V ADVISOR: Nguyen Thanh Nghia, M.Eng CHAIR OF THE PROGRAM (Sign with full name) ADVISOR (Sign with full name) Nguyễn Thanh Nghĩa i vii HCMC University of Technology and Education Socialist Republic of Vietnam Faculty for High Quality training Independence - Liberty – Happiness Ho Chi Minh City, July 29th, 2022 PROJECT IMPLEMENT SCHEDULE Name of Members: Pham Viet Anh Student ID: 17141001 Nguyen Dang Khoa Student ID: 17141013 Class: 17141CLA Name of project: Design of an automatic fare collection system for buses based on RFIF technology Week/Date 1st (11/03-18/03) 2nd (19/03-26/03) 3rd (27/03-03/04) 4th (04/04-11/04) 5th (12/04-19/4) 6th (19/04-26/04) Content Lecture Confirm Meeting with instructor to discuss and choose the topic Write the detailed outline Design block diagram and explain the functions of each block Learn about QR code technology, Arduino UNO R3 and communication standards Learn about the principle of transmitting and receiving data between Arduino UNO R3 and infrared sensor LM393 Programming data transmission between Arduino UNO R3 and infrared sensor LM393 module vi th Complete schematic and layout of components on the circuit board (27/04-04/05) Calculate, consider and order components for the project’s model 8th Learning about programming language C# in application Visual Studio (05/05-12/05) 9th (13/5-20/5) 10th (21/05-28/05) 11th (29/05-05/06) 12th (06/06-13/06) 13th (14/06-21/06) 14th (22/06-29/06) 15th (30/06-07/07) Programming to create interface for system and transmitting information with the computer Learn about SQL Server and how to store into database information Implement the circuit board and construct the model Testing and fixing the model Write the report Send the report to instructor for review Prepare the report and slide PowerPoint to submit Advisor’s Confirmation Students Students Student Nguyễn Thanh Nghĩa vii 3.3.3 FLOWCHART Flowchart Explanation: If the input sensor detects an obstacle, the sensor will send a signal to the arduino, then the arduino will send a signal to the system, then the camera will start scanning the QR code and the system will receive the data of the QR code, then compare with available data in the database If the above comparison is compatible, the user information is displayed on the interface and the system will conduct a fee deduction form Next, the vehicle will pass through the output sensor, the output sensor will receive a signal sent to the system, at this time the information currently in the system will return to the default value 26 Figure 10 Flowchart of User Information Activity 27 Figure 11 Flowchart of Arduino The input sensor will light up when a vehicle passes by, and then the camera will immediately scan the vehicle's QR code If there is no vehicle passing, the signal light will not be on and the camera will not scan After the vehicle passes through the input sensor and scans the QR code, the vehicle continues to interact with the output sensor The output sensor signal will light up and the information will return to default 28 CHAPTER EXPERIMENT RESULTS 4.1 MODEL IMPLEMENTATION The general process of the system consists of three main parts: the user's QR code will be used to submit their information, including name, vehicle type, and corresponding amount, to the system; The QR code owner will see the information The remaining balance is displayed on the screen of the system when the QR code is scanned by the camera After being scanned, the system at the tollgate will process information such as fee deduction and top-up if the user's balance is not enough for the prescribed fee The system saves user information in an SQL database In addition, the system can also register new vehicle information and edit it if necessary The functionality of the product is divided into two main processes: the data collection procedure and the test procedure Figure Top view of node model Following with Figure 4.1, when the vehicle passes through the sensor marked 1, sensor will transmit a signal to the Arduino, then the signal will be transmitted to the processing system on the computer and panel will turn from red to green as shown in Figure 4.2 29 Figure Sensor detects the media and panel at the interface changes After the system receives a signal from sensor 1, the camera then begins to scan the QR code mounted on the vehicle If the data from that QR code is compatible with the data in the system's SQL database, the system will display the user's information and proceed to deduct the fee as shown on the screen, as shown in Figure 4.3 below Conversely, if the data of the QR code is not compatible with the SQL database, the system will not display the information Figure Camera scan QR and display information on screen The vehicle will continue to move to sensor when the system successfully conducts the deducting method If sensor detects a vehicle, panel on the screen changes from red to green At the same time, panel turns from green to red and the information of 30 the user who has just been paid will return to default for the system to continue processing for the next vehicle, as shown in Figure 4.4 below Figure 4 Sensor detects the media and panel at the interface changes 4.2 DATA COLLECTION PROCESS Data collecting process: The purpose of data collecting process is collecting the user’s data and then storage the information in database for the later use The data collecting process is split into parts: data submission, data storage, data display Users registering for the system will provide their vehicle information such as vehicle type, user name, and license plate number to the system to receive information and store it for display when it is processed Figure 4.2 shows the Interface of adding new vehicle 31 Figure Interface of adding new vehicle User information will be stored in the system's SQL database Figure 4.3 shows the SQL representation facility In addition, users can request to correct their media information if there are errors This is shown in Figure 4.4 Figure SQL database 32 Figure Interface of editing user information The data of the user, which the gateway received from the sender, is stored in string form Therefore, every time a new user comes in, the user needs to provide separate information such as username, license plate number, and vehicle type After that, the user will be given a separate QR code and sent to the SQL database for storage For vehicles that need to be recharged and have insufficient balance when scanning the QR code at the station, the system has a recharge interface for the cases mentioned above When the top-up interface is enabled, users need to put their QR code into the camera to scan for information, including: customer name, vehicle name, number plate, and remaining amount Users will provide the amount they want to top up 33 to the system manager When the payment is successful, the interface will display "Successfully deposited" Figure Top-up interface 4.2.1 DATA PROCESSING SYSTEM PROCESS We create the new QR code with a support tool called Qrcode-GEN, this QR code is encoded from short text, as described in Figure 4.6 below Figure Create QR code [14] 34 We use the QR code just created above, for the camera to scan in the new user interface When the camera at the interface scans the above QR code, it will receive the encrypted text and display it in the "QR Code" panel, as shown in Figure 4.7 Figure 10 Add new user After entering enough information about the new user, clicking the add button will display a successful add message and that information is saved to the database Figure 11 Main processing interface 35 In the main processing interface, when the camera scans the QR code, the encrypted data of the QR code will be displayed in the "Ma QR" box The system will take the data displayed in the "Ma QR" box to compare with the "Ma QR" data in the database, if they are match, the customer information will be displayed on the screen and the system will begin to process the toll collection Figure 12 Database 4.3 SYSTEM ASSESSMENT In general, the system operates smoothly and stably The time the camera scans the QR code is fast in a normal environment With a distance of 0.5m, the ideal scan time is 1-2 seconds Tables 4.1, 4.2, and 4.3 provide a comparison of the system when operated in three different light intensity environments (normal, low light, and high light intensity) Table 4.1 Performance results of the system when normal lighting conditions No Identification results Deduction system Distance True True Yes Yes 0.25m 0.5m AVG True True False 80% Yes Yes No 80% 0.75m 1m >1m According to Table 4.1, in normal lighting conditions, the camera scans the QR code stably and quickly with a distance of less than 1m 36 Table 4.2 Performance results of the system when high light intensity conditions No AVG Identification results False True False False False 20% Deduction system No Yes No No No 20% Distance 0.25m 0.5m 0.75m 1m >1m According to Table 4.2, under high light intensity conditions, the camera is very difficult to recognize QR code Table 4.3 Performance results of the system when lack of light conditions No AVG Identification results True True True False False 60% Deduction system Yes Yes Yes No No 60% Distance 0.25m 0.5m 0.75m 1m >1m According to Table 4.3, in low light conditions, the camera still works stably in recognizing QR code with appropriate distance 37 CHAPTER CONCLUSIONS AND RECOMMENDATIONS 5.1 CONCLUSIONS After the process of researching, understanding, building, and adjusting the "DESIGN AUTOMATIC VEHICLE TOLL SYSTEM THROUGH SCANNING QR CODE USING CAMERA" model of the group, it has operated relatively accurately and it has operated relatively accurately and meet the requirements Specifically, when the camera correctly recognizes the QR code, the system displays the user's information very quickly, almost immediately The system works smoothly in stable lighting conditions with any distance below 1.5 m The user interface is simple, easy to use and observe In addition, the actual installation cost is low and it is easy to install However, there are still some limitations in knowledge and equipment to be overcome to achieve optimal results The accuracy of the camera when scanning QR codes in low light and high light intensity is unstable 5.2 FUTURE WORK After completing the system and the implementation results in Chapter 4, we found the possibility of future development possible, so we proposed The studies that expand the functions and applications of the topic are as follows: - Adding the mobile app - The scanning ability of the camera in low light and high light is not absolutely stable, so it is necessary to design more roofs and lights to provide light 38 Reference [1] Directorate for roads of Vietnam, “Environmental pollution from traffic”, 13 September 2021 [2] “Programming Arduino: Getting Started with Sketches 2nd Edition”, Kindle Edition, June 29, 2016 [3] Công nghệ nhận dạng vô tuyến RFID(Nguyễn Văn Hiệp, ĐH Sư Phạm Kĩ Thuật TP.HCM) [4] “Arduino and Open Source Computer Hardware and Software”, Nikola Zlatanov, 2013-01-18 [5] Arduino for Dummies, John Nussey (May 28, 2013) [6] ZXing official resource page, http://code.google.com/p/zxing/, supported by Google Company, accessed on July 2012 [7] “What is a QR code? A guide to the barcode's basics, why you're seeing it everywhere, and how to scan one”, Ennica Jacob May 3, 2021 [8] “QR Code vs Barcode: Why the Difference Matters”, Sep 04, 2021 [9] ATmega328P [DATASHEET] [10] “What is an IR Sensor: Circuit Diagram & Its Working” Oct 12, 2020 [11] “Fact Sheet Logitech® HD Webcam C270” - Dec 14, 2020 [12] “Welcome to the Visual Studio IDE” - 04/30/2022 - TerryGLee [13] “MCSE 70-293: Planning Server Roles and Server Security” Martin Grasdal, Dr.Thomas W ShinderTechnical Editor, in MCSE (Exam 70-293) Study Guide, 2003 [14] ”QRCODE-GEN” - Ninecode JSC, https://qrcode-gen.com/ 39 S K L 0