Project mechatronics iot parking lot system

Self-spontaneous parking lot rise throughout the city because people''''s parking needs rise 7Abstract In recent years, large cities of Vietnam have implemented many measures to develop sta

FACULTY FOR HIGH QUALITY TRAINING

PROJECT OF MECHATRONIC SYSTEM

IOT PARKING LOT SYSTEM

NGUYEN DUY KHANH

Major: MECHATRONICS ENGINEERINGAdvisor: BUI HA DUC, PhD.

Ho Chi Minh City, December 2021

Abstract1

3.5.2 Algorithm model for license plate recognition33

Figure 1.2 The vacant lands become temporary parking, significantly affecting urban beauty.3

Figure 1.0.5 The penetration rate of “smart” parking spaces in the public domain reached 11% in 2018

Figure 2.0.1 Self-spontaneous parking lot rise throughout the city because people's parking needs rise 7

Abstract

In recent years, large cities of Vietnam have implemented many measures to develop static traffic in urban areas However, plans to overcome the lack of parking lots have not yet promoted efficiency Therefore, application of IoT for parking lots is completely necessary, when traditional parking lots cannot meet the increasing demand for vehicles today In addition, It is also impossible not to mention the remarkable role of IoT This is a network connecting devices together, in which devices can transmit information and data with each other without human intervention Moreover, we apply machine vision in identifying vehicle license plates and available places, then transfer data to our website to be able to easily control and help customers to capture the status of the parking lot Besides, we also encountered many difficulties in the idea and deploying a smart parking lot First, it can be mentioned as the process of collecting data on license plates so that the system can learn and identify Vietnam's license plate Second, it is a challenge for us to design a website and send data to it, as we take a lot of time to be able to build a website and transmit data as well as information up completely Finally, the system is almost complete when it is possible to identify and analyze the number of license plates, count the remaining space up to 90% and transfer data to the website correctly.

1.1 Introduction 1.1.1 Problems in Vietnam

In metropolises, the large population entails that the moving needs of the people increases and also directly increase individual vehicles City managers should solve some issues about flow traffic so that minimizes traffic jams in peak hours, building additional infrastructure such as highways, undergrounds, expanding additional routes to meet the density of vehicles, and developing a lot of parking lots to serve the demand for residents For instance, in some large cities of our country today, like Ho Chi Minh City, finding a parking lot in the city center is very difficult, because the car traffic daily in the city is always bigger a lot compared to the number of built-in parking lots So users are difficult to find parking lot to send their vehicles.

Figure 1.0.1 Traffic congestion in metropolises on peak hours

Not only that, the lack of measures to develop static traffic in the city has contributed to slowing the progress of building new parking lot Besides, plans to overcome the lack of parking lots have not yet been effective because investors have not seen their potential Currently, the condition of parking lot is gradually becoming a problem in big cities in our country on Tet holidays and as usual days Meanwhile, there are also a lot of spontaneous parking lots with the aim of profit from people's car deposits but does not guarantee security, quality management and especially taking ticket prices very expensive, making many parts of people dissatisfied So it can be seen that the demand for smart and safe parking at the moment is currently extremely large.

Spontaneous parking lots have lost the aesthetics of the urban area without meeting safety and convenience So we believe that the development of smart parking lot is an urgent need for our current situation.

1.1.2 Suitable solutions for current parking lot status in our countryManual counting

In order to resolve that need, namely increasing the interaction between car owners and owners of parking, IoT parking lot was established to help customers can capture the situation of the parking lot anywhere With current situation, the car owner when it comes to a place, it will be very difficult to find a available place, because they won't know the parking lots around them or not, so updating the parking lot status up to the websites are extremely necessary, that helps the car owner quickly reach where they want to minimize the time on the road, causing traffic jams just because they search for a place to send a car To do this, there are many common ways to do today that can be listed as The manual counting method, the owner of the parking lot will hire people who are consecutively counting the parking lot in about 30-60 minutes and updating parking lot status on their website This manual count is also quite main the corpses for small parking lots and in the beautiful weather conditions, or the day of less cars We believe that the countless space with bare eyes is often very time consuming, and cannot be exactly if we increase the project scale to dozens of hectares of land It is very difficult for employees to manage it all.

Another method is also used for a long time that is use ultrasonic sensors This is a method that is usually applied in parking car in commercial centers or high-rise apartments The convenience point this way is to reduce labor costs, supervise 24/7 activities without the need for intervention, adjustation of people, vehicle directions to the desired parking area during low hours points to save electricity and management, favorable for maintenance, and repair of equipment in the parking lot if necessary, absolute security system, anti-data loss The downside of the use of sensor systems that we can list, which are not suitable for large-sized car beaches, because it cost a lot of money for sensors to set in a large land.

Figure 1.0.3 Using ultrasonic control sensors in parking lot

Image processing technique

As for our IoT parking lot, technology we use in this project, it is a image processing combined with the data transfer method on our website We suppose this is an effective solution for medium and big parking lots, as it can solve the problems that traditional cars are encountered, while minimizing installation costs as well as appropriate With more terrain than installing sensor system.

Figure 1.0.4 Detect occupancy by image processing

1.1.3 IoT Parking Lot Demand

The IoT parking lot devices are connected to a raspberry that receive control signals from cameras, sensors, or a website Cameras received the signal and information about license plates and places then Raspberry transmitted to the website to store, so the owner can manage its customer information from a long distance.

Especially for big cities, parking problems are difficult to solve effectively By 2023, market spending for smart parking products and services was expected to grow with a CAGR 14% and exceed 3.8 billion dollars under the IoT Analytics report Thanks to growth of market spending, it forced everyone to act to find a specific solution to overcome the problem instead of holding traditional models.

Figure 1.0.5 The penetration rate of “smart” parking spaces in the public domain reached 11% in 2018 and is expected to reach 16% by 2023

Many people believe that the IoT parking lot system does not guarantee enough trust of safety Specifically, in order to operate this system, cutting the human resources is obvious, so people will think that there is a lack of people who look after their property Not only that, they also believe that the device they are monitoring will not be equal to humans However, despite cutting down human resources, we believe that the IoT Parking Lot System still ensures the ability to protect users' properties IoT technology allows devices to connect with each other and send data to the website, which allows the supervisor to manage the parking lot from a long distance Not only that, using both physical cards and license plates will be a huge obstacle for the crook to aim at our car park.

Another problem, many businesses are still hesitating in replacing traditional parking lots with smart parking lots because they think no matter whether to reduce labor, they still have to pay a not small amount of expense in maintaining the IoT parking lot This is indeed not wrong, but if we look at the parking needs of our country, it will notice the potential of the IoT parking lot system Indeed, the IoT parking lot system will solve most previous problems of traditional car parks, while increasing performance as well as being convenient, comfortable for customers every time they come here This is the goal we targeted.

1.3 Project Goal

In this project, we want to create an IoT parking lot system prototype with all the necessary functions without consuming too much money to prove that an IoT parking lot is a reasonable parking solution for metropolises In order to resolve the issues that traditional parking lot is encountered and at the same time increasing customer experience when using this service We build a website to receive data that cameras and sensors transmit to manage our car parking as well as combine those devices and let them operate automatically to somewhen there are any employees looking after the park, the parking lot are able to still operate normally Therefore, customers can track the situation of parking lot at anywhere to be able to easily make their decisions easily.

2.1 Demand for parking lot in Vietnam

Realizing the reality of many shortcomings in car parking in Ho Chi Minh City Our team has launched smart parking lot system Thus product are highly appreciated for safety for users while saving time and employee costs According to the statistics of Ho Chi Minh City Police, the average in the city occurred 50-100 of motorbike losses in which the hospitals, supermarkets, commercial centers, markets, etc accounting for 30% The main reason is because the crook used a fake ticket, the number plate or the car holder lost the ticket The idea of the parking system was born from there With high security, our team decided to apply this model as the topic for our project We will provide the actual data to persuade investors, potential partners or readers as your business will attract many customers in a growing business and can guarantee sales out defy competition This is one of the most important parts of the business plan, including considering the size of the current market and market development trends Many the next part of the business plan as the production part , Marketing and the total capital you need, will be based on the forecast about sales mentioned in this section Here are the parts that we want to mention in product market analysis

Figure 2.0.1 Self-spontaneous parking lot rise throughout the city because people's parking needs rise

As we have seen, the needs of the customer are endless but the ability to respond to is finite, so it is necessary to focus on the current urgent needs of our customers Therefore, our team has focused on finding out save the needs of customers about products that we

want to introduce to customers, a project that feasibility is quite high, meeting the need for the current urgent level The traffic jam is always a hot topic, there are many channels such as press, radio, television posting this issue, and has a channel specializing in providing information about traffic spots in the area The city to inform every people, the car flow moves too much on the streets is a lot that the capacity of the current streets is limited so the occurrence of the parking points is article weak to reduce traffic jams, but due to the amount of vehicles too much, the current parking points have not really responded to the requirements that customers want, the reason is:

● Safety levels of the above car parking points are not safe and secure

● Serving attitudes of car senders to non-delicate customers, as well as professional levels

● Vehicle sending time makes customers uncomfortable because they have to wait until a long time for their turn

● Customers take a long time to go to nearby parking lot because they cannot know their current status.

2.2 Global smart parking systems market size

The global smart parking market was valued at $ 6.05 billion in 2019 and is expected to reach $ 11.13 billion in 2027, reaching the CAGR speed of 12.6%.

Smart parking system market is based on hardware, software, services, types and applications According to the smart hardware parking system are segmented into (Pucks, Camera & Lprs, smart, meters, signs, parking ports), according to software (parking guide systems, analytical solutions ) According to the service (consulting services, technical services), by type (off-street, on-street), by application (security & supervision, intelligent payment system, electronic parking , Identify number plates) .In 2020, segment of parking guidelines and accounting for nearly 75.0% of total revenue These systems have become popular in the market because they support drivers to save time by providing information about free space, parking guides, available space and time available These systems ensure a better driving experience for drivers by tracking the status of many ultrasonic sensors and electrical signals and providing user-friendly graphical interface.

Figure 2.0.2 Global parking system market size predicted

2.3 Available technologies used in smart parking lot2.3.1 Image processing technique

Gaussian filter

The Gaussian filter is said to be the most useful filter, implemented by convolutionalizing the input image with a Gaussian filter matrix and then adding them together to form the output image.

The general idea is that the value of each pixel will depend more on the nearby pixels than on the distant pixels The weight of the dependence is taken according to the Gaussian function (also used in the normal distribution).

Figure 2.0.3 Gaussian filter matrix representation

Assume the image is one-dimensional The pixel in the center will have the greatest weight The pixels further away from the center will have a decreasing weight as the distance from them to the center point increases Thus, the closer the point is to the center, the more it will contribute to the central point value.

Figure 2.0.4 Image filter formula based on 2-dimensional Gaussian function (horizontal and vertical)

Bilateral filter

Bilateral filter is a highly effective filter in removing noise while preserving the contours (edges) in the image.

The Bilateral filter also uses a Gaussian filter with the distance to the center point, ensuring that only nearby points participate in the value of the central pixel However, it uses an additional Gaussian function for the gray level, ensuring that only pixels with a gray level similar to the central pixel participate in the smoothing process Therefore, the Bilateral filter preserves the edges in the image because the pixel at the edge has a very obvious change in gray level.

Furthermore, instead of operating on color channels separately like mean filter or Gauss filter, Bilateral filter can perform purposeful color measurement in CIE-Lab color space, smoothing color and preserve the edges in a way that is more suitable for human perception.

Figure 2.0.5 Photos before and after the Bilateral filter

Canny Edge Detector

Canny edge detects the edge intensity and direction by calculating the gradient of the image using edge detection operators Edges correspond to a change of pixels' intensity To detect it, the easiest way is to apply filters that highlight this intensity change in both directions: horizontal (x) and vertical (y)

Perform a Gaussian blur on the image The blur removes some of the noise before further processing the image Non maximum suppression works by finding the pixel with the maximum value in an edge In the above image, it occurs when pixel q has an intensity that is larger than both p and r where pixels p and r are the pixels in the gradient direction of q If this condition is true, then we keep the pixel, otherwise we set the pixel to zero (make it a black pixel).

Double thresholding sets two thresholds, a high and a low threshold, normalized all the values such that they will only range from 0 to 1 Pixels with a high value are most likely to be edges It helps to choose a threshold ratio instead of a specific value and multiple that by the max pixel value in the image.

Figure 2.0.6 Color image of rear car

Tesseract is an OCR (Optical Character Recognition) leading engine today This tool is distributed with the Apache 2.0 open-source license It supports character recognition on image files and outputs as plain text, html, pdf, tsv, invisible-text-only pdf The user can use it directly or the programmer can use the functions through the API.

Currently, Tesseract has developed to version 3.0x and can work on 3 popular operating systems: Window, Mac and Linux This tool supports character recognition of more than 100 different languages, including Vietnamese Not only that, we can train the program to use Tesseract to be able to recognize a certain language.

The request recognition system must first be trained with patterns of specific characters Intelligent systems with high recognition accuracy for most fonts are now commonplace Some systems are also capable of reconstructing the document's formatting close to the original, including: images, columns, tables, and non-text elements Currently, with Vietnamese characters, word recognition software capable of directly identifying documents scanned through scanners is no longer stored as an intermediate image file Document pages can be scanned and stored as multi-page files The results are stored in the format of Microsoft Word, Excel to serve the needs of data digitization well.

Figure 2.0.7 Tesseract OCR text localization and detection

2.3.2 RFID TechiniqueDefinition:

RFID stands for Radio Frequency Identification (radio frequency recognition) It is a remote radio recognition technique, allowing data on a chip to be read "do not expose" through the radio wave path at a distance from 50 cm to 10 meters, depending on the type of RFID label card.

Service users will be provided with a magnetic card This type of card contains ICs with identity information about a product, animal or person to identify and track radio waves In the parking lot, the magnetic cards will be connected to the car sending information and that means your information are managed better Basically, magnetic cards like a ID car owners and vehicles Information on this card is unique Each RFID card will have a

different frequency range.

The basic RFID device includes an antenna or a coil, a transceiver (accompanied by the decoder) and a RF card When operating, RFID antenna will have a radio signaling function to activate tags and read data related to vehicles RFID antenna will be mounted on the transceiver or decoder.

It acts as a signal reader/scanner When a card passes through the electromagnetic area due to the antenna generate, the information on the card will be read and decoded.

Figure 2.0.8 Basic working of RFID implemented in parking lot system

How IoT parking lot system use RFID technique ?

Parking lot management system using RFID technology includes RFID device set, computer has installed car parking management software, camera recorded images in the parking lot Operation of this system is as follows:

When the car through the lane on the parking lot, they will swipe the card at the RF card reader installed outside the gate of the parking lot, while the camera is mounted in this lanes will record the sea images vehicle number Similarly, when taking the car from the parking, guests also need to scan a card at the reader If the information on two card scans

is similar, the car will be taken out of the yard.

The highlight of this system is the security of guest's information as well as vehicles, limiting the maximum loss during the parking process This is the reason that automatic parking lots have no employees taking care but still much safer than traditional car parks.

Figure 2.0.9 Using a lot of devices combining with RFID

3.1.2 Connection

First, the automatic parking system recognizes the license plate at the entrance when the car arrives at a specific location The software analyzes license plate data through image refinement techniques, image noise filters, and image processing algorithms to obtain accurate information about each letter and number on the license plate The data is saved in the database and open the entry barrier At that time, the cameras are installed in the parking lot allows the driver to check the percentage of cars in the parking lot and the number of parking spaces, and clearly identify each parking space These cameras provide images of the parking lot and analyze from these images, and then it uses a Cascade to classify each parking space as if it is occupied by car or not Cascade classify need to be trained in the parking lot to improve accuracy even in dark, bright places and obstacles in front of the camera When the vehicle is leaving, the software processes using the information updated at the time of entry and the image captured when the vehicle is at the exit gate If the input and output data match, the system will automatically check and open the barrier The system is constantly updated on the website so that parking lot owners can manage all activities and conditions of the parking lot.

3.3 Components3.3.1 Raspberry Pi 4Definition:

In this project, we use raspberry pi 4 like a microprocessor to receive signals from devices and control them Raspberry PI is a very compact computer, and it is run by Linux operating systems Raspberry PI was developed by Raspberry Pi Foundation, a non-profit organization We can use Raspberry Pi as a computer because it has integrated everything needed Its SOC Broadcom processor BCM2835 includes CPU, GPU, RAM, microSD card slot, Wi-Fi, Bluetooth and 4 USB 2.0 ports.

Figure 3.2 Raspberry pi 4

With Raspberry Pi, we just need to install the operating system, the mouse, keyboard and screen that can be used as a computer Raspberry PI is not fully replaced by a desktop or laptop but it is a flexible device that can be used for electronic systems, computational system settings, DIY projects, etc, with low expenses.

Specification:

● Broadcom BCM2711, Quad core Cortex-A72 (ARM v8) 64-bit SoC @ 1.5GHz ● 2GB, 4GB or 8GB LPDDR4-3200 SDRAM (depending on model)

● 2.4 GHz and 5.0 GHz IEEE 803.31ac wireless, Bluetooth 5.0, BLE ● Gigabit Ethernet

● 2 USB 3.0 ports; 2 USB 2.0 ports.

● Raspberry Pi standard 40 pin GPIO header (fully backwards compatible with previous boards)

● 2 × micro-HDMI ports (up to 4kp60 supported) ● 2-lane MIPI DSI display port

● 2-lane MIPI CSI camera port

● 4-pole stereo audio and composite video port

● H.265 (4kp60 decode), H264 (1080p60 decode, 1080p30 encode) ● OpenGL ES 3.1, Vulkan 1.0

● Micro-SD card slot for loading operating system and data storage ● 5V DC via USB-C connector (minimum 3A*)

● 5V DC via GPIO header (minimum 3A*)

● Power over Ethernet (PoE) enabled (requires separate PoE HAT) ● Operating temperature: 0 – 50 degrees C ambient

3.1.2 RFID Card Definition:

RFID (Radio Frequency Identification) is a technology that uses a radio wave connection to automatically identify and track identification tags attached to the object This

technology does not use light rays like barcodes or direct contact In other words, RFID can replace barcodes on products sold at retail supermarkets Instead of having to put the device to the barcode to scan, RFID allows information that can be passed through small distances without a physical contact So, all of the benefits above, we recognize this technology is really appropriate with our project.

Application:

In recent decades, the theory of RFID technology has been enriched and improved, and RFID tags have been developed rapidly, including active, passive, and semi-passive tags RFID tags are also used more and more widely In the civil aspect, RFID are used in some main fields like Identification, Access Control, Tracking, Anti-counterfeiting, Management, or Counting.

Figure 3.3 The applications of RFID

In this project, we develop RFID technology as a means for us to manage our car parking in the most professional and effective way

3.3.3 Module RFID RC522Definition:

RFID RF522 module is a reader by using MFRC522 chip, which accepts the ID code from the RFID card then sends the ID code to Raspberry It is usually accompanied by an RFID tag in a credit card format and an RFID tag in a keychain format The cards can have 1K or 4K memory divided into sectors and blocks The RFID reader module RC522 is also used to write RFID tags To read the information encoded on a tag, it is placed in close proximity to the Reader (does not need to be within direct line-of-sight of the reader) A Reader generates an electromagnetic field which causes electrons to move through the tag’s antenna and subsequently power the chip.

Figure 3.4 The RC522 RFID Reader module

● RST: it is a pin to turn the module on and off As long as the pin is in the LOW state it will stay off with little consumption When the state changes to HIGH the RC522 restarts.

● IRQ: interrupt pin that alerts the microcontroller when an RFID tag approaches the RFID reader RC522.

● MISO / SCL / TX: This pin has three functions When the SPI interface is enabled, it functions as slave output and master input

● MOSI: entry in the SPI interface ● SCK: clock signal of the SPI interface.

● SS / SDA / RX: The pin acts as a signal input when the SPI interface is enabled.

3.3.4 16x02 LCD Display ModuleDefinition:

LCD 1602 is a liquid crystal display This component is a kind of dot matrix module It is used to show letters, numbers, and characters, etc It's composed of 5x7 or 5x11 dot matrix positions, with each position can display one character we input LCD 1602 can separate characters and lines by a dot pitch between two characters and a space between lines The meaning number of the LCD can show 2 rows with 16 characters in each row.

Figure 3.6 16x02 LCD pinout

Pinout Configuration:

● Vss (Ground): Ground pin connected to system ground

● Vdd (+5 Volt): Powers the LCD with +5V (4.7V – 5.3V)

● VE (Contrast V): Decides the contrast level of display Grounded to get maximum contrast.

● Register Select: Connected to Microcontroller to shift between command/data

● Read/Write: Used to read or write data Normally grounded to write data to LCD

● Enable: Connected to Microcontroller Pin and toggled between 1 and 0 for data acknowledgement.

● LED Positive: Backlight LED pin positive terminal

● LED Negative: Backlight LED pin negative terminal

● Data pins: Data pins 0 to 7 form a 8-bit data line They can be connected to Microcontroller to send 8-bit data These LCD’s can also operate on 4-bit mode in such cases Data pins 4,5,6 and 7 will be left free.

Specification:

● Operating Voltage is 4.7V to 5.3V

● Current consumption is 1mA without backlight

● Alphanumeric LCD display module, meaning can display alphabets and numbers

● Consists of two rows and each row can print 16 characters.

● Each character is build by a 5×8 pixel box

● Can work on both 8-bit and 4-bit mode

● It can also display any custom generated characters

● Available in Green and Blue Backlight

At present, LCDs are used frequently in CD/DVD players, digital watches, computers, etc It is also used in many electronic projects and devices to display messages In screen industries, LCDs have replaced the CRTs (Cathode Ray Tubes) because these displays use more power as compared to LCD, heavier & larger

In this project, we use LCD 16x02 for the purpose of displaying available space in the parking lot, and also showing "Full Slot" when the parking lot has no space available.

3.3.5 I2C ModuleDefinition:

I2C is a simple method of communication that combines the best features of SPI and