Helmet Detection on Two-wheeler riders using Machine Learning PDF

Preview

Summary

Report for Helmet detection and Number plate extraction for bike riders without wearing helmets....

Description

A PROJECT DESIGN REPORT ON

“Helmet Detection on Two-wheeler riders using Machine Learning” Bachelor of Engineering In Information Technology Punyashlok Ahilyadevi Holkar Solapur University By Name

Roll No

Pramod Paratabadi

18

E-mail [email protected]

Under Guidance Of Mrs. Manisha A. Nirgude

DEPARTMENT OF INFORMATION TECHNOLOGY WALCHAND INSTITUE OF TECHNOLOGY SOLAPUR - 413006 (2019-2020)

Seat No. 622683

CERTIFICATE This is to certify that the Project entitled

“Helmet Detection on Two-wheeler riders using Machine Learning” is Submitted by

Name

Roll No

Pramod Paratabadi

18

E-mail [email protected]

as a part of Project Design Report. Studying in BE IT

(Mrs. Manisha A .Nirgude) Project Guide Dept of Information Technology

(Dr.L.M.R.J Lobo) Head

(Dr. S .A. Halkude) Principal DEPARTMENT OF INFORMATION TECHNOLOGY WALCHAND INSTITUE OF TECHNOLOGY SOLAPUR - 413006 (2019-2020)

Seat No. 622683

INDEX 1. 2. 3. 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 time 4. 5. 5.1 5.2 5.3 5.4 5.5 6. 6.1 6.2 6.3 6.4 6.5 6.6 7. 7.1 7.2 8. 8.1 8.2 8.3 8.4 8.5 8.6

Abstract Introduction Literature Review Machine Vision Techniques for Motorcycle Safety Helmet Detection Smart Helmet Using GSM and GPS Technology SMART HELMET– A Review Paper Literature Survey On Image Filtering Techniques Digital Image Processing Techniques in Character Recognition of Indian Languages Limitations and challenges in Existing Systems Automatic detection of motorcyclists without the helmet Motorcycle Detection and Tracking System with Occlusion Segmentation Automatic Detection of Bike-riders without Helmet using Surveillance Videos in RealExisting System Proposed Methodology Flowchart of the proposed methodology Moving object detection Vehicle classification Helmet detection License plate extraction Machine Learning Approaches Random Forest Gradient Boosted Trees Support Vector Machine Deep Neural Networks TensorFlow OpenCV Platform Requirement Software Requirement Hardware Requirement UML Diagrams System Architecture Use Case Diagram Component Diagram State Chart Diagram Activity Diagram Deployment Diagram

Abstract Now-a-days two wheelers is the most preferred mode of transport. It is highly desirable for bike riders to use helmet, but wearing helmets is often neglected by riders worldwide leading to accidents and deaths. To address this issue, most countries have laws which mandate the use of helmets for two-wheeler riders. In addition to the law, there is a significant proportion of the police force that discourages this behavior by issuing a traffic violation ticket. As of now, this process is manual and tedious. The proposed system is to solve this problem by automating the process of detecting the riders who are riding without helmets. Furthermore, the system also extracts the license plate, in extraction of license plate algorithm has five parts: image procurement, preliminary processing, fringe detection and segmentation, feature extraction and recognition of character number plates using suitable machine learning algorithms so that it could be used to issue traffic violation tickets. The system implements machine learning and image processing techniques to detect riders, riding twowheelers, who are not wearing helmets. The system takes a video of traffic on public roads as the input and detects moving objects in the scene. A machine learning classifier is applied to the moving object to identify if the moving object is a two-wheeler. The license plate is provided as the output in case the rider is not wearing a helmet.

Introduction According to transport ministry[1], in 2016 about 28 two wheeler riders die daily because of not wearing helmet. In 2017, 31 out of 100 people died in road accidents which shows increased rate from 21.6death per 100 accidents in 2005. Each year there are 1.4 million Traumatic Brain Injuries (TBI’s) in INDIA. About $76.5 billion dollars is spent in treatment related to these injuries. More than 50,000 individuals die from TBI. The proposed system aims to provide complete safety for bike riders. Recently helmets have been made compulsory, but still, people drive without helmets. The amount of deaths has been rising each year, especially in developing countries. Therefore, keeping public safety in mind, there needs to be a mechanism for automatic helmet detection which can extract the number plates of those who don’t wear helmets on roads. This sort of automation will help the administration to issue helmet violation tickets more efficiently and ultimately aims to inhibit the violation by two-wheeler riders.

The database consists of images of motorcycles. Existing techniques only deal with vehicle in fixed view. However, in video, rotation is occurred and it decreases the performance of recognition. Proposed approach where image will be stored in the form of matrix and the output will be displayed in the form of detected numbers. The overall work will be used for Sobel Fringe detection technique.

Two-wheeler[2] is a very popular mode of transportation in almost every country. Observing the usefulness of helmet, Governments have made it a punishable offense to ride a bike without helmet and have adopted manual strategies to catch the violators. However, the existing video surveillance based methods are passive and require significant human assistance. In general, such systems are infeasible due to involvement of humans, whose efficiency decreases over long duration.

Automation of this process is highly desirable for reliable and robust monitoring of these violations as well as it also significantly reduces the amount of human resources needed[3]. Also, many countries are adopting systems involving surveillance cameras at public places. So, the solution for detecting violators using the existing infrastructure is also cost-effective.

However, in order to adopt such automatic solutions certain challenges need to be addressed: 1) Real-time Implementation: Processing significant amount of information in a time constraint manner is a challenging task. As such applications involve tasks like segmentation, feature extraction, classification and tracking, in which a significant amount of information need to be processed in short duration to achieve the goal of real-time implementation.[4]

2) Occlusion: In real life scenarios, the dynamic objects usually occlude each other due to which object of interest may only be partially visible. Segmentation and classification become difficult for these partially visible objects[5].

3) Direction of Motion: 3-dimensional objects in general have different appearance from different angles. It is well known that accuracy of classifiers depends on features used which in turn depends on angle to some extent. A reasonable example is to consider appearance of a bikerider from front view and side view.

4) Temporal Changes in Conditions: Over time, there are many changes in environment conditions such as illumination, shadows, etc. There may be subtle or immediate changes which increase complexity of tasks like background modelling[6].

5) Quality of Video Feed: Generally, CCTV cameras capture low resolution video. Also, conditions such as low light, bad weather complicate it further. Due to such limitations, tasks such as segmentation, classification and tracking become even more difficult. As stated in, successful framework for surveillance application should have useful properties such as real-time performance, fine tuning, robust to sudden changes and predictive. Keeping these challenges and desired properties in mind, we propose a method for automatic detection of bike-riders without helmet using feed from existing security cameras, which works in real time[7].

Literature Review 1.

Machine Vision Techniques for Motorcycle Safety Helmet Detection

This paper presents a system which automatically detects motorcycle riders and determines that they are wearing safety helmets or not. The system extracts moving objects and classifies them as a motorcycle or other moving objects based on features extracted from their region properties using K-Nearest Neighbour / (KNN) classifier. The heads of the riders on the recognized motorcycle are then counted and segmented based on projection profiling. The system classifies the head as wearing a helmet or not using KNN based on features derived from 4 sections of the segmented head region.Experiment results show an average correct detection rate for near lane, far lane, and both lanes as 84%, 68%, and 74%, respectively[8].

2.

Smart Helmet Using GSM and GPS Technology

In this, Author has discussed safety and security of the bikers against road accident. Smart helmet has special idea which makes motorcycle driving safety than before, this is implemented using GSM and GPs technology. Other advantages of this project is to measure the alcohol level of the drunken people who is riding the bike. Whenever the alcohol level crosses the predefined value, the alarm starts and get notification about the drunken driver. The author have also discussed about the accident detector and the sensor will active the GPS and find the location and further SMS will send to ambulance or family members.[9]

3.

SMART HELMET– A Review Paper:

According to the recent Research paper in 2016 titled ‘2 Helmet using GSM and GPS technology for accident detection and reporting system’, The author specially developed this project to improve the safety of the bikers. The objective of this project is to study and understand the concept of RF transmitter and RF receiver circuit. The project uses ARM7, GSM and GPS module. The project also uses buzzer for indication purpose. Whenever the accident will occur then accident spot will be note down and information will send out on the registered mobile number. The major disadvantage of this project is they are not using any display device for showing the current status. Also the cost of helmet is still high since helmet is designed for only one purpose. According to the Research paper in 2015 titled ‘Microcontroller based smart wear for driver safety’, In this paper author has discussed on the speed of the vehicle. In this application the project will be monitoring the areas in which the vehicle will be passing. On entering any cautionary areas like schools, hospitals, etc the speed of the vehicle will be controlled to a predefined limit. LCD is used for showing the various types of

messages after wearing the helmet. The author has worked only on the phenomenon of accident which is generally happens due to drunk and drive. But as we know that the accident in the area is not happens only due to consuming alcohol but also other parameters like speed are also responsible[9].

4.

Literature Survey On Image Filtering Techniques

Image processing has become a common technique for making images more comprehensible to the human eye. Images acquired are found to be corrupted with noise in many cases. There are many methods available to remove impulse noise in gray scale and color images. But very little has been done for the removal of additive noise in color images. Of the many filters presented, most of them are only for gray scale images. The filtering techniques developed for gray scale images can be extended to color images by applying it to the different color components separately but it is also evident that they can partially destroy image details. The existing systems includes Conservative Smoothing, linear filters, non-linear filters like median filter and fuzzy filter, adaptive filter, wavelet based filter etc. These techniques have a number of advantages and also disadvantages[3].

5. Digital Image Processing Techniques in Character Recognition of Indian Languages. This paper presents a brief overview of digital image processing techniques such as Feature Extraction, Image Restoration and Image Enhancement. A brief history of OCR and various approaches to character recognition is also discussed in this paper. Handwritten character recognition is always a frontier area of research in the field of pattern recognition. There is a large demand for OCR on hand written documents in Image processing. Even though, sufficient studies have performed in foreign scripts like Arabic, Chinese and Japanese, only a very few work can be traced for handwritten character recognition mainly for the south Indian scripts. OCR system development for Indian script has many application areas like preserving manuscripts and ancient literatures written in different Indian scripts and making digital libraries for the documents. Feature extraction and classification are essential steps of character recognition process affecting the overall accuracy of the recognition system[10].

6.

Limitations and challenges in Existing Systems:

Bikers do not wear helmets in the region where traffic checking is not done. There is a tendency of the driver to wear helmet only where the anticipate checking may takes place, they do not wear helmet where no checking is done. The vehicle may be turn on or may be stolen by passing the ignition switch.

Testing alcohol content present in blood in each individual rider in big countries like India is almost impossible. Accidents due phone calls as previous helmets do not contain Bluetooth speakers.

7.

Automatic detection of motorcyclists without the helmet.

This paper aims to explain and illustrate an automatic method for motorcycles detection and classification of public roads and a system for automatic detection of motorcyclists without the helmet. For this, a hybrid descriptor for features extraction is proposed based on Local Binary Pattern, Histograms of Oriented Gradients and the Hough Transform descriptors. Traffic images captured by cameras were used. The best result obtained from classification was an accuracy rate of 0.9767, and the best result obtained from the helmet, detection was an accuracy rate of 0.9423[4].

8.

Motorcycle Detection and Tracking System with Occlusion Segmentation.

The method uses the visual length, visual width. and Pixel Ratio to detect the classes of the motorcycle occlusions and segment the motorcycle from each occlusive class. Because the motorcycle riders must put on their helmets, the helmet detection or search method is used to make sure whether the helmet/motorcycle exits or not. Experiments obtained by using complex road scenes are reported, which demonstrate the validity of the method in terms of robustness, accuracy, and timely responses.

9. Automatic Detection of Bike-riders without Helmet using Surveillance Videos in Realtime. In this paper, we propose an approach for automatic detection of

bike-riders without helmet using

surveillance videos in real time. The proposed approach first detects bike riders from surveillance video using background subtraction and object segmentation. Then it determines whether bike-rider is using a helmet or not using visual features and binary classifier. Also, we present a consolidation approach for violation reporting which helps in improving the reliability of the proposed approach. In order to evaluate our approach, we have provided a performance comparison of three widely used feature representations namely histogram of oriented gradients (HOG), scale-invariant feature transform (SIFT), and local binary patterns (LBP) for classification[11].

Scope of Improvement: Any system always has a scope for improvements and more advancement. All the systems studied under the literature survey have their own different features. All the systems proposed till date are used only for sending message in case of accident. There could be such a system where only alcohol detection is present. Here in this system many advanced features are added and also the previous features are clubbed in a single system. It will send message automatically when rider met an accident with helmet on. RF transmitter and receiver are used for starting the two wheeler, if rider not wearing the helmet the bike will not get start. The alcohol sensor will sense the alcohol and it will lock the ignition if drunk. The solar sense is generating power for the system. It can tracked easily with location when bike is stolen.It can also use to receive call while driving through wireless Bluetooth Speakers.

Conclusion: Thus this system is very effective for the safety purpose of the user. User has to wear helmet to ride a bike and hence traffic rules will be followed by the rider. This system is under pocket control i.e. Riding the two wheeler vehicle having safety in hand and in budget. This system has easy functionalities. It provides a better security to the biker.

Existing System The system proposed isolates the bikes from the images by approximation crops the most probable area where helmet might be present and then feeds it to the feature abstraction and matching system. Automatic detection of bike-riders without helmet falls under broad category of anomaly detection in surveillance videos. As explained in, effective automatic surveillance system generally involve following tasks: environment modeling, detection, tracking and classification of moving objects. It uses circle arc detection method based on the Hough transform. The major limitation of this approach is that it tries to locate helmet in the full frame which is computationally expensive and also it may often confuse other similar shaped objects as helmet.

Proposed Methodology

1. Flowchart of the proposed methodology

2. Moving object detection: The first task in helmet identification is to detect a moving vehicle. It is the first step before performing more sophisticated functions such as tracking or categorization of vehicles. Rather than immediately processing the entire video, the example starts by obtaining an initial video frame in which the moving objects are segmented from the background. Processing only the initial few frames helps to take the steps required to process the video. The foreground detector needs a certain number of video frames to initialize the Gaussian mixture model. The foreground segmentation process is not perfect and often includes undesirable noise. Next, we will find bounding boxes of each connected component corresponding to a moving vehicle. Generally, more than one blob is detected apart from moving vehicles such as pedestrians, trees, dogs and other small noises. All the blobs that consist of less than n number of pixels are discarded (in our case n is 150 pixels). This way, we only remain with the moving vehicle. But there are a lot of gaps in the blob, that is, it is not one coherent blob. We use the morphological opening to remove the noise and to fill gaps in the detected objects

which makes the blob more coherent. Once the blob is found, the raw image is extracted that is hidden behind the blob. 3. Vehicle classification: The next step is to classify the moving vehicle extracted in the last part. To classify vehicle, we are going to use the number of machine learning algorithms, from classical machine learning algorithms to modern deep neural networks, to see which approach works best in vehicle classification with limited data. A vehicle can be classified into two categories two-wheelers or four-wheelers. We are only interested in two-wheelers Figure 1 since we want to detect the presence of a helmet. The system proceeds further only if a two-wheeler is detected. Else, it discards this vehicle and looks for other vehicles and the cycle continues. We will collect the training data required for the classification of a vehicle on our own. We will capture the images o...