Smart Mirror - its a synopsis of our project PDF

Preview

Summary

its a synopsis of our project...

Description

VISVESVARAYA TECHNOLOGICAL UNIVERSITY JnanaSangama, Belagavi – 590018

Synopsys Report on

“Home Automation Using Smart Mirror” Submitted in partial fulfillment of the requirement for the award of the degree of

BACHELOR OF ENGINEERING IN ELECTRONICS AND COMMUNICATION ENGINEERING Submitted by JAGADISH SAI VARMA CH

(1RR17EC056)

R NAVANEETH YADAV

(1RR17EC097)

MEGHANA K

(1RR17EC071)

HARSHITHA S

(1RR17EC052)

Under the guidance of

Prof. Ajay M Assistant Professor Dept. of ECE

DEPT. ELECTRONICS & COMMUNICATION ENGINEERING

RAJARAJESWARI COLLEGE OF ENGINEERING

[Accredited by NBA & NAAC, Affiliated to VTU, Belagvi, Approved by AICTE, New Delhi] #14, Ramohalli Cross, Mysore Road, Kumbalagodu, Bengaluru-74 2021-2022

Contents:  Abstract  Introduction  Block Diagram  Hardware and Software requirement  Advantages and Applications

 Expected Outcome 

References

1. ABSTRACT This project is aimed to perform home automation using Smart Mirror which is simple, accurate, time saving to consume multiple data at one place. The Smart mirror uses sensors and transmitters which are set to appliances and transmitted data is received to raspberry pi and displayed on Smart mirror. The smart mirror is controlled by using VUI. It provides functionalities such as the weather of the city, room temperature, Curtain Control, the latest updates of news and headlines, local time, Light brightness & Fan speed control all at a same place.

2. INTRODUCTION The world and everything around us are constantly changing. With the advancement of science and technology, we are moving towards a more automated lifestyle. We have smart cities, smart homes, smartphones, smart cars, and more. This fast way of life requires further development of home automation projects. home automation systems are mainly created using Internet of Things (IoT) devices. IoT is an integrated system of communicating devices in which each device can carry out tasks autonomously. Using IoT for home automation has many real-world applications, for example, we can build a smart home that will automatically close or open the windows based on the weather conditions outside or even turn the lights on and off in a particular room. This paper presents the implementation of a Smart Mirror using IoT with the help of a Raspberry Pi. • A Smart Mirror is capable of displaying the date, time, weather, and traffic conditions on its reflecting surface. These features will be obtained from the internet and implemented using the Raspberry Pi. A common approach to building a Smart Mirror is to use a sheet of two-way acrylic mirror, a monitor, a frame to hold the glass and monitor, and a web browser with JavaScript to provide the software features and drive the display. A web browser is still a necessary feature for providing and

displaying information, as it has built-in support for multiple media formats, such as text, images, and videos. The information presented can be made interactive with JavaScript and is customizable with Cascading Style Sheets (CSS). Our project is mainly focused on making data available at a common place which is easily accessible and controlled from a common point, which saves a lot of time. In this process a Smart mirror is used and it is capable of displaying the data as well as mirror. IOT acts as a base medium of the project and implemented using the Raspberry Pi. A common approach to building a Smart Mirror is to use a sheet of two-way acrylic mirror, a monitor, a frame to hold the glass and monitor, and a web browser with JavaScript to provide the software features and drive the display. Some sensor will be places on the devices which are mainly used for the automation process and these sensors updates their live status to the smart mirror. VUI is used for giving commands.

3. LITERATURE SURVEY

IoT Based Voice Controlled Raspberry PI Smart Mirror in IEEE paper was proposed in July 2021 by Sophia Jasmine G, Magdalin Mary D, Jaya Ghaanndth S V, Dhanush Kumar J.

This paper proposes a concept that the Alexa smart mirror provides a great ambient environment between users and the internet. This will help the users in their daily life activities. Also they have stated in this paper that Embedding Alexa VUI to smart mirror for better user interaction without help of smart phone. Some drawbacks are observed as Difficulty in making multiple schedules apparent to Others.

Smart Mirror Application with Raspberry Pi in IEEE paper was proposed in November 2017 by Fatma, Murat Can.

In this paper, we found the following features like display weather information, time and location, current event and user information on the mirror with the use of microcontrollers, raspberry pi, python and javascript by signal processing Drawbacks like only some can be controlled by voice commands was found without any security.

Smart Reflect: -A Modular Smart Mirror application platform in IEEE paper was proposed in October 2016 by Gold Derrick David This paper proposes a system about the smart mirror its modular and lightweight nature and The project is designed mainly on the ModelView-Controller (MVC) design pattern in which Model refers to the plugin, View is the screen that displays data and Controller is the server component that controls the execution of each. Design of Smart Mirror Based on Raspberry pi in IEEE paper was proposed in April 2018 by Yong Sun and Ke Dan. This paper states that the smart mirror is time, date, temperature, voice recognition, and weather information. In which different hardware's like low power CMOS real-time clock chip and SYN6288 Speech synthesis chip is used, which increases the overall cost of the mirror is the major drawback of the system. No security is provided for the system. A Mobile Programmable Smart Mirror for ambient IoT Environments in IEEE paper was proposed in October 2017 by Mohammad Ghazal, Tara Al, Yasmina Al Khalil, Mohammad, and Hassan. This paper proposes the concept of the smart mirror and its adaptability and security. The project is designed mainly on a Bluetooth module. The user has to connect his Bluetooth-enabled mobile device to the smart mirror to access it. The major drawback of this model is that the device is in continuous search of nearby Bluetooth-enabled devices which consumes more power. Users without mobile phones can't access the smart mirror.

IoT based Smart Mirror using Raspberry Pi in IEEE paper was proposed in 2018 IJERT by Lakshmi NM, MS P. This paper proposes all the basic features of a smart mirror-like display date and time, news, weather, etc. The additional feature included in this mirror is a thief detection module that is used to capture some malicious act in the house. To display the temperature DHT22 sensor is connected to GPIO pins of Raspberry Pi which is not necessary because the weather detection module has the same concept.

4. BLOCK DIAGRAM  From the block diagram given below, we can observe that Relay, PIR sensor, Fire detection sensor, Raspberry Pi, Temperature Sensor are used.  Here at first, we are connecting the Relay to the Fire detection sensor. And these both are further connected to Raspberry pi.  PIR sensor is also connected to Pi and along with temperature sensor input and output, then the output of the raspberry pi is connected to cloud and web protocol from where the output is displayed.

Figure 4.1: Architecture of Existing System Model

 The proposed smart mirror device aims at displaying the user’s image as well as providing customizable information. 

In the proposed design, a wall-mounted single-sided mercury-coated mirror will be used as it is capable of projecting user-relevant information such as current weather reports, local time, and date along with a voice assistant.

Figure 4.2: Block diagram of Raspberry Pi with Alexa Enabled

 When the device is booted, it verified the authenticated user or unauthorized person by using what kind of security is applied to the device such as biometric and facial recognition patterns.  It controls all the appliances state whether it is working or not working same like that the music system and many home appliances are controlled.  Gesture detection is used to sense and control the device and interact with the device without touching the device. All the information is stored in the database and sent an alert message to authorized users.  This will be able to suggest and motivate according to the user's facial emotion through image processing.  The device fitted with switches can also be able to control the lighting conditions and window blinds in the bathroom as required.

 All of this information from the sensors can be sent to the mirror application via a Wi-Fi module.  This smart mirror allows the user to monitor and control the entire home appliances and security system of the house.  The mirror will be connected to the sound system and we can able to control it through air gestures.  This mirror will be activated through image recognition along with a voice password.  Initially, the mirror appears as a normal ordinary mirror and the camera will be active, once the recognized the registered user then the biometric fingerprint of the user is requested, once the biometric authentication is passed then the user is navigated to the home screen.

5. HARDWARE AND SOFTWARE REQUIREMENT 5.1 Hardware Requirement

Sl No.

Description

Specification

Operating voltage

Quantity

1

Raspberry Pi – Series 4

Raspberry Pi standard 40 pins, GPIO header.

5V

1

2

Raspberry Pi camera Board v1.3

5MP OmniVision 1080p

3.3V

1

3

Servo Microcontroller

linear position and for specific velocity, and acceleration.

4.8V

2

4

LCD Monitor

27.9 x 15.7

12V

1

5

90 Degree HDMI cable

1.5 MTR L-Shaped rightangled 90-degree elbow

5V

1

6

Arduino Uno Rev3

Microcontroller

5V

2

7

Relay Module

5V

1

8

Temperature & Humidity

Automatic control circuit and to control a highcurrent using a low-current signal DHT 22

3-5V

1

5.2 Software Requirement - Raspberry Pi Raspbian - Alexa Speech Services

6. ADVANTAGES AND APPLICATIONS 6.1 ADVANTAGES    

It makes life easier. We have all the information that we need right in front of us. Collects the status from appliances and displays data when we see mirror. Appliances will be controlled with voice commands and errors will be notified prior with alarm.  Read the news at the same time from a convenient place.  It showcases Date/Time, current news highlights, home temperature, Water, Gas & other appliance status all at one place.

6.2 APPLICATIONS  Centralized air conditioning systems  Avoid Fire Accidents

 Notifies when Cooking Gas is empty  Controlling household appliances.

7. EXPECTED OUTCOME According to our assumption, we expect directly work together with the home assistant and sensors both of them to communicate with the Smart Mirror. Features such as control ambient lighting systems, centralized air conditioning systems, and other modular home automation systems/devices like Google Home) and additional applications and widgets can be implemented. 8. REFERENCES 1. Sophia Jasmine G, Magdalin Mary D, Jaya Ghaanndth S V, Dhanush Kumar J. “IoT Based Voice Controlled Raspberry PI Smart Mirror” IEEE Paper (1 July 2021) 2. Manan Mehta, “ESP 8266: A breakthrough in Wireless Sensor Networks and Internet of Things”, International Journal of Electronics and Communication Engineering & Technology (IJECET), 2015. 3. Daemin Shin, Vishal Sharma, Jiyoon Kim, Soonhyun Kwon, Ilsun You, "Secure and Efficient Protocol for Route distributed home automation software”, Proc. of IEEE 2015 ICCE–Berlin,2015 4. “Google Cloud Computing, Hosting Services & APIs |Google Cloud Platform.” [Online]. 5. M. Anwar Hossain. 2007. Smart mirror for ambient home environment. IET Conference Proceedings (January 2017). 6. Daemin Shin, Vishal Sharma, Jiyoon Kim, Soonhyun Kwon, Ilsun You, “Secure and efficient Protocol for Route distributed home automation software”, Proc. of IEEE 2015 ICCE–Berlin,2015

7. “Google Cloud Computing, Hosting Services & APIs Google Cloud Platform.” (August 2017)

8. Muhammad Asadullah, Ahsan Raza, “An Overview of Home Automation Systems”, Research gate publication, 2016 9. M. Tucic, R. Pavlovic, I. Papp and Dj. Saric, “Networking layer for unifying distributed smart home entities”, Proc of IEEE Telfor, 2014 10.M.Sekulic, I. Lazarevic, M.Bjelica and V. Pekovic, “Asynchronous application programming interface library for Hadoop”, Proc. of IEEE 2016 ICBDA, 2016.

Block diagram

Cloud Computing : Blynk is a full suite of software required to prototype, deploy, and remotely manage connected electronic devices at any scale: from personal IoT projects to millions of commercial connected products. With Blynk anyone can connect their hardware to the cloud and build a no-code iOS, Android, and web applications to analyze real-time and historical data coming from devices, control them remotely from anywhere in the world, receive important notifications, and much more… Blynk is a multi-tenant solution. You can configure how users get access to the data by setting roles and configuring permissions. Applications made with Blynk are ready for the end-users. Whether it is your family member, an employee, or someone who has purchased your product, they will be able to download the app, connect the device and start using it.

Blynk also offers a white-label solution (part of the Business Plan), which means that you can add your company logo, app icon, choose the theme, colours, and publish the app-to-App Store and Google Play under your company name. These apps will work with your devices.

Control Devices (GPIOs and more) Blynk can control Digital and Analog I/O Pins (GPIOs) on your hardware directly. You don’t even need to write code for it. But when it's not enough, you can use Virtual Pins. We designed Virtual Pins to exchange any data between your hardware and Blynk. Anything you connect to your hardware will be able to talk to Blynk. With Virtual Pins you can send something from the App, process it on the microcontroller, and then send it back to the smartphone. You can trigger functions, read I2C devices, convert values, control servo and DC motors etc. Virtual Pins can be used to interface with external libraries (Servo, LCD, and others) and implement custom functionality. Hardware may send data to the Widgets over the Virtual Pin like this: Blynk.virtualWrite(pin, "abc"); Blynk.virtualWrite(pin, 123); Blynk.virtualWrite(pin, 12.34); Blynk.virtualWrite(pin, "hello", 123, 12.34);

Why use Virtual Pins ? Virtual pins are hardware-independent. This means that it’s far easier to port your code from one hardware platform to another in the future (when you realize that the NodeMCU is far better than the Arduino Uno + ESP-01 that you started with, for example). You have far more control over what your widget does when using virtual pins. For example, if you want a single app button to switch multiple relays on or off at the same time then that’s simple with virtual pins, but almost impossible using digital pins. Virtual pins are more predictable (stable if you like) than manipulating digital pins.

How do Virtual Pins relate to the GPIO pins on my hardware? Virtual pins are really just a way of sending a message from the app to the code that’s running on your board (via the Blynk server). There is no correlation between Virtual Pins and any of the physical GPIO pins on your hardware. If you want a Virtual Pin to change the state of one of your physical pins then you have to write the code to make this happen.

Basic principles of using Virtual Pins We’ll use an example of a Power Switch, set to Integer data type, connected to Virtual Pin 0 (V0). In Blynk.Console we’ll leave the values set to 0 and 1, so the widget sends a 0 when it’s turned off, and a 1 when it’s turned on - like this:

The BLYNK_WRITE(vPin) function In your C++ sketch, you can add a special function that is triggered automatically whenever the server tells your device that the value of your virtual pin has changed. This change would normally happen when the widget button in the app is pressed. This special function is called BLYNK_WRITE. Think of it as meaning that the Blynk.Cloud is telling your hardware “there a new value written to your virtual pin”. So, for Virtual Pin 0, your sketch would need this bit of code adding… That’s okay if you want the same code to execute regardless of whether the button widget was turned on or off, but that’s not much use in real life, so we need to find out what the new value of the virtual pin is. Don’t forget, this will be a 0 if the button widget is off, and a 1 of it’s on.

Obtaining values from the virtual pin The server sends the current Virtual Pin value to the hardware as a parameter, and this can be obtained from within the BLYNK_WRITE(vPin) function with a piece of code like this… int virtual_pin_value = param.asInt(); This tells the code to get the value parameter from the virtual pin and store it in the local integer variable called virtual_pin_value. We can then use this value to do different actions if the button widget is now on, compared to if it is now off.

Some datastreams send their values at text, or double/float point numbers (integers are whole numbers, double point variables are one with numbers to the right of the decimal point). To allow you to use these values the Blynk library also allows the following: param.asStrng() param.asFloat() but, as we are dealing with just zeros and ones, which are integers, we’ll use the param.asInt method.

How to control the physical GPIO pins on my board? If you’re familiar with C++/Arduino programming you’ll probably know about pinMode and digitalWrite commands already. These are what we use to control the physical pins of your device from within the BLYNK_WRITE(vPin) function. For those people who aren’t familiar with these commands, I’ll give a brief summary here - but feel free to learn more by searching the internet. The pinMode command tells your board how a particular pin is going to be used. The three most common commands are: pinMode(pin,OUTPUT); pinMode(pin, INPUT); pinMode(pin, INPUT_PULLUP); As we will be controlling something like a relay or an LED in this example, we want our pins to be OUTPUTs - we’ll be outputting a HIGH or LOW signal to the relay/LED. You only need to issue a pinMode command once, when your device boots up, so this command goes in your void setup() The digitalWrite(pin, value) command sets the specified pins LOW (zero volts) or HIGH (3.3v or 5v, depending on your type of board). This is how you energise your relay, LED etc. This example code assumes that we want to control digital pin 2 on your board… Note that you can only have one void setup in your sketch, so the pinMode statement needs to be copied into your existing void setup That’s it really, you now have the same functionality from your virtual pin as you would have had if you’d used a digital pin. I’m now going to cover some extra stuff - some of which is specific to working with virtual pins, but some also apply if you use digital pins instead…

Helpful tips when working with Virtual Pins

Dealing with Activ...