Controlling Mouse Motions Using Eye Tracking

Srinivasbatchu
5 min readDec 16, 2020

--

Introduction

The Business idea for my startup company is to build a software which helps in moving the cursor in a computer handsfree and operate it by the movement of our eyes .

Computers are readily usable to persons who have hands to control mouse and keyboard and eyes to see what is on the monitor. Now even blind can use the computer using the text to speech option which pronounces the content on the screen. But people who do not have hands cannot use it due to their inability to control mouse and keyword operations. In today’s competitive environment everybody needs to be equipped with different sets of skills so as get a job. Knowledge and usage of computers being a necessity nowadays. So this causes them to live a miserable life.

An eye tracking system is one of the best application for the handicapped person. To develop this application various algorithm methods and techniques of the image processing are used. These methods and techniques of image processing gives a well designed model for eye tracking system.

Market Demand

There is lot of demand for this kind of project . Generally people only opt for easy ways. So this project would have a big demand in the market and it was also useful for many disabled people.

Relevant Products

There are so many research papers for this kind of project but there are no proper products relevant to this.

Target Customers

This project is more beneficiary for the people who have computer knowledge but unable to type because of there disability. There is a small requirement for them is to buy a laptop or a computer available with a camera and install the required things to this project. This is useful for many countries.

Required Knowledge

The method for mouse movement by pupil and mouth movement was achieved using the following process:-

A. Face Detection

To represent a clean and accurate image, the user should face parallel to the webcam position.(Eye level to the top of monitor)

The image of the person is captured by webcam pre-installed in the system using python.

B. Eye Detection

For eye detection, we use Eye-Aspect-Ratio(EAR). It was used to

Observe if the person’s eye is flickering or not in the video frame.

C. Mouth Detection

Same as eye-aspect-ratio, we have mouth-aspect ratio(MAR) is used to identify whether the mouth is open or not.

To control the mouse pointer (cursor) on the screen we utilize the understudy of the eye, the focal organize of the screen is consider as the beginning point. This position is utilized as the base for look following, and the beginning situation of the mouse pointer is set as the focal point of the screen. The moving situation of the cursor accepts the underlying situation as the base. As the understudy move to some bearing, the organize of the mouse pointer on screen change as per the development of the understudy. At the point when the under studies re-visitation of the first position, the cursor quits moving. The size of the student are getting greater and greater at the point when client looks upward and the size of eye is getting little when the clients eye position is downwards or on the other hand the eyes are in marginally half-shut state. This wonder can be utilized for controlling the mouse pointer to move through and through.

· For activating/deactivate mouse control we have to

open mouth continuously for some time.

· If the user blinks their left eye it will act as a left-click.

· If the user blinks their right eye it will act as a right-click.

· If the user squints his/her eye for some time it will activate/deactivate scrolling.

· Head will be used for cursor movements and scrolling up or do.

The algorithm starts to detect a face of a person using a face detection algorithm. After detecting the face, the position of eyes and mouth is captured for controlling the mouse functions such as left-click, right-click, and cursor movement. This method doesn’t require any special hardware and sensors. It is a hands-free system that is useful for handicapped. First, we have to activate the mouse control mode by opening the mouth. For moving the mouse cursor left or right we simply have to move our head in the intended direction of movement of a cursor. For enabling the scroll mode, we have to squint our eyes into the camera and on initiation, it will show scroll mode is on. Now you can move your head up for scrolling the up and similarly down to scroll the page down.

In this module we will present the most conceivable area of the eye. By applying the Leonardo da-vinci rule we can isolate the eyes from the face, that layout is only the precise working zone .At that point we need to box of size E*E (for example 15*15 ) is drawn around the focal point of the working eye area, as appeared in fig6. The picture inside this case is trimmed out of the current picture. The trimmed picture is saved according to the heading, for example, up, down, right, left in the information base and each picture in the information base is consider as the format of the eye. We need to save distinctive example for the single heading in light of the fact that there might be odds of indicating the variety in the yield. At long last we have to coordinate that the current layout of the client with the generally put away format in the information base. On the off chance that two formats have least contrast that implies it gives the most extreme counterpart for one another. Finally we can move towards the cursor development.

Solution

Estimated Budget

This project does not need more budget. It requires just few things like a laptop or a computer with a webcam . The estimated budget for this project is based on the laptop we buy or a computer we buy and an excess of Rs.500 to Rs.1000 will be used .

Product Pricing

As this is a backend product I would release it as a application to the respective stores. If it was a hardware product I would sell it.

Marketing Plan

After the completion of the project I would check whether it does not have any errors or any problems. Once I had got an idea of how the project is I will first request a company and I will present my project and advertise it in some apps and television about this new feature.

Risk Analysis

The whole risk is during the coding.

--

--

Srinivasbatchu
Srinivasbatchu

No responses yet