Eye Tracker for the Disabled

by swimming0831 in Circuits > Software

1122 Views, 3 Favorites, 0 Comments

Eye Tracker for the Disabled

jj.jpg

Eye Tracking Software

Hi, my name is Lucas Ahn, otherwise known as Soo Young Ahn. I am currently enrolled in Asia Pacific International School, and this is my project!

Background Information

ssc.png
vvs.png

Paper: "Accurate Eye Centre Localisation by means of Gradients" by Fabian Timm and Erhardt Barth

- The estimation of the eye centers is used in several computer vision applications such as face recognition or eye tracking

- EYE CENTRE LOCALISATION

Math Theory

Main Principle

sss.png
asd.png
dd.png

Evaluation of (1) for an exemplary pupil with the detected centre marked in white (left). The objective function achieves a strong maximum at the centre of the pupil; 2-dimensional plot (centre) and 3-dimensional plot (right)

Webcam Gaze Tracker

gg.png

https://github.com/iitmcvg/eye-gaze

Webcam Based Eye Tracking Pros and Cons

Pros: Cheap, available for almost everyone, fast turnaround and available at anywhere with a webcam

Cons: Less accurate, Steady posture, Low light condition, Low frame resolution

Open CV: Eye Detection

aa.png
vv.png

https://www.usability.gov/how-to-and-tools/methods/personas.html

Eye Tracker for Disabled Project

gh.png

Eye detection --> Mouse control --> Web browsing

Results:

Upgraded Project for Mobile

rr.png
tt.jpg

ARKit for iOS + Cocoapods Library

Eye Tracking Functions

bb.png
cc.png
dd.png
ee.png
ff.png

Up, Down, Right, Left Recognition

Eye Track Browser Development Process

hh.png

iOS + ARKit + Cocoapods

(OpenCV Library) Language : Swift + Objective C

eyeTrackBrowser 1

Reason Why I Made This Browser

This browser was created for the purpose of helping disabled people browse on the internet for several purposes such as searching for jobs online or simply for entertainment.