Looking for Waldo... Literally

by schilbesa in Circuits > Cameras

436 Views, 1 Favorites, 0 Comments

Looking for Waldo... Literally

whereswaldo.png

In this project, we are tracking eye movement to play Where's Waldo

Gathering Materials

To start this project, we first have to gather all of the materials. Thankfully, most of the things we need are software based, and don't require purchasing. The only hardware components we will need are a computer and a pair of headphones, and if you are reading this Instructable, you likely already have a computer, so the only hardware purchase you will need to make will be for a pair of headphones. As far as the software components go, we will be using GazePointer for our eye-tracking software, Matlab to run the cursor tracking code, Where's Waldo App on the Windows App Store, IOGraphica to make a plot of where the cursor has been during the game, and AutoHotKey to bind the volume up button and left click to the spacebar.

Preparation of GazePointer

Once you have gathered and installed all of the materials and software needed for the project, it's time to set everything up. We'll start with GazePointer. When you first open the software, it will make take you through a calibration process. The process is very easy, simply follow the target with your eyes until it's complete. Once the calibration is complete, the software will start tracking your eye movement. To switch to the cursor, select the cursor icon in the software, and now the cursor will follow your eyes.

Preparation of IOGraphica

We will be using a software called IOGraphica to track the cursor movement on the screen in real-time. When you have the program installed and extracted, you can start recording simply by pressing the button in the middle of the window. The program will follow your mouse movement, and when you're ready to stop the recording, simply hit the button again.

Preparation of Matlab Code

matlabscript.JPG

Using Matlab, we will be writing a script that tracks the position of the mouse in real time and also keeps a timer of how long the game takes to complete. Open up Matlab and copy down the script included in the image.

Preparation of AutoHotKey

ahkscript.JPG

After downloading AutoHotKey, go to your desktop and right-click. Hit "New", then hit "AutoHotKey Script" and name the script. Right-click the script and hit "Edit Script". Type in the script that is shown in the image above.

Preparation of the Where's Waldo App

After the Where's Waldo app has been installed from the Windows App store, simply start running the game. The levels should pop up for you, allowing you to enter them and search for Waldo.

Putting It All Together

Once you have everything installed and prepared, you're ready to start playing the game! Start running all of the software, and you should be able to play through the levels of Where's Waldo using your eyes and the spacebar. Be warned, if you guess incorrectly, the music will get louder, so use your guesses wisely! Enjoy!

Video Demonstration