Mix Reality Headset With Machine Learning

by Sam Kodo in Circuits > Robots

173 Views, 2 Favorites, 0 Comments

Mix Reality Headset With Machine Learning

20200220_172439.jpg
20200220_172412.jpg

I deciced recentely to build my own Mix reality Headset with Hand gesture Tracking system like Magic Leaps or hololens since i could not afford one for myself .

Supplies

To build this project , you will need :

20190605_222922.jpg
20190726_134600.jpg

For this project , i used an ARM Single Board Computer running on Windows 10 and used a dual TFT Lcd screen connetcted the HDMI port of the computer .

20190912 112206

The biggest challenge i faced during this project was to run properly the Leap Motion sensor with the Single Board Computer since the processor was very slow to handle and compute datas from the sensors with a limited RAM memory .

However , I decided to overclocked the tiny computer and finally added a small Fan to cool down the processor , and then it works pretty much well .

Un Ordinateur Capable De Voir Ma Main !!

To test, I built a simple Interactive Apps with unity to be able to grab some 3D Objects with my fingers , with the leap motion sensor .

20190906_180036.jpg
20191014_141754.jpg
20191014_141831.jpg

Now has come the time to design , to 3D print , to assemble and to put everything inside the goggles . It was the most difficult steps on this project, since i had little space to add some extra components , although i had to add some extra modification on my design .

20200220_172412.jpg

Finally my Headset was almost done , but was not running successfully as i expected since i noticed some latency with my leap motion .

On my next Instructable , i will upgrade and fix the hardware and the software then share some STL and codes on GitHub .