Ghetto positional tracking. Previous chapters of “ ”: How I hacked Google Daydream controller (Part I) Reversing and making it compatible with Apple iOS devices. (Part II) Developing compatibility across multiple platforms. (Part III) What about using two controllers at same time? Doing things even more serious. (Part IV) FOREWORD Ever since I was a kid I’ve always loved to disassemble toys. I enjoyed browsing what was hidden by the plastic, to the discover the magic that gave life to everything. When I found circuits instead of gears, I was marveled: it was how I met the electronics for the first time. Soon, I found myself surrounded by a lot of disassembled toys. Back then, I realised that I had to do something to save them, otherwise someone would have thrown them all. I started early practicing the art of “tinkering” to create some compositions. I wanted to create better toys, with some extra-functions: something unique to show to my friends. Time has passed, but my attitude has not changed, rather, I have just changed my toys: this is what happened when I discovered the . Google Daydream controller What could I ever craft just with a ping-pong ball and some hardware tools? A . DIY positional tracking Google Daydream controller hack with a positional tracking light. HARDWARE I started with a robust guitar pick to separate the two bodies of the passing it into the gap around the outer edges. The upper part (the one hosting the ) is attached to the bottom shell with two clips; the lower halves of both parts are glued: I had to slightly force the hand to get them detached. Daydream controller touchpad I had to be careful not to tear the white flat that connects the body parts electrically. Later, I unscrewed the 5 screws that hold the main PCB in place and then I disconnected the battery. Google Daydream controller teardown. I picked a ping-pong ball, I pierced it with a hand-drill and I glued a white LED inside it. A ping-pong ball with a LED inside the hole. Following, I drilled both the lower shell of the (to allow the housing of a off-the-shelf button) and the upper part (to allow the pins of the LED to access the inside circuit). Daydream controller Drills and holes everywhere. Once the tip of the soldering iron was hot, I soaked a bit of tin in the flux, then I welded two wires to the poles of power socket ( and ): from here I took the power to light up the LED. + - Google Daydream controller master PCB with power derivations from the battery socket. I shoved the LED pins into the slots I made on top and I soldered the connectors with the wires, according to their polarity. Something gonna happen. Test number one: it works. Google Daydream controller hack: positional tracking light test. Sprucing up the tiny wires with some electric tape. Google Daydream controller hack: positional tracking light After carefully reassembled it all, the result is the following: front and back views. Google Daydream controller hack: positional tracking light (fixed to the bottom case with some putty). SOFTWARE The can be quite tricky to deal with, but… I nimbly solved the problem “inside the browser”. I found , an amazing and opensource library that I had previously used to track objects via my laptop’s webcam. The implementation was quite easy: to make it up and running, it took just a brief code setup after a quick read in the documentation. positional tracking tracking.js JavaScript Google Daydream controller: ghetto positional tracking with + A-Frame.io tracking.js The tracked area around the light changes according to its distance from the webcam (I interpreted it as the for forward-backward movements). The tracked area projected in the webcam FOV, is identified by a coordinate system that allowed me to shift the controller along the axes. z-coordinate x,y As a I used to serve the and to my This uses the as output: for those who don’t know what we are talking about, check out the . middleware, tracking.js Daydream controller position distance Nightmare.js driver. A-Frame framework previous chapters Nightmare.js: the Google Daydream controller universal ble driver Represented below, the whole architecture that allows me to use the on all the desktop operating systems. Daydream controller (Google Daydream controller universal ble driver stack) Et voilà, ladies and gentleman, my ghetto positional tracking: Do you think you have missed something along the way? Reading previous chapters of “ ” may will help you to understand how things began: How I hacked Google Daydream controller (Part I) Reversing and making it compatible with Apple iOS devices. (Part II) Developing compatibility across multiple platforms. (Part III) What about using two controllers at same time? Doing things even more serious. (Part IV) New chapter available! . (Part VI) Building a better typing system for VR/AR using AI

Apple

Ball

How I hacked Google Daydream controller (Part V)

Too Long; Didn't Read

Companies Mentioned

@matteopisani91

RELATED STORIES