Hand Washing Reminder in Mixed Reality (Meta Quest w/ Passthrough)


While many videos of proposing how life would be in AR/MR are video edited with visual effects, here’s one that actually be programmed out and can be experienced in headset in real time.
You can expect everything goes colorful if this is using a future Quest device with a colored Passthrough view.

Posted in Life | Leave a comment

The Wall between Virtuality and Reality


Be cautious in walking into reality.
VR device: Oculus Quest 2.

Posted in Life | Leave a comment

VR/MR Escape Room Experience – What You Touch Is What You Get


My table and stuff got cleaned manually after this.

You can expect everything goes colorful if this is using a future Quest device with color passthrough view. Though for this scenario grayscale may just fit well.

Posted in Life | Leave a comment

Casting Spells to Unveil the Real World in VR


Imaging the whole world is in dark. Only your hands are visible.
Now you’ve got the magic to unveil the real world.
Take a look to learn the skill for the future metaverse.

Posted in Life | Leave a comment

Mixed Reality Home Experiences With Virtual Spheres And Cubes(Meta Quest Passthrough)


Imagining throwing virtual spheres and cubes that can interact with keyboard, iPhone, HomePod, Macbook and remote control in real life.

https://patreon.com/tangochen
Support on Patreon for:
– Behind-the-scenes videos of how this project is done. And more Patron-only contents.
– Your name in Special Thanks of future videos.
– Early-access to new project videos.

Posted in Mixed Reality, Tech, Virtual Reality | Leave a comment

Ring Display on Meta Quest Touch Controller


Showing text info and menu on Meta Quest Touch Controller.

Posted in Life | Leave a comment

VR Full Body Tracking Using a Mirror


Experimenting with VR + mirror.
Same as the previous video, the Passthrough view is casted to my computer. And the full body tracking is done on computer using OpenPose.
Because Quest isn’t allowing apps to access actual Passthrough image.

Posted in Life | Leave a comment

What if we colorize the Oculus Quest Passthrough view using deep learning?


The Oculus Quest currently won’t allow any access to the actual Passthrough content inside the app. Only displaying(or changing the outline color), no accessing. (And the Passthrough view won’t even be captured by the built-in recorder or by casting it to the Quest app.)
So I had to cast it to my PC and do the colorization on the PC. The view isn’t transferred back to the Quest. Though it could partially done with some delay. I’d like to stop it here and feel good to just see what it can look like.

Colorization method: Colorful Image Colorization. Richard Zhang et al. 2016.
The training sets can be emphasized on daily home views for a better prediction result.

Please stay tuned for more actual cases applied with Passthrough feature.

Posted in Life | Leave a comment

Making a Motion Detector with Game Builder Garage on Nintendo Switch


This is a Game Builder Garage implementation of a $9.99 app.
It can be done with Toy-Con garage from any Nintendo Labo Kits, too.

Posted in Life | Tagged , | Leave a comment

Backlit Keyboard as a Typing Trainer

Posted in Life | Leave a comment