Imagining throwing virtual spheres and cubes that can interact with keyboard, iPhone, HomePod, Macbook and remote control in real life.
https://patreon.com/tangochen
Support on Patreon for:
– Behind-the-scenes videos of how this project is done. And more Patron-only contents.
– Your name in Special Thanks of future videos.
– Early-access to new project videos.
Showing text info and menu on Meta Quest Touch Controller.
Experimenting with VR + mirror.
Same as the previous video, the Passthrough view is casted to my computer. And the full body tracking is done on computer using OpenPose.
Because Quest isn’t allowing apps to access actual Passthrough image.
The Oculus Quest currently won’t allow any access to the actual Passthrough content inside the app. Only displaying(or changing the outline color), no accessing. (And the Passthrough view won’t even be captured by the built-in recorder or by casting it to the Quest app.)
So I had to cast it to my PC and do the colorization on the PC. The view isn’t transferred back to the Quest. Though it could partially done with some delay. I’d like to stop it here and feel good to just see what it can look like.
Colorization method: Colorful Image Colorization. Richard Zhang et al. 2016.
The training sets can be emphasized on daily home views for a better prediction result.
Please stay tuned for more actual cases applied with Passthrough feature.
This is a Game Builder Garage implementation of a $9.99 app.
It can be done with Toy-Con garage from any Nintendo Labo Kits, too.
This is like a Try-Not-To-Type-In-A-Normal-Way challenge for myself, with a backlit keyboard.
As always, things are done early but it took me a lot of unpredictable procrastinating(waiting and not doing anything more) time before videos are made to publish.
The video clips are in a super bad quality. *facepalm*
Also, I’ve compromised on inconsistent unstable recorded voices.
Enough(time spent) is enough.
Every video is made like an experiment without being in a consistent style and quality. Some are put more effort with new editing ideas, some are simpler. After all, I hope I’ve done more (than nothing) while in a balance between time consumption and trying more for skills expansion.
I had never been a fan of mechanical keyboard until I thought, there is something programmable with it…
Specifically with a backlit keyboard. Every key has its individual RGB lighting. Just like a LED matrix panel with interactable pixels.
And I want to program these pixels…
10 effects included in this video. I’ve done more actually, will publish in other videos.
