{"id":2648,"date":"2021-10-25T01:21:27","date_gmt":"2021-10-24T17:21:27","guid":{"rendered":"http:\/\/tangochen.com\/blog\/?p=2648"},"modified":"2021-11-03T15:38:56","modified_gmt":"2021-11-03T07:38:56","slug":"what-if-we-colorize-the-oculus-quest-passthrough-view-using-deep-learning","status":"publish","type":"post","link":"http:\/\/tangochen.com\/blog\/?p=2648","title":{"rendered":"What if we colorize the Oculus Quest Passthrough view using deep learning?"},"content":{"rendered":"<p><iframe class='youtube-player youtuber' type='text\/html' width='640' height='360' src='http:\/\/www.youtube.com\/embed\/G725PbusmWY?rel=0&amp;fs=1' webkitAllowFullScreen mozallowfullscreen allowFullScreen frameborder='0'><\/iframe><br \/>\nThe Oculus Quest currently won&#8217;t allow any access to the actual Passthrough content inside the app. Only displaying(or changing the outline color), no accessing. (And the Passthrough view won&#8217;t even be captured by the built-in recorder or by casting it to the Quest app.)<br \/>\nSo I had to cast it to my PC and do the colorization on the PC. The view isn&#8217;t transferred back to the Quest. Though it could partially done with some delay. I&#8217;d like to stop it here and feel good to just see what it can look like.<\/p>\n<p>Colorization method: Colorful Image Colorization. Richard Zhang et al. 2016.<br \/>\nThe training sets can be emphasized on daily home views for a better prediction result.<\/p>\n<p>Please stay tuned for more actual cases applied with Passthrough feature.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The Oculus Quest currently won&#8217;t allow any access to the actual Passthrough content inside the app. Only displaying(or changing the outline color), no accessing. (And the Passthrough view won&#8217;t even be captured by the built-in recorder or by casting it &hellip; <a href=\"http:\/\/tangochen.com\/blog\/?p=2648\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-2648","post","type-post","status-publish","format-standard","hentry","category-life"],"_links":{"self":[{"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/2648","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2648"}],"version-history":[{"count":3,"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/2648\/revisions"}],"predecessor-version":[{"id":2654,"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/2648\/revisions\/2654"}],"wp:attachment":[{"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2648"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2648"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/tangochen.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2648"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}