Search Unity

  1. Megacity Metro Demo now available. Download now.
    Dismiss Notice
  2. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Gear VR, passthrough camera, how?

Discussion in 'AR/VR (XR) Discussion' started by frepe360, Oct 31, 2015.

  1. frepe360

    frepe360

    Joined:
    Sep 20, 2015
    Posts:
    3
    Hi!

    I've just started using Unity3d to make programs for the samsung galaxy S6/samsung gear vr.

    Using the software from samsung, it is possible to do a long press on the back button of the gear vr to get to a "settings" screen. In that screen, I can press "passthrough camera on" to get the phone camera to turn on and be displayed (stereoscopically) in the gear vr.

    Is it possible to do this from a unity3d program, and if so, how?

    I would also like to process the incoming video with different filters, like simple edge detections but also more complicated filters where I need access to raw pixel data.

    Thanks in advance!
     
  2. guru20

    guru20

    Joined:
    Jul 30, 2013
    Posts:
    239
    Would love to know the same thing... thought about this, but it wasn't immediately relevant to the game I was working on at the moment, so I didn't dig too deeply (however, I don't see any documentation about whether this is possible. Also, I have not seen any Gear VR apps that use this functionality even though it seems like it would be possible to do AR this way...)
     
  3. EdBlais

    EdBlais

    Unity Technologies

    Joined:
    Nov 18, 2013
    Posts:
    311
  4. moshebitan

    moshebitan

    Joined:
    Nov 13, 2013
    Posts:
    3
    The performance on the WebCamTexture is realy poor
     
  5. Lanre

    Lanre

    Joined:
    Dec 26, 2013
    Posts:
    3,970
    I developed NatCam. I have had a couple of our beta testers use NatCam with GearVR. I did use NatCam with Google Cardboard and it works excellently well. And it has performance comparable to the native camera apps.

    I would love to speak to the Unity developers responsible for managing the WebCamTexture API. I can think of a couple ways to increase the interoperability of NatCam and Unity.
     
    archonware_jbueza likes this.
  6. archonware_jbueza

    archonware_jbueza

    Joined:
    May 18, 2016
    Posts:
    15
    NatCam is awesome, there should be more AR apps coming for the GearVR because of your awesome work!

    Kind regards,
    Jaime Bueza
    ConstructVR.io
     
    Lanre likes this.
  7. archonware_jbueza

    archonware_jbueza

    Joined:
    May 18, 2016
    Posts:
    15
    Hey Lanre! Just wondering, do you have any examples that are downloadable that intergrate the GearVR with NetCam?

    Cheers!
    Jaime
     
  8. Lanre

    Lanre

    Joined:
    Dec 26, 2013
    Posts:
    3,970
    Hi Jamie. There aren't any GearVR examples. I could create one once I complete NatCam 1.4b0. However, there is a minimal Cardboard example on GitHub.
     
  9. Davedub

    Davedub

    Joined:
    Mar 30, 2016
    Posts:
    22
    I'm also trying to get NatCam working on GearVR. Looking at the Google cardboard project, I see the following:
    • On the main camera, add a StereoController component and click 'Update Stereo Cameras'
    However, I do not know where to find the StereoController component. I don't see it anywhere in the example project, and I don't see it in the standard 'Add Component' menu.

    ~ Where do I find this component?

    Thanks in advance,

    DaveDub
     
  10. Lanre

    Lanre

    Joined:
    Dec 26, 2013
    Posts:
    3,970
    This instruction was made for an older version of the Google Cardboard SDK. I have to update the NatCam VR demo.
     
  11. pStar

    pStar

    Joined:
    Jun 26, 2013
    Posts:
    7
    Hi Lanre,

    I'm back on a project that requires a pass through camera in GearVR. Would you have an updated VR Demo, or brief instructions on how to integrate NatCam into the GearVR?

    Thank you for your awesome work,

    ~pStar
     
  12. Lanre

    Lanre

    Joined:
    Dec 26, 2013
    Posts:
    3,970
    I happen to be working on an updated VR example app for the NatCam. Make sure to check my GitHub and keep in touch here or via email. I expect to complete the example this week.
     
  13. pStar

    pStar

    Joined:
    Jun 26, 2013
    Posts:
    7
    Thank you, I'll keep a look out for the example.
     
  14. paulyn_pelayo

    paulyn_pelayo

    Joined:
    Jan 12, 2015
    Posts:
    1
    Hi Lanre, Is there any update regarding the VR example for the NatCam? Thanks!
     
  15. Lanre

    Lanre

    Joined:
    Dec 26, 2013
    Posts:
    3,970
    We are working on a written tutorial series called the NatCam Tutorial Series. MoodCam VR is currently slated to begin at part 7 so monitor the NatCam thread as I announce more tutorials being uploaded.