Search Unity

How to Do Mixed Reality Capture With Script

Discussion in 'VR' started by PDeveloper1, Jul 25, 2017.

  1. PDeveloper1

    PDeveloper1

    Joined:
    Mar 6, 2013
    Posts:
    15
    Hello, I am trying to add Mixed Reality Capture support in my application to create a video file of the user interacting with holograms but I can't seem to find any examples of how to do this. I tried using this example script: https://docs.unity3d.com/Manual/windowsholographic-videocapture.html but it only records the webcam video feed and does not include the holograms in the video. I see that it is possible to do this via Cortana or from the Windows device portal but it would be preferable for me to control it from Unity.

    Is doing this possible and if so are there any good example scripts or Unity documentation on how to accomplish this?
     
    PDeveloper1, Jul 25, 2017
    #1

  2. unity_andrewc

    unity_andrewc

    Unity Technologies

    Joined:
    Dec 14, 2015
    Posts:
    221
    That linked manual page sets hologramOpacity to zero on the CameraParameters object. You probably want to set it to one.

    Though the scripting reference for that field (https://docs.unity3d.com/ScriptReference/VR.WSA.WebCam.CameraParameters-hologramOpacity.html) says that you "must have also indicated that you wanted to capture holograms when you created your capture object". I'm not sure what that part entails, but just in case setting hologramOpacity to one instead of zero doesn't do the trick for you on its own, I've poked the dev that wrote that feature about it and will update this thread with his answer when he gets back to me.
     
    unity_andrewc, Jul 25, 2017
    #2

  3. PDeveloper1

    PDeveloper1

    Joined:
    Mar 6, 2013
    Posts:
    15
    PDeveloper1, Jul 25, 2017
    #3

  4. PDeveloper1

    PDeveloper1

    Joined:
    Mar 6, 2013
    Posts:
    15
    Thanks I will try that out and see if it works for me.
     
    PDeveloper1, Jul 25, 2017
    #4

  5. PDeveloper1

    PDeveloper1

    Joined:
    Mar 6, 2013
    Posts:
    15
    I changed hologramOpacity to 1 instead of 0 and it didn't seem to change anything for me. I still only see the webcam feed in the video and no holograms.
     
    PDeveloper1, Jul 25, 2017
    #5

  6. unity_andrewc

    unity_andrewc

    Unity Technologies

    Joined:
    Dec 14, 2015
    Posts:
    221
    The dev that wrote the feature sits in the same room as me, but is out at lunch. I'll let you know what I find out from him when he gets back.
     
    unity_andrewc, Jul 25, 2017
    #6

  7. PDeveloper1

    PDeveloper1

    Joined:
    Mar 6, 2013
    Posts:
    15
    I actually just managed to figure it out on my own.

    VideoCapture.CreateAsync(false, delegate (VideoCapture videoCapture)

    also needed to be changed to

    VideoCapture.CreateAsync(true, delegate (VideoCapture videoCapture)

    and along with changing the opacity to 1 records the holograms as well. Thank you for the help unity_andrewc.
     
    PDeveloper1, Jul 25, 2017
    #7

  8. unity_andrewc

    unity_andrewc

    Unity Technologies

    Joined:
    Dec 14, 2015
    Posts:
    221
    Ah, I missed that. Glad you found it. (As an aside, this is my issue with passing bools to public methods we expose, it makes the code far less intuitive when reading - even if it's only two allowed values, I wish we'd expose those as enums.)
     
    unity_andrewc, Jul 25, 2017
    #8

  9. PDeveloper1

    PDeveloper1

    Joined:
    Mar 6, 2013
    Posts:
    15
    This is only tangentially related to my original question but do you know if there is a maximum value that MaxRecordingTime can be set to? I have seen some info online saying that video recording is limited to only a few minutes at a time on HoloLens and I wasn't sure if that was also the case here.
     
    PDeveloper1, Jul 26, 2017
    #9

  10. Sam128

    Sam128

    Joined:
    Nov 21, 2017
    Posts:
    9
    Is there a way to sent this capture over a webserver, and create possible video conferencing ?
     
    Sam128, Jan 27, 2018
    #10