Help with tracking headsets in VR

Hello,

I am working on a simple UNET project with two HTC Vives. I just need them to be in the same scene and interact a little bit. I am able to spawn both into the same lobby and see each other's headsets initially.

The problem I am having is that one headset controls the movement and rotation of the other. I have tried making sure the other cameras are turned off locally and have tried to get them to update via Network Transform but have had no luck.

Can anybody help me out with the idea behind fixing this? I can script but I am not sure what to even try right now after trying so many things. If anyone has any info please let me know. I would appreciate it.

Thank you

edit: Here is an image of what my scene and player looks like.


Edit: I have fixed this and got what I needed to. If anyone runs into this same issue send me a message and hopefully I see it and can help.