VR interaction of objects in networking

Hi!

I am making a test project with vive and networking. I have a small level and two spheres on the scene. I would want to be able to grab the sphere and throw it around and other player to catch it and throw it again in somewhat nice sync.

So far spheres have network identity, network transform with mode "syncRigidbody3d", rigidbody and vrtk interactable object components. If I try to grab the object, it will immediately snap back to its position. If I change the network transform mode to "SyncTransform" I can grab the object but the movement is not seen on other clients.

I know there is something to do with owner and then using commands and rpc's depending on who is moving what, but i haven't yet been able to wrap my head around that. Any ideas, fellow developers?

EDIT: vrtk_interactable_object extends monobehaviour. Maybe there's a way to make it networkable by extending networkbehaviour, with grabbing, throwing etc.

 

Anyone got something on this?