Occlusion Culling in the Scene View

So I have a scene with a load of spheres. When I enable Occlusion Culling with the standard Unity FP Controller, everything works as expected. When I face away from objects, they are not rendered, as can be seen in the images below.

When facing the spheres:


When facing away:


PERFECT SO FAR!

However, when I add the OVR Controller to the scene, it doesnt update in the Scene View. (Yes I have updated the Bake to be sure). I still get what I assume is the correct info when I examine the "Stats" tab in the Game VIew, as I can see loads of draw calls are being saved. Im just wondering why it doesnt update in the Scene View the same way the standard FP Controller does?

Facing the spheres with OVR Controller:


Facing away from cubes:


It sometimes chooses to not render one or two spheres, but it doesnt update dynamically in the scene view when I look around.

Can someone let me know if there is a special way to implement this when using an Oculus Rift Controller?

Thanks