Immersive

The Need to Play with 360 Video

A few years ago I signed a contract to generate 360 content but the contract ended after just a month because the company restructured or something similar. I then bought a 360 camera and played with it to film interesting angles.

I keep forgetting that I have this fantastic camera. It’s fantastic because with 360 videos you can either allow people to see what they want to see, or you can frame the shot just as you want it to be. With a normal camera you need to place it so that you can film what you want to film. With a 360 camera you film everything and then frame the shot.

Apple Pure Vision and the Immersive Experience Opportunity

Memorable VR experiences

AR/VR and XR have been around for years, if not decades. The most unique VR experience I was involved with was people wearing an immersive headset whilst snorkelling in a pool to experience being “weightless” whilst watching an immersive video. 

The second most interesting video 360 experience was a ZDF volcanic explosion where you could watch a volcano explode, as if you were in Pompei. You could follow the projectiles as they flew by you. You could watch the pigeons take off and fly away. 

Filming events in 360

We have all seen events covered by photographers and camera operators but how many events have we seen covered with 360 degree videos?

A few weeks ago I filmed the Escalade, wrestling and other events with 360 cameras and it was fun. In some cases it was the opportunity to play with a new format and in other cases it was the opportunity for proof of concept.

The thing to remember about 360 videos is that you’re placing the camera at a point in space and people can look around as if they were holding the camera. Of course rather than hold the camera with their hands they are holding it with their fingers or even on their heads.

A continued Interest in 360 Videos

A few weeks ago I was at the Geneva International Film Festival in Geneva as a volunteer so I got to play and experience new 360 experiences and some of these were interested because we could move around in space whilst others were interesting because of their length.

A few years ago people thought that 15-20 minutes was long for content but during the GIFF it became apparent that content is now 30 or more minutes long so another wall has come down. People can now experience immersive VR Goggle experiences for extended periods of time and this opens quite a few new doors.

Thoughts on the Oculus Quest

During the World XR Forum I had to carry six or more Oculus Quest devices from a car to the conference centre and then help with setting up at least one of these devices. At first I thought it was like most VR headsets where the phone is the display.

In reality, the Oculus Quest is a self-contained VR headset driven via an app from the mobile phone. Once the Oculus quest and the mobile phone are paired you can play with content and use it. This is great because it no longer requires a high spec computer, it has no cables and best of all it’s affordable. At 400-500 CHF it’s affordable within most geek budgets.

Sea of Tranquility - Snorkeling VR by Pierre Friquet

During the World XR Forum this year in Crans Montana I helped Pierre Friquet with his Sea of Tranquility VR Experience. This VR experience was unique in that it required you to be either in your swimming clothes, your underwear or other.

This was a VR experience where you went from being outside where the temperature was descending to winter temperatures to what felt like a warm room when dressed but comfortable when wet.

Experimenting with Spherical photographs

I was in Spain with the Ricoh Theta S last week so I took the opportunity to experiment with the Ricoh Theta S in a number of locations. What I like about such a device is that it takes a click to get pictures. I experimented with a manfrotto monopod and a smaller monopod. The Manfrotto base was clearly visible in shots so the immersive experience is degraded. With the smaller monopod the base is the same width as that of the camera. This means that at least the support was hidden.

The Immersive Video Experience

  I was at the World Virtual Reality Forum in Crans Montana this weekend as a volunteer. During this time I was able to try many of the demonstrations and get a real feel for the potential of 360° and immersive videos. I was also able to listen to people comment on what they appreciated about the experiences and what they did not like.

Vulkane in 3D und 360

One of my favourite experiences was Vulkane in 3D und 360. I worked at this exhibit two out of the three days helping two people at a time every three minutes experience this. I had watched a number of videos before this one and when I watched this one I said Wow because the experience was so beautiful. The quality is excellent and there are some vistas that are spectacular. We are familiar with watching volcanic eruptions but with this experience we are watching the scene as if we are there. As the volcano erupts we can see the projectiles and follow their course through the sky. This is a novel experience for many of us.

Video Editing in a virtual Reality environment

A few years ago I said that I would upgrade my mac book pro when apple came out with a dual display laptop where the keyboard is a touchscreen display that changes to suit the application in use. Two days ago I had a change of heart. I do not expect Apple to come out with such a device. I have set my sites on a different idea. An edit suite which requires VR goggles to use. The edit suite could be used either by standing people or sitting people. Turn your eyes to the left and you see the rushes. You would have a choice. The rushes could be shown as keyframes on a board or as film strips. Motion feedback gloves would be worn that provide tactile feedback. Double click and the selected clip appears in the player window. With current editing systems keyboard shortcuts are learned and memorised by editors to avoid using the mouse. In this case specific finger positions would be short cuts. You could trim, splice, insert, overwrite, make multiclips and more. Sound and vision could be faded as if using physical controls. Imagine multicamera editing in Final Cut VR. The setup would be like in an OB van except that you’re in an edit suite or in a park. You could even be sitting in the back seat of a car. The beauty of such a setup is that monitors and displays could eventually be removed from the desk to be replaced with goggles and a pair of gloves. This means that the same edit suite could have a virtual 64 channel audio mixing board for sound technicians, colour correction wheels for colour graders, vision mixing console for vision mixers and standard video editing controls for video editors. In theory we could go back to the jug/shuttle controls from linear editing days. I now look forward to seeing whether Avid, Apple or Adobe come out with the first virtual audiovisual creation suite. Imagine how immersive the experience would be. Enjoy the notion that this virtual environment will allow you to stand or sit down.