knot for sale – Page 4

360 VR: A Brave New World

kaitann October 7, 2016 October 7, 2016Uncategorized

By Morgan Buxton for WRIT 420 Note: Sources are hyperlinked* As an adrenaline junkie, I am particularly drawn to horror films. In fact, the first thing that I did after receiving my Habor VR headset in the mail was download an app called “VR Terror 360” to my phone. From there, I spent close to two hours walking into walls and annoying my roommates by shrieking every time something startled me—walking into a monster in your living room is far freakier than having him jump out at you from your television screen. Here is what I learned from my first VR 360 experience: It’s not that bad. Virtual reality has significantly altered the classic framework of filmmaking. As a writer, this got me thinking. Virtual reality films don’t only alter the way we write movies, they alter the way we watch them. In a two-dimensional world,…

Real Memories: 360° Filmmaking Done Well

kaitann October 7, 2016 October 7, 2016Uncategorized

By Natasha D’Amours for WRIT 420 Cinematic VR. VR storytelling. 360° films. Whatever you call it, this new form of storytelling – this new medium – is innovative and exciting. Still in its early stages, most 360° film content is non-fiction. Which makes sense – it’s easier to forgive technology slip ups, like noticeable seams, awkward cuts and visible equipment and crew, when it comes to non-fiction. The viewer knows they’re in the real world. They don’t need to be convinced of the virtual reality. There’s no suspension of disbelief to maintain. That’s not to say that there’s only non-fiction when it comes to 360° content. More and more, people are using this new technology to tell narrative stories. They’re learning how to use the 360° technology to create seamless spherical tales: invisible seams, invisible equipment, and cuts woven into the story so skillfully that they don’t feel disorienting at…

My Experience with VR/360 Horror Films

kaitann October 7, 2016 October 7, 2016Uncategorized

By Rylan Gladson, University of Victoria When my mobile phone-housing “VR” headset came in the mail, I was fairly excited. I had never tried virtual reality of any sort, and my perception of it was limited to videos of people looking very silly while trying it. As with most innovations of this sort, the hype vastly outweighed the content. For the past year I had read an increasing number of articles and opinion pieces touting VR as being “the future of gaming,” or “the future of film.” Some people were calling it a new medium unto itself. But what I noticed that while a host of VR hype was flooding the internet, rarely (I can’t recall a single instance) was there hype around an actual VR game or film. It seemed that the platform itself was far more interesting than anything designed to be experienced with it, which seemed like…

The Strengths of 360 VR

kaitann October 7, 2016 October 7, 2016Uncategorized

By Brad Seabrook, University of Victoria I first came into contact with 360o Virtual Reality film with no expectations. After arriving, my Google Cardboard sat on the self for over two weeks until the first time I picked it up. When I did finally pick it up, it wasn’t because I wanted to, but because I had to. This lack of excitement doesn’t speak well for the brand of 360o VR. I wasn’t hearing a lot about it, and what I was hearing was negative criticism of 360o being a broken gimmick. But I am not here to talk about what others say, am I? No, but when I did first “experience” 360o, I understood the criticism. Low resolution, double vision and an unconvincing immersion was what I found… until I began to really play with it. I’m going to liken 360o VR to a talking animal movie for a…

Popular Online Media Producers and Their Attempts at 360° — Failure or Not?

kaitann October 7, 2016 October 7, 2016Uncategorized

By Kaitlyn Michaelis, University of Victoria As someone who has followed Rooster Teeth’s adventures since 2011, I’m fairly familiar with their production work and the kind of humorous content they put out. The media production company has put out more than a handful of short films, video game playthroughs, created TV mini series broadcasted through their own website (Day 5, RWBY, and Crunch Time, to name a few recent ones). When I started taking Writing 420 and learned that we were going to be making a short 360° film, Rooster Teeth uploaded a short live-action 360° film to YouTube called Kidnapped. The premise is that you are Agent X, caught in between two idiotic henchmen and their boss. You must be dispatched of, as you have come in the way of their plans. But through a comedic misinterpretation, the two bumbling henchmen take you out — an idyllic ride on…

My Virtual Tragedy

kaitann October 7, 2016 October 7, 2016Uncategorized

by Brendan Lee, University of Victoria What began with childlike excitement, ended in frustration laced with venomous rage. My inaugural entrance into the virtual realm, the 360-degree, VR film, “Kidnapped”, reminded me of a certain memorable Christmas morning. It was the year 2000, I was an eight year old ball of energy, and it was finally the day! With the stocking ripped open, socks, pyjamas, and the new pair of ski mitts piled neatly on the couch, at last I opened my final gift. I peeled off the wrapping paper and immediately sprinted up the spiral staircase to my mom’s office, popped NHL 2001 into the disc drive and waited for the game to install. With the loading bar 90% filled in, an alarm pinged, and the progress halted. A message popped up on the screen and told me the computer didn’t have the proper graphics card. My older brother…

White Room? More like Alright Room…

kaitann October 6, 2016 October 6, 2016Uncategorized

By Chandler McCorkindale, University of Victoria While doing research on 360-degree narrative films, I stumbled upon White Room: 02B3 (available for $3.99 on the App Store). I chose to write about this film because like our film currently in production, it was shot in both 360 degrees and a traditional Flattie format. In terms of the script, the film revolves around six strangers who awake seated around a table in a white room with a gun on it. Unsure of who they are, or how they got there. They only know that they are a part of an experiment that tests their ability to settle disputes with communication or conflict. This script is ideal from a 360-degree standpoint because it allows for a controlled shoot. Roddenberry Entertainment doesn’t have to worry about camera movement or positioning. They don’t have to worry about weather or natural lighting. Instead they can situate…

kaitann October 6, 2016 December 16, 2016Uncategorized

kk-sis:

My film production class is making a VR 360 film called Knot For Sale & I made a quick video about it bc I’m hyped!

(Source: https://www.youtube.com/)

“The Invisible Man” and Integrating Editing, Music and Cinematography into 360-degree Filmmaking

kaitann October 6, 2016 October 6, 2016Uncategorized

By Kate McCallum, University of Victoria One of the largest challenges with 360-degree filmmaking is figuring out how to successfully tell a story with the knowledge of 2d “flattie” filmmaking that can become limited within this new medium. Can filmmakers take tools such as cinematography, editing, animation, sound, and lighting and treat them the same in VR films as they would a flattie, or must they develop a new way of expressing the story within this new medium? The obvious is the latter, however the amount of integration is still to be discussed. My experience in viewing 360 films is limited and I’m definitely no expert in the topic, however the few films I have seen shy away from more stylistic elements of a flattie film. I’ve observed that these films tend to work with action in the space around the camera to move the story forward, rather than use…

Sound Recorting and Editing for a 360 Film

kaitann October 5, 2016 October 5, 2016Uncategorized

Sound Recorting and Editing for a 360 Film

By Hector Perez, University of Victoria

Concerns in the Medium of 360 Film.

There are many questions in the medium of 360 film. For a long time, the main concern was the image – is it realistic enough? Now, sound in 360 film is becoming more and more important, as it aids in the immersion of the viewers. It is also a big challenge. For 360/VR to be truly immersive, it needs convincing sound to match. The role of the sound editor is to create the illusion of space.

In 360 it becomes tricky to create edits as the experience is jarring. The immersion could be disrupted quite easily. A problem with audio for 360 film is the directionality of it. What if the spectator doesn’t look where you may want them to? On the other hand, if directional sounds are persuasive enough, the viewer could be convinced to change their position.

Another concern is the placement of recording equipment. How do we conceal it from the viewer?

Main Techniques for Recording for 360 Film.

How can all the different sound recordings be compiled together, resulting in a ‘believable’ mix? These are the main techniques I discovered.

Binaural Audio

Binaural audio would be great for VR, if you could track head movement. There is a technique when you can make binaural recordings on a dummy head with microphones for ears. Using the resulting audio can be problematic. For example, you would feel if you’re in the soundspace, but you wouldn’t feel the same if you moved your head too much. This is because typical Binaural recording is static and records sounds from one exact position in space.

This is a quote with an analogy of why this happens: “A stereo pair of videos gives us the illusion of a 3D view, but doesn’t have information about how the world looks if we move our head. With binaural audio we do not have the information of how the sound would be if your ears were in other locations.(3)”

There are alternatives. Some have been using a setup in which multiple Binaural Recorders are used simultaneously. This is a picture of an Omni binaural recording setup by 3Dio.

3dio_8_way.0.jpg

Ambisonics.

Using a tetrahedral mic array. The information recorded really is not what should come out of the speakers, but the information can be decoded into audio tracks that can be played out of the speakers. Head tracking functions would determine a transform applied to the recorded sound. Disadvantages with this technique are that it’s complex, and finicky. It is also impractical: you would need to figure out a specific speaker setup for playback, and to decode the data for that setup. I don’t believe this is a candidate because it requires speakers.

Non-Head Tracking Strategies.

Another option is to not worry about head-tracked audio. An example presented in the article (3) is when the author of this article recorded a rock concert. He placed a clay modeled dummy head and put it above the audience to get the ‘feel’ of things happening all around. The author also suggests that doing voice over helps you not worry about head-tracking. Specifically, he used the (locationless) voice over supported by ambient sound for this.

Another strategy he used is to ‘read’ the viewer’s mind and not go super fancy with sound. For example if you know where they’ll probably look at, you don’t need head-tracking.

Go for more advanced plugins.

Some gaming development platforms, like Unity , provide spatialization tools.

Dolby Surround (Not really 360 – but interesting)

Surround sound was based on fixed audio channels, when implemented by Dolby.

But then, the channels would be sent to a specific speakers in the room.

This did not always work in larger rooms- like cinemas.

Dolby’s Atmos appeared in response, which allows for more control of where sounds are, without having to route the audio to specific speakers.

Psychoacoustics Principles Used

How do humans perceive sounds? The following ideas are taken advantage of to ‘fool’ the brain into believing the localization of sound.

The cues that the human brain needs to localize sound are challenging to recreate. One of these is Proximity. E.g. if the sound arrives to one ear before the other, the sound appears to come from that direction. Also, audio levels would differ, and that would also help determine the direction of the sound.

Some directions are hard to recreate – front or back are ambiguous. There are HRTFs (Head Related Transfer Functions) that have to do with the interaction of the sound with the person’s body – head, shoulders, ears and neck that help the brain solve the ambiguity. (As shown below, level of sound changes slightly depending on the direction of the incoming sound) But how can that be recreated in 360 film?

Every person’s HRTFs is different. This is why dummy binaural recordings don’t work for everything.

Recommendations/Strategies for Recording/Mixing

Aki Silventoinen provides good insight into his experience with 360 audio. He shares several recommendations, here compiled.

Microphone setups used for recording: Mid-Side and XY configurations. Lavalier Mic’s.

Comment: Recording dialogue with lavalier microphones – syncing the audio later could be complicated and there might be disparity between dialogue and lip movement.

Backup the Backups – He has copies of everything at least in three locations – and in the cloud.

To create the illusion of sound localization when the soundscape is fixed in stereo with no adaptive head tracking, the best you can do is to keep all the dialogue and sound FX in the middle of the stereo field as mono mix. This is not perfect, but stereo is limiting.

Keep everything that should be spatialized in mono format. This takes advantage of psychoacoustics – the brain tries to ‘reason’ what is the most likely source of the sound. ‘If for example, there is a person speaking in front of you in the 360 VR film, then your brain presumes that’s where the sound comes from. There is still a problem with this – when a person turns their head too much during dialogue lines.

Although it is possible to create panning automations in Pro Tools, don’t do that in stereo mixes in 360 videos. These automations don’t make sense when viewers turn their heads.

Ambience tracks and other audio tracks with less significance can be presented in stereo.

Use equalization to reduce the level of the ambient tracks so that there’s room for dialogue. Also, this helps un-localize these tracks. Specifically, use a parametric EQ (wide – with low Q) to reduce the 1-2kHz area and the 6-10kHz area. Why those frequencies: that’s where human hearing is fine tuned to listen to voice.

Do the opposite when you wish to increase the localization of a certain sound. Use the EQ to increase the level in those same frequency ranges. The maximum is -6dBFS (full-scale, where 0dB is the maximum level achievable).

Mix using headphones. Since this isolates the external soundscape, all the nuances in the sound are very noticeable. Using high sample rates is a good idea – 24/48 kHz. Also – use different models of headphones to check the mix.
It’s a very bad idea to let the mix peak near 0 dBFS. -6dBFS is maximum. Always check the level of the final mix. There level shouldn’t be above -3dB.
It is hard to justify the use of music in a 360 video. It might break the illusion, if it’s presented as a regular stereo mix. He recommends if music is used, it should be world-generated/ diegetic/ inside the virtual world.

When syncing the video to the audio:

Have reference track from one or two of the VR cameras. Otherwise it’s too hard to place the audio where it should go. (take it out/mute it at the end).

Perform phase-checking for all audio signals when syncing – if there is a delay between signals, they could interfere constructively or destructively (sound louder/ lower than they should).

Conclusions

The sound for the 360 film should be of high quality. For best results, it should be directional. The sound should be recorded and played back with two or more channels (stereo/binaural), and synchronized with the pictures. There are specific ranges of frequencies that are optimal for hearing human voice – this can be exploited. There are psychoacoustic principles that can be used to make the viewer more immerse in the virtual reality/360 experience.

Going Further – Tools existing worth exploring.

Pro Tools alone won’t save the day if you’re going for a truly immersive experience. You could use some third party plugins in game engines – Unity , for example to create a Binaural mix. ‘Two Big Ears’ is a virtual reality audio developer group that provides good tools for virtual reality 3D mixing. The software recommended by Aki Silventoinen is 3 Deception Spatial Workstation (by Two Big Ears) – now FaceBook 360 Spatial Workstation. It can be found at:

https://facebook360.fb.com/spatial-workstation/

Cool Links to Check Out

Cool demo of Binaural audio (You can click!)

http://www.theverge.com/2015/2/12/8021733/3d-audio-3dio-binaural-immersive-vr-sound-times-square-new-york

The developers of the 360 Spatial Workstation – now joining FaceBook.(Software is Free!)

http://www.twobigears.com/

Aki’s blog, where he posts his experiences and latest works.

http://www.akisilventoinen.com/blog

‘Fixing Incus’ – a 360 short film

https://youtu.be/CjsZfIoihKs.

Introducing Facebook Surround 360: An open, high-quality 3D-360 video capture system

https://code.facebook.com/posts/1755691291326688/introducing-facebook-surround-360-an-open-high-quality-3d-360-video-capture-system/