Lesson 06: Immersive and Spatial Audio
Learning Outcomes
-
Understand sound in a 360 space
-
Describe different approaches to recording sound for 360
-
Implement spatialized sound in editing
Lesson Outline
Watch: Notes on Blindness
360 video w/spatial audio (NPR)
Wadada Leo Smith: Awakening Emmett Till (360˚ Video + Audio) | Jazz Night in America
STAND AT THE EDGE OF GEOLOGIC TIME 360 audio + 360 photos
Beginners guide to spatialized audio in 360 video | NPR
Recording 360 audio | NPR
Different types of immersive audio and key terms – binaural, spatial, ambisonic
Recording and mics
Point source recording
Spatializing in the edit: Premiere, Facebook Spatial Audio Workstation, Airfield
Location-based audio (geo spatialized) Audio walking tours, roundware
In-class Exercise/Activity for Small Groups
Have students manipulate a mono point-source recording in 360 using Premiere’s spatial audio effects. (See https://helpx.adobe.com/premiere-pro/using/VRSupport.html#AssemblingAmbisonicsAudio)
Readings
A great link to many resources: Microsoft Spatial Audio
Spatial Audio: The Continuing Evolution | Basic Intro via Abbey Road Institute
BBC Spatial audio: Where do I start? | Academy Guides
On Our Radar: Audio AR | BBC R&D
Your Guide to Spatial Audio in VR | Circuit Stream
Spatial Workstation User Guide and Template Info
Ambisonic Audio in Adobe Premiere
Ambisonic Audio in Adobe Premiere tip sheet
Oculus Localization and the Human Auditory System
A guide to recording spatial audio for 360-degree video | NPR
Join the Spatial Workstation Facebook Group to ask questions
Discussion Topics
Discuss the difference between “head locked” and responsive or spatial audio.
What are the benefits of using spatial audio in your project?
End of lesson feedback
3-2-1 (3 takeaways, 2 questions, 1 thing they enjoyed)
Immersive and spatial audio allow the audience to be sonically immersed in an environment. There’s a maxim of filmmaking that sound is 50% of the movie, and that goes for immersive storytelling too. The way we see/hear the world is a mix of point source and ambisonics audio and the immersive audio tools aren’t quite as uniform and simple to use as some of the 360 video cameras and editing software. This lesson should get students started with immersive and spatial audio and get them thinking about when and how to apply it in their work.