A shot from Rene’s spatial sound studio at Fraunhofer IDMT in Berlin. You can just about see the multitude of speakers that span the perimeter of the room, and there are many speakers located above. Things got a bit busy leading up to IPS2012 so I wasn’t able to blog about the conversations going between Rene, and Flavio, but it’s pretty cool collaborating on a zero budget project with two other guys from different parts of the world, especially when we’re having to deal with complex techniques that we aren’t all familiar with. It’s taken a while to get my head around 3D sound. I invited Rene to be part of the project when it was still in previs so I was able to let spatial sound ideas feed into the animation visually, rather than it be purely a post production process. It’s not complicated to understand the principles of 3D sound as it’s closer to our usual experience of sound in the world. Sounds can appear to emanate from any point in space. How this is achieved is through mind bending concepts like wave field synthesis, huge arrays of speakers, some very clever software and of course a sound genius such as Rene.
Perhaps the most fascinating aspect of the 3D sound mix for VORTEX is that it is made from music rather than real world sounds. The animation is completely driven by the music and many of the structural elements are visual manifestations of specific instruments or sounds within the music. One example is the electric arc that coils around the dome in time to the musical element I would describe as a bass buzz. So begins the abstraction from stereo music to visual movement to spatial sound element. This doesn’t exactly describe the complete process. There was an an extra layer of creativity going on between Flavio and Rene that I didn’t really get to hear.
Here is a breakdown of all the elements that I initially sent to Flavio to separate off as individual stems to be used for the 3D sound mix. There are also some ideas for how they could work.
Hi-Hat
Snare
Bass-Buzz
Bass-Drum
Crunch-FX
Scratch
High-Buzz
Accelerate
Power-Build
Power-Down
Digital-Fizz
Implode
OtherAll stems must be the full duration of the track.
All stems should be mono.
When layered together they should sound as much like the original track as possible.Details:
I use audio time units to give timed examples for the ‘hard to explain’ sounds. All times are based on the sections you put in dropbox. Please stick to the timings you have been using.1. Hi-Hat
not usual hi-hat, but high pitched buzz/tsst sound2. Snare
Usual snare sound3. Bass-Buzz
Very low tone electric sound. I’ve used this to sound to drive the electric/lightning elements around the perimeter of the vortex. (the sound in FX for Aaron 3)4. Bass-Drum
Deep reverberating bass drum hits.5. Crunch-FX
Distortion crunch sounds… There are several throughout the duration.
Example a: 00:00:19:21714 – 00:00:19:37592
Example b: 00:00:28:36081 – 00:00:29:03842
Example c: 00:00:22:15907 – 00:00:23:009246. Scratch
Sounds like a fast record scratch.
Example a: 00:00:16:17267 – 00:00:16:32085
Example b: 00:00:11:00267 – 00:00:11:051737. High-Buzz
high pitched electric buzz like a ‘zzzzzzz’
Example a: 00:00:05:32643 – 00:00:05:42441 (goes on longer than this but other sounds are also heard with it and I’m just trying to explain the individual sounds)
Example b: 00:00:14:23380 – 00:00:15:027158. Accelerate
Only once between 00:00:00:00000 – 00:00:03:176219. Power-Build
Very hard to explain the sound but here are some examples to help. Other sounds are usually overlapping so listen to a few to know which sound I mean.
Example a: 00:00:03:17712 – 00:00:04:13376
Example b: 00:00:15:01102 – 00:00:15:43948
Example c: 00:00:18:31067 – 00:00:19:26578
Example c: 00:00:18:31067 – 00:00:19:2657810. Power-Down
The powering down sound between 00:00:33:19944 – 00:00:36:0192011. Digital-Fizz
The high pithed digital noise/hiss between 00:00:36:11378 – 00:00:39:0869112. Implode
The sound last sound that sucks all sounds from existence between 00:00:39:10026 – 00:00:39:2938713. Other
Any other sounds that are left over to complete the mix. (This may not be needed)Once all 13 wavs are in the dropbox, I will then re-export these layers using the global timings for the whole film. I will also include separate layers for the intro and credits. (Oh… Send me a high quality stereo wav of the full track)
Then the full film duration layers will be individually positioned and moved around in 3D space by Rene to follow the animation.
After this, Flavio worked closely with Rene to export additional layers and figure out any issues arising in the studio and Rene worked on the spatial mixing. Well that was all a couple of weeks ago now.
Last week was the incredible International Planetarium Society Conference in Baton Rouge, where I got to meet up with Rene and discuss some ideas. We watched VORTEX in stereoscopic 3D and discussed additional ideas and ways to work on the mix in the studio in stereoscopic. Rene tells me that VORTEX is the first stereoscopic fulldome show that uses 3D sound in the world, which seems odd as in my mind the two should go together hand-in-hand. Oh, he also explained 3D sound over breakfast using toast:
So anyway… All that’s left is for me to find some pennies and go to Jena to hear the thing and put some final touches on the mix with Rene.

Leave a comment