5
$\begingroup$

I'm trying to render 3D audio so that when you turn the view on YouTube, the audio will change depending on what direction you are looking in. Please note that when I say this, I mean VR video and audio.

The Spatial Media Metadata injector (found here) only supports ambiX ACN/SN3D format audio, and I'd like to find out how to get those file types in Blender. I have 5 speakers, none moving, all playing different ambient sounds (birds, water flowing).

Speakers Audio Panel Injector

Software Available:

  • Windows 10

  • Windows 7

  • Mac OS 10.14

  • Blender

  • Audacity
  • iMovie
  • GarageBand
  • PowerDirector 12
  • AnyVideoConverter
  • VLC Media Player
  • FL Studio

Thanks for the help!

$\endgroup$
  • $\begingroup$ Watch this: youtube.com/… $\endgroup$ – LeoNas Sep 17 '18 at 16:28
  • $\begingroup$ @LeoNas Sorry, that's for a non-spherical video. I need audio that will move when your head does. $\endgroup$ – CStafford-14 May 2 at 9:16
  • 1
    $\begingroup$ @CStafford-14 During audio rendering, first select audio container (e.g. mp3) then select the "split channel" option which will generate six tracks for 5:1 setup. Then you can mix these tracks with the help of some Ambisonics plugin to generate ACN/SN3D format, here youtube.com/watch?v=mcUwiYwgBHw, brucewiggins.co.uk/?p=666 $\endgroup$ – 3DSinghVFX May 2 at 19:01
  • 2
    $\begingroup$ @3DSinghVFX Can you not post it as an answer? I was able to make it work, thanks to you. youtu.be/xq06CgPveM8 $\endgroup$ – CStafford-14 May 3 at 11:08
3
$\begingroup$

It's rather simple as to do this, also, for free :)

Thanks to @3DSinghVFX for the answer in a comment.

During audio rendering, first select audio container (e.g. mp3) then select the "split channel" option which will generate six tracks for 5:1 setup. Then you can mix these tracks with the help of some Ambisonics plugin to generate ACN/SN3D format.

Add all the tracks into a DAW (I'm using Reaper), and enable the WigAmbiRemap JS Effect. Set the Outgoing Amb Normalisation to SN3D and Outgoing Channel Ordering to ACN. Then render to a file with 4 channels.
Setup
Then, render the video and "glue" them together with ffmpeg.

Use this in the terminal (CMD or Bash will do, ffmpeg must be installed)

ffmpeg -loop 1 -i video.mov -i ambiX.wav -map 1:a -map 0:v -c:a copy -channel_layout 4.0 -c:v libx264 -b:v 40000k -bufsize 40000k -shortest output.mov

You can change the following:

video.mov can be a .mov file or image file, and represents the video.
ambiX.wav is the 4-channel B360 Ambisonic file.
output.mov is the output file.

After that, pop it through the metadata injector (Making sure you check the 1st and 3rd checkbox, 2nd is optional) and you're done! Just upload it to your site of choice.

Source: YouTube, Ambisonics, and VR

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.