Normal videos can be edited easily by any video editor, but immersive videos need special handling. At a minimum, the edited videos need to be injected with metadata, and videos that contain spatial audio need to have the audio extracted and preserved during an edit.
For example, the Facebook 360 audio format (TBE8.2) is 8 channels of audio plus an optional 2 channels of headlocked audio. The .mkv container supports many channels per track, but .mp4 containers support a maximum of 4 per track. This means that the .mp4 files that are uploaded to Meta Quest Media Studio have 10 channels split into a 4+4+2 arrangement. It’s possible to import a video file with audio in this format into a tool such as Adobe Premiere Pro and hack a way to export spatial audio and headlocked audio separately, but it is better to extract the audio and treat it like new masters. Here is an overview of the full process:
- Extract spatial audio and headlocked audio
- Put the video and extracted audio on a timeline in Adobe Premiere Pro or another NLE that supports multichannel audio tracks
- Do your edit
- Export video, spatial audio, and headlocked tracks separately
- Use FB360 Encoder to encode audio, mux, and tag with appropriate metadata