Software tools for VR media production

In many cases, standard video editing software can be used for VR media production, but specialized software is often required. This guide will help.

In many cases, standard video and audio editing software can be used for VR media production. General editing software like Adobe’s Premiere Pro and Blackmagic’s DaVinci Resolve Studio are commonly used for immersive video editing, but for some focused tasks such as custom stitching and spatial audio design, specialty software is required.

The following summaries should help clarify the basic abilities of various software tools that are frequently used in this industry (inclusion in this list is not an endorsement). If you’re still unsure whether something is right for you, download a trial or demo version and spend a little time familiarizing yourself with its quirks and capabilities.

General purpose video editing software (in some cases, they can be used for the whole production workflow including color grading, VFX, and audio mixing).

Kind

Non-linear video editor

Platforms

macOS, Windows

Summary

Premiere Pro is video editing software with a wide range of features including editing, audio mixing, and color grading. It integrates with other Adobe products such as After Effects and Photoshop, and it is available as part of Adobe's Creative Cloud subscription.

Kind

Non-linear video editor

Platforms

macOS

Summary

Final Cut Pro is video editing software with a wide range of tools and features for editing, color grading, and sound mixing. It integrates with other Apple products, such as Motion and Compressor, to enhance workflow.

Kind

Non-linear video editor

Platforms

macOS, Windows, Linux

Summary

DaVinci Resolve is a color grading, color correction, visual effects, and audio post-production video editing application. The free version of DaVinci Resolve is good for learning, but its maximum output resolution is 4K so use DaVinci Resolve Studio for VR content production.

Kind

Color grading and finishing

Platforms

macOS, Windows

Summary

Mistika Boutique is a post production tool set that includes finishing tools for conforming, VFX, color grading, and producing immersive media. Mistika Boutique Immersive Edition is available via several subscription options.

Specialized software for stitching and de-warping

Kind

Stereo fisheye conversion to 3D 180 video

Platforms

macOS, Windows

Summary

Subscription based standalone VR utility transforms video from Canon R5/R5C with RF Dual Fisheye Lens into stereoscopic equirectangular immersive video for playback in VR. At present only the macOS version can render ProRes.

Kind

Stereo fisheye conversion to 3D 180 video

Platforms

macOS, Windows

Summary

Subscription based VR plug-in for Adobe Premiere transforms video from Canon R5/R5C with RF Dual Fisheye Lens into stereoscopic equirectangular immersive video for playback in VR.

Kind

Stitcher and stabilizer

Platforms

macOS, Windows

Summary

Mistika VR is a professional standalone stitching tool capable of stitching any number of camera sources into equirectangular content. Subscription based Mistika VR generates 180 and 360 VR video in mono or stereo.

Kind

Lens conversions, projections and stabilization for 360 VR and fisheye footage

Platforms

macOS, Windows

Summary

RE:Lens is available as a plug-in to many professional video editing software products. The plug-in supports dewarping fisheye and wide angle lens distortion, and reframing dewarped video into virtual cameras with user defined FOV.

Kind

Dedicated stitching software

Platforms

macOS, Windows

Summary

Z CAM WonderStitch is an optical flow based stitching tool that performs offline stitching of video files from Z CAM cameras including the S1 Pro and the K1 Pro.

Kind

Compositing and motion graphics production

Platforms

macOS, Windows

Summary

After Effects is a powerful digital visual effects, motion graphics, and compositing application. It can enhance footage and add effects and graphics, and it allows 2D assets to be manipulated in a 3D space.

Kind

Planar Tracking, Rotoscoping, Object Removal, Image Stabilization

Platforms

macOS, Windows

Summary

Mocha Pro is available both as a set of Adobe, Avid and OFX plug-ins and as a standalone application. Its planar based tracking tools support complicated removal processes in both rectilinear and immersive video of moving rovers, tripods and practical elements on set, and generate rotoscoped masks for compositing.

Kind

Tracker and stabilizer

Platforms

macOS, Windows, Linux

Summary

SynthEyes is a standalone VFX application optimized for camera, object, geometry, and planar tracking, stabilization, and motion capture, with both 2D and 3d (stereoscopic) VR media.

Kind

Color grading, compositing, stabilization, object removal and finishing of immersive media

Platforms

macOS, Windows

Summary

Subscription based or fully licensed standalone tool provides VR aware compositing, color grading, object removal and replacement, previewed in headset, with support for ambisonic audio.

Kind

Ambisonic audio editing

Platforms

macOS, Windows

Summary

Plug-ins for editing 3D ambisonic audio in most DAWs. Includes support for positioning sounds in 3D scenes, adding 360 reverberation, setting ambisonic peak level, and rendering scenes to binaural audio. The ab Decoder Lite plugin is free.

Kind

Ambisonic audio editing

Platforms

macOS, Windows

Summary

Set of Noise Maker plug-ins for creating 3D ambisonic audio. Includes support for positioning sounds in 3D scenes, adding 360 reverberation, setting ambisonic peak level, and rendering scenes to binaural audio.

Kind

Digital audio workstation

Platforms

macOS

Summary

Logic Pro is a digital audio workstation with a wide range of tools and features for creating, editing, and mixing music and audio tracks. It supports various audio formats and can be used with a variety of external instruments and plugins.

Kind

Digital audio workstation

Platforms

macOS, Windows

Summary

Adobe Audition is a digital audio workstation used to create, mix, and edit audio tracks for a variety of media, including music, films, and podcasts. It offers a range of tools and features, including multitrack recording, spectral editing, and noise reduction.

Kind

Digital audio workstation

Platforms

macOS, Windows, Linux

Summary

Audacity is a free, open-source audio editor with a wide feature set that makes it a potential rival to Adobe Audition. It lacks direct support for working with immersive audio but it is useful for other areas of sound editing.

Kind

Digital audio workstation

Platforms

macOS, Windows

Summary

Full featured audio editing and processing suite with plug-in support for first, second and third order ambisonic audio

Kind

Spatial audio encoder

Platforms

macOS, Windows, Linux

Summary

Used to encode spatial audio and ‘mux’ immersive videos that can be uploaded to Meta Quest Media Studio for distribution via Meta Quest TV.

Kind

Digital audio workstation

Platforms

macOS, Windows

Summary

Reaper is a digital audio workstation with a wide range of tools and effects for sound processing. It supports multiple audio and MIDI tracks, as well as VST and AU plugins for extended functionality, and it offers flexible routing and automation options as well as support for multiple output formats.

Kind

Virtual analog synthesizer for sound effects

Platforms

macOS, Windows, Linux

Summary

Free synthesizer for processing audio tracks using presets and user defined controls.

Kind

Photo stitcher

Platforms

macOS, Windows

Summary

PTGui is the industry-leading photo stitching tool. It generates wide-format, cylindrical and spherical panoramic images from multiple shots, and it can produce ultra-high-resolution gigapixel panoramas as well as more normal headset-ready output. It can be somewhat technical for more complex stitching tasks, but it is capable of producing excellent results.

Kind

Open-source photo stitcher

Platforms

macOS, Windows, Linux

Summary

Hugin is a free open-source photo stitching tool. It generates wide-format, cylindrical and spherical panoramic images from multiple shots, and it can produce ultra-high-resolution gigapixel panoramas as well as more normal headset-ready output. It is complex and technical with a spartan interface, but it is capable of producing excellent results.

Kind

360 photo tour builder

Platforms

macOS, Windows

Summary

3DVista Virtual Tour Pro is a 360 photo tour builder with support for adding interaction behaviors and rich media elements including video hotspots, 360 video and 3D model assets. It can generate web tours with immersive VR browser support, and a 3DVista Quest app can be used for local headset playback.

Kind

360 photo tour builder

Platforms

macOS, Windows

Summary

KRPano is a 360 photo tour builder with extensive support for adding interaction behaviors and rich media elements including video hotspots and 360 video. It can generate web tours with VR headset support. Production beyond the basics involves working with XML files in a text editor.

Kind

360 photo tour builder

Platforms

macOS, Windows

Summary

Pano2VR is a 360 photo tour builder with support for adding interaction behaviors and rich media elements including video hotspots and 360 video. It can generate web tours with immersive VR browser support, and a Tourviewer app can be used for local headset playback. It can also generate reprojected images and custom animated video from 360 photos.