Encoding video using streaming with multiple codecs can double the video quality, reduce bandwidth consumption, and maximize device coverage.

Current State of Codecs

H.264, also known as AVC, is currently the most widely used codec in online video. Almost every device and operating system supports hardware or software decoding. But while this compression technology is widely supported, it is far from the most efficient codec available in terms of compression ratio. Next-generation codecs such as VP9 and H.265, also known as HEVC, have been proven to deliver up to 50% bitrate savings over H.264. Once the AV1 hits the commercial market, it will likely offer an additional 30% savings.

Challenges of Using Next Generation Codecs

The challenge for the next generation codecs (HEVC, VP9 and AV1) lies in their limited browser support. HEVC is supported on Apple devices equipped with iOS 11 and macOS High Sierra, as well as most 4K SmartTVs and Microsoft Edge for Windows 10 (when the device has a hardware decoder). VP9 is supported on Google Chrome, Firefox, Microsoft Edge, and Android devices. This split support situation has resulted in many content providers using H.264 by default to provide full platform coverage.

How Streaming Works with Multiple Codecs

Multi-codec streaming allows you to switch between codecs based on the user’s platform capabilities, maximizing video streaming quality and bandwidth efficiency, improving QoE and reducing CDN solutions costs.

Multi-Codec Workflow

At a high level, OTT streaming with multiple codecs is a simple concept. The player determines the capabilities of the viewer’s platform and streams the video according to the system in which it is played.
The first stage in the multi-codec workflow requires encoding each video into all of the codecs that you wish to support. In most cases this will be H.264, HEVC and VP9, however AV1 is already available and will soon be commercially viable.
The first step in the multi-codec workflow requires you to encode each video into all the codecs you want to support. In most cases these will be H.264, HEVC and VP9, ​​however AV1 is already available.
Once encoding is complete, adaptive bitrate packets are moved to your storage system, where they are immediately available for streaming. The manifest file of a multi-codec adaptive package contains information for the player that tells it what codecs are available. Every time a user clicks the play button, player analyzes their system and selects a stream encoded with the most efficient codec for their device and platform.