Popular open-source streaming software OBS Studio is getting some new features, including AI-powered virtual backgrounds from Nvidia Broadcast that allow you to change your virtual environment without using a green screen.
Previously, it was possible to use a virtual green screen in OBS via plugins, but Nvidia Broadcast will make the feature much more accessible. Those who use an Nvidia RTX graphics card could probably already have the software installed (unless you are on Linux), and Nvidia Broadcast also integrates with lots of popular streaming hardware and applications.
Nvidia Broadcast is only available for Windows, but the Video and Audio AI SDKs it uses are available for Linux too, but not yet public...
There are other non-Nvidia Broadcast features coming to the service, such as support for high-efficiency video coding (HEVC or H.265) and high-dynamic range (HDR). macOS/Linux support get limited support.
From Nvidia's site: With OBS version 28, you can stream with HEVC to platforms that support it. HEVC is an improved codec that provides 15% better encoding efficiency than H.264 (i.e. it provides quality as if you streamed with 15% more bitrate). HEVC - and OBS version 28 - also allow you to record and stream HDR content. NVENC is NVIDIA’s encoder. It’s a physical section of our GPUs that is dedicated to encoding only. This means that your GPU can operate normally regardless of whether you use this region to stream or record. Other encoders, such as x264, use your CPU to encode, which takes resources away from other programs such as your game. That’s why using NVENC allows you to play games at a higher framerate and avoid stuttering, giving you and your viewers a better experience.
The encoding side should work fine on Linux as well, as I see it active on my Manjaro Linux machine.
See Nvidia Broadcast support will make virtual green screens easier in OBS Studio
OBS Studio is getting support for AI-powered virtual backgrounds from Nvidia broadcast, so Nvidia RTX GPU users can ditch the plug-ins.