Rockchip RK3588 and RK3576 H.264 and H.265 Video Decoders Gain Mainline Linux Support

Key Takeaways

• 17 patches add H.264/H.265 decoder support
• New V4L2 controls handle short‑term and long‑term RPS
• IOMMU reset bug fixed, preserving address mappings
• Struct‑based register writes ensure ordering, multi‑core readiness
• Support slated for Linux 7.1, expanding open‑source options

Pulse Analysis

The Rockchip RK3588 and RK3576 system‑on‑chips have become staples in high‑performance embedded platforms, but developers have long been forced to rely on the vendor’s board support package for video acceleration. Collabora’s upstream contribution changes that dynamic by delivering native H.264 and H.265 decoding directly in the Linux kernel. By moving the decoder drivers into mainline, manufacturers can now ship products with a fully open‑source stack, reducing firmware licensing hurdles and simplifying long‑term maintenance.

Technically, the patch series introduces a suite of V4L2 user‑space API extensions that expose explicit short‑term and long‑term reference picture set (RPS) handling, a requirement for the VDPU381 and VDPU383 hardware. An obscure IOMMU reset issue—where the kernel mistakenly assumed address mappings remained valid after a decoder reset—has been corrected, safeguarding both video and other IP blocks like the RGA graphics accelerator. Additionally, the driver now uses a struct‑based register programming model, guaranteeing correct write ordering and paving the way for future multi‑core decoder implementations.

The broader ecosystem stands to benefit immediately. GStreamer 1.28 already integrates the new controls, and a preliminary FFmpeg implementation is available, meaning developers can leverage familiar multimedia frameworks without custom patches. Compatibility with Vulkan Video Decode further expands hardware‑accelerated use cases, from media players to AI‑enhanced video pipelines. Looking ahead, Collabora plans multi‑core support, AV1 and VP9 decoding, and extensions to other Rockchip decoder families, positioning the RK3588/RK3576 platform as a truly open and future‑proof solution for video‑intensive applications.