Releases: intel/cartwheel-ffmpeg
Releases · intel/cartwheel-ffmpeg
Intel ffmpeg patches upstream 2024q1 queue
FFmpeg-vaapi and FFmpeg-qsv upstream patches commits tested:
- cartwheel-ffmpeg: https://github.com/intel/cartwheel-ffmpeg/releases/tag/2024q1 (tag: 2024q1)
Supported Intel Platforms:
- ATS-M
- DG2
- RPL-S (Raptor Lake-S/P)
- ADL-S (Alder Lake-S/P/N)
- SG1/DG1
- RKL (Rocket Lake)
- TGL (Tiger Lake)
- ICL (Ice Lake)
- JSL (Jasper Lake)/EHL (Elkhart Lake)
- CFLx (CFL/Coffee Lake; WHL/Whiskey Lake; CML/Comet Lake; AML/Amber Lake)
Tested Features:
- Decode: AVC/H264, HEVC/H265 (8/10/12bit), AV1 (8/10bit), VP9 (8/10/12bit), VP8, JPEG/MJPEG, MPEG2
- Encode: AV1 (8/10), AVC/H264, HEVC/H265 (8/10/12bit), VP9 (8/10bit), VP8, JPEG/MJPEG, MPEG2
- VPP: procamp (brightness/contrast/saturation/hue), csc, deinterlace, denoise, scale, sharpen, mirroring, rotation, transpose
Supported Features among Intel platforms:
For features supported on each Intel platform, please refer to links below:
- decode/encode features: https://github.com/intel/media-driver/#decodingencoding-features
- VPP features: https://github.com/intel/media-driver/#video-processing-features
Build configures
FFmpeg build configure:
- #./configure --prefix=$ROOT_INSTALL_DIR --enable-shared --enable-vaapi --enable-libvpl
- #make
- #make install
Reference Configure Used: Intel Libva/iHD driver, MediaSDK, oneVPL and oneVPL GPU Runtime
- VPL Dispatcher: https://github.com/intel/libvpl/releases/tag/v2.10.2
- VPL Runtime: https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-24.1.5
- Media SDK: Intel-Media-SDK/MediaSDK@7a72de3
- Media driver: https://github.com/intel/media-driver/releases/tag/intel-media-24.1.5
- Libva: https://github.com/intel/libva/releases/tag/2.21.0
- Libva-utils: https://github.com/intel/libva-utils/releases/tag/2.21.0
- Gmmlib: https://github.com/intel/gmmlib/releases/tag/intel-gmmlib-22.3.18
Binary:
these components binary of media stack (LibVA/iHD/VPL/GmmLib) can be found from https://github.com/intel/libvpl/releases/tag/v2.10.2
Contactors:
Please contact [email protected], if you have any question.
New Detail
2024Q1:
- Added new ffmpeg-raisr filter, which can be used by content creators and broadcasters to transform older content or user generated content created in non-digital and pre-high-definition (HD) formats into today's HD and 4K formats for use with NAS, Streaming and Video-on-Demand services
- ffmpeg-dnn added support of libtorch as dnn backend
- ffmpeg-vaapi added support of BLBRC(Block level bitrate control), which assigns different bitrate block by block
- ffmpeg-qsv changed default BRC mode to CQP
- ffmpeg added d3d12va encoder
- cartwheel-ffmpeg patches supported the latest ffmpeg 6.1.1 release
2023Q3:
- ffmpeg-vaapi and qsv support dynamic frame buffer pool for vpp and decode instead of using fixed number buffer
- ffmpeg-dnn: add scale and layout options to do pre/post-processing for openvino
- ffmpeg-dnn: add multi-frame support for libtorch to support BasicVSR, BasicVSR++ and RVRT
2023Q2:
- ffmpeg-vaapi added passthrough mode for lavfi/{denoise, procamp, scale, sharpness}_vaapi filters
- ffmpeg-vaapi/qsv add auto hwmap filter
- ffmpeg-qsv add openvino2.0 support
2023Q1:
FFmpeg:
- ffmpeg-qsv and ffmpeg-vaapi added hstack_qsv, vstack_qsv and xstack_qsv filter support
- ffmpeg-qsv and ffmpeg-vaapi added gopconcat bsf support. This filter will concat gop from different streams to make a new stream, which helps to run encoder on multi-gpu platform
- ffmpeg-vaapi support RGB* format clips for vp9 decode
2022Q4:
- ffmpeg added new RPL-P platform support
- ffmpeg added new ADL-N platform support
- ffmpeg-qsv added av1 encode adaptive_i/b support
- ffmpeg-qsv added hevc encode support HDR info support
- ffmpeg-qsv added hevc encode 12bit (p012, y212, xv36) support
- ffmpeg-qsv decoder support to ouput hdr info
- ffmpeg-qsv change gop option to ”open“ by default
- ffmpeg-qsv added vpp_qsv scale mode can be applied to color conversion
- ffmpeg-qsv added vpp_qsv support p010 system memory input
- ffmpeg-vaapi refined overlay vaapi filter and added more options like framesync
- ffmpeg-vaapi added hevc encode 12bit (p012, y212, xv36) support
2022Q3:
- FFmpeg added new RPL-S platform support
- ffmpeg-vaapi added av1 encode support
- ffmpeg-vaapi can select related hw codec to do decode automatically, a example cmd line for decode "ffmpeg -hwccel vaapi -i av1.mp4 -f null -"
- ffmpeg-qsv h265 encode added adaptive_i/b support
- ffmpeg-qsv vpp scaling add model select through oneVPL which supports EU, VDBOX or VEBOX. User can use option of "scale_mode" to select which hardware model
- ffmpeg dnn: OpenVINO full GPU detect and classify support
- ffmpeg dnn: enabled libtorch as one of FFmpeg DNN backend
2022Q2:
- ffmpeg-vaapi added VDSFC Scaling support
- ffmpeg-vaapi added max_frame_size for encode
- ffmpeg-vaapi added GPB frame support for encode
- ffmpeg-qsv added adaptive_i and adaptive_b support for hevc encode
- ffmpeg-qsv added min/max qp control for I/P/B frames
- ffmpeg-qsv added ROI support for h264/h265 encode
- ffmpeg-qsv supported yuyv422/y210 format direct input mode for encode
- ffmpeg added gaussian filter through Vulkan
- ffmpeg added stitching filter through libxcam library
- ffmpeg video analysis added BasicVSR super resolution support
- ffmpeg video analysis added FRVSR super resolution
2022Q1:
- ffmpeg_qsv added av1 encode support
- supported av1 decode frame split bsf feature in ffmpeg core
- fixed a hevc 10bit run2run issue on some legacy platforms for ffmpeg_qsv
2021Q4:
- buffer sharing between media and vulkan
- support 0YUV, YUY2, Y210, Y410, P012, Y212, Y412 on Windows when using d3d11 device
- hevc main10 sp encoding
Intel ffmpeg patches upstream 2023q4 queue
ffmpeg-vaapi and ffmpeg-qsv upstream patches commits tested:
- cartwheel-ffmpeg: https://github.com/intel/cartwheel-ffmpeg/releases/tag/2023q4 (tag: 2023q4)
Supported Intel Platforms:
- MTL (Meteor Lake)
- ATS-M (Arctic Sound)
- DG2 (Discrete Graphics 2)
- RPL (Raptor Lake-S/P)
- ADL-S (Alder Lake-S/P/N)
- SG1/DG1
- RKL (Rocket Lake)
- TGL (Tiger Lake)
- ICL (Ice Lake)
- JSL (Jasper Lake)/EHL (Elkhart Lake)
- KBLx (KBL/Kaby Lake; CFL/Coffee Lake; WHL/Whiskey Lake; CML/Comet Lake; AML/Amber Lake)
Tested Features:
- Decode: AVC/H264, HEVC/H265 (8, 10, 12bit), AV1 (8, 10bit), VP9 (8/10/12bit), VP8, JPEG/MJPEG, MPEG2
- Encode: AV1(8, 10bit), AVC/H264, HEVC/H265 (8, 10bit), VP9 (8, 10bit), VP8, JPEG/MJPEG, MPEG2
- VPP: procamp (brightness/contrast/saturation/hue), csc, deinterlace, denoise, scale, sharpen, mirroring, rotation, transpose
Supported Features among Intel platforms:
For features supported on each Intel platform, please refer to links below:
- decode/encode features: https://github.com/intel/media-driver/#decodingencoding-features
- VPP features: https://github.com/intel/media-driver/#video-processing-features
Build configures
FFmpeg build configure:
- #./configure --prefix=$ROOT_INSTALL_DIR --enable-shared --enable-vaapi --enable-libvpl
- #make
- #make install
Reference Configure Used: Intel Libva/iHD driver, MediaSDK, VPL and VPL GPU Runtime
- VPL Dispatcher: https://github.com/intel/libvpl/commits/v2023.4.0/
- VPL Runtime: https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-23.4.3
- Media SDK: Intel-Media-SDK/MediaSDK@7a72de3
- Media driver: https://github.com/intel/media-driver/commits/intel-media-23.4.3/
- Libva: https://github.com/intel/libva/releases/tag/2.20.0
- Libva-utils: https://github.com/intel/libva-utils/commits/2.20.1
- Gmmlib: https://github.com/intel/gmmlib/commits/intel-gmmlib-22.3.15/
Binary:
these components binary of media stack (LibVA/iHD/VPL/GmmLib) can be found from https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-23.4.3
Contactors:
Please contact [email protected], if you have any question.
New Detail
2023Q4:
- FFmpeg added Intel new MTL platform support
- ffmpeg-dnn added support of openvino yolov1 v2 v3 v4
- ffmpeg-dnn added support of SSD model with two outputs tensors
- ffmpeg-dnn added support of model with dynamic output tensor shape
- ffmpeg-dnn libtorch backend added support for using multi-devices to accelerate inference
- both ffmpeg-vaapi and ffmpeg-qsv can use user-specified card on multi-gpu platform (such as dGPU+iGPU configure)
- ffmpeg-vaapi and ffmpeg-qsv added icq encode mode support
2023Q3:
- ffmpeg-vaapi and qsv support dynamic frame buffer pool for vpp and decode instead of using fixed number buffer
- ffmpeg-dnn: add scale and layout options to do pre/post-processing for openvino
- ffmpeg-dnn: add multi-frame support for libtorch to support BasicVSR, BasicVSR++ and RVRT
2023Q2:
- ffmpeg-vaapi added passthrough mode for lavfi/{denoise, procamp, scale, sharpness}_vaapi filters
- ffmpeg-vaapi/qsv add auto hwmap filter
- ffmpeg-qsv add openvino2.0 support
2023Q1:
FFmpeg:
- ffmpeg-qsv and ffmpeg-vaapi added hstack_qsv, vstack_qsv and xstack_qsv filter support
- ffmpeg-qsv and ffmpeg-vaapi added gopconcat bsf support. This filter will concat gop from different streams to make a new stream, which helps to run encoder on multi-gpu platform
- ffmpeg-vaapi support RGB* format clips for vp9 decode
2022Q4:
- ffmpeg added new RPL-P platform support
- ffmpeg added new ADL-N platform support
- ffmpeg-qsv added av1 encode adaptive_i/b support
- ffmpeg-qsv added hevc encode support HDR info support
- ffmpeg-qsv added hevc encode 12bit (p012, y212, xv36) support
- ffmpeg-qsv decoder support to ouput hdr info
- ffmpeg-qsv change gop option to ”open“ by default
- ffmpeg-qsv added vpp_qsv scale mode can be applied to color conversion
- ffmpeg-qsv added vpp_qsv support p010 system memory input
- ffmpeg-vaapi refined overlay vaapi filter and added more options like framesync
- ffmpeg-vaapi added hevc encode 12bit (p012, y212, xv36) support
2022Q3:
- FFmpeg added new RPL-S platform support
- ffmpeg-vaapi added av1 encode support
- ffmpeg-vaapi can select related hw codec to do decode automatically, a example cmd line for decode "ffmpeg -hwccel vaapi -i av1.mp4 -f null -"
- ffmpeg-qsv h265 encode added adaptive_i/b support
- ffmpeg-qsv vpp scaling add model select through oneVPL which supports EU, VDBOX or VEBOX. User can use option of "scale_mode" to select which hardware model
- ffmpeg dnn: OpenVINO full GPU detect and classify support
- ffmpeg dnn: enabled libtorch as one of FFmpeg DNN backend
2022Q2:
- ffmpeg-vaapi added VDSFC Scaling support
- ffmpeg-vaapi added max_frame_size for encode
- ffmpeg-vaapi added GPB frame support for encode
- ffmpeg-qsv added adaptive_i and adaptive_b support for hevc encode
- ffmpeg-qsv added min/max qp control for I/P/B frames
- ffmpeg-qsv added ROI support for h264/h265 encode
- ffmpeg-qsv supported yuyv422/y210 format direct input mode for encode
- ffmpeg added gaussian filter through Vulkan
- ffmpeg added stitching filter through libxcam library
- ffmpeg video analysis added BasicVSR super resolution support
- ffmpeg video analysis added FRVSR super resolution
2022Q1:
- ffmpeg_qsv added av1 encode support
- supported av1 decode frame split bsf feature in ffmpeg core
- fixed a hevc 10bit run2run issue on some legacy platforms for ffmpeg_qsv
2021Q4:
- buffer sharing between media and vulkan
- support 0YUV, YUY2, Y210, Y410, P012, Y212, Y412 on Windows when using d3d11 device
- hevc main10 sp encoding
Intel ffmpeg patches upstream 2023q3 queue
FFmpeg-vaapi and FFmpeg-qsv upstream patches commits tested:
- cartwheel-ffmpeg: https://github.com/intel/cartwheel-ffmpeg/releases/tag/2023q3 (tag: 2023q3)
Supported Intel Platforms:
- ATS-M
- DG2
- RPL-S (Raptor Lake-S/P)
- ADL-S (Alder Lake-S/P/N)
- SG1/DG1
- RKL (Rocket Lake)
- TGL (Tiger Lake)
- ICL (Ice Lake)
- JSL (Jasper Lake)/EHL (Elkhart Lake)
- KBLx (KBL/Kaby Lake; CFL/Coffee Lake; WHL/Whiskey Lake; CML/Comet Lake; AML/Amber Lake)
Tested Features:
- Decode: AVC/H264, HEVC/H265 (8, 10, 12bit), AV1 (8, 10bit), VP9 (8, 10, 12bit), VP8, JPEG/MJPEG, MPEG2
- Encode: AV1(8, 10bit), AVC/H264, HEVC/H265 (8, 10bit), VP9 (8, 10bit), VP8, JPEG/MJPEG, MPEG2
- VPP: procamp (brightness/contrast/saturation/hue), csc, deinterlace, denoise, scale, sharpen, mirroring, rotation, transpose
Supported Features among Intel platforms:
For features supported on each Intel platform, please refer to links below:
- decode/encode features: https://github.com/intel/media-driver/#decodingencoding-features
- VPP features: https://github.com/intel/media-driver/#video-processing-features
Build configures
FFmpeg build configure:
- #./configure --prefix=$ROOT_INSTALL_DIR --enable-shared --enable-vaapi --enable-libvpl
- #make
- #make install
Reference Configure Used: Intel Libva/iHD driver, MediaSDK, oneVPL and oneVPL GPU Runtime
- VPL Dispatcher: https://github.com/oneapi-src/oneVPL/releases/tag/v2023.3.1
- VPL Runtime: https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-23.3.4
- Media SDK: https://github.com/Intel-Media-SDK/MediaSDK/releases/tag/intel-mediasdk-23.2.2
- Media driver: https://github.com/intel/media-driver/releases/tag/intel-media-23.3.5
- Libva: https://github.com/intel/libva/releases/tag/2.20.0
- Libva-utils: https://github.com/intel/libva-utils/releases/tag/2.20.0
- Gmmlib: https://github.com/intel/gmmlib/releases/tag/intel-gmmlib-22.3.12
Binary:
these components binary of media stack (LibVA/iHD/OneVPL/GmmLib) can be found from https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-23.3.4
Contactors:
Please contact [email protected], if you have any question.
New Detail
2023Q3:
- ffmpeg-vaapi and qsv support dynamic frame buffer pool for vpp and decode instead of using fixed number buffer
- ffmpeg-dnn: add scale and layout options to do pre/post-processing for openvino
- ffmpeg-dnn: add multi-frame support for libtorch to support BasicVSR, BasicVSR++ and RVRT
2023Q2:
- ffmpeg-vaapi added passthrough mode for lavfi/{denoise, procamp, scale, sharpness}_vaapi filters
- ffmpeg-vaapi/qsv add auto hwmap filter
- ffmpeg-qsv add openvino2.0 support
2023Q1:
FFmpeg:
- ffmpeg-qsv and ffmpeg-vaapi added hstack_qsv, vstack_qsv and xstack_qsv filter support
- ffmpeg-qsv and ffmpeg-vaapi added gopconcat bsf support. This filter will concat gop from different streams to make a new stream, which helps to run encoder on multi-gpu platform
- ffmpeg-vaapi support RGB* format clips for vp9 decode
2022Q4:
- ffmpeg added new RPL-P platform support
- ffmpeg added new ADL-N platform support
- ffmpeg-qsv added av1 encode adaptive_i/b support
- ffmpeg-qsv added hevc encode support HDR info support
- ffmpeg-qsv added hevc encode 12bit (p012, y212, xv36) support
- ffmpeg-qsv decoder support to ouput hdr info
- ffmpeg-qsv change gop option to ”open“ by default
- ffmpeg-qsv added vpp_qsv scale mode can be applied to color conversion
- ffmpeg-qsv added vpp_qsv support p010 system memory input
- ffmpeg-vaapi refined overlay vaapi filter and added more options like framesync
- ffmpeg-vaapi added hevc encode 12bit (p012, y212, xv36) support
2022Q3:
- FFmpeg added new RPL-S platform support
- ffmpeg-vaapi added av1 encode support
- ffmpeg-vaapi can select related hw codec to do decode automatically, a example cmd line for decode "ffmpeg -hwccel vaapi -i av1.mp4 -f null -"
- ffmpeg-qsv h265 encode added adaptive_i/b support
- ffmpeg-qsv vpp scaling add model select through oneVPL which supports EU, VDBOX or VEBOX. User can use option of "scale_mode" to select which hardware model
- ffmpeg dnn: OpenVINO full GPU detect and classify support
- ffmpeg dnn: enabled libtorch as one of FFmpeg DNN backend
2022Q2:
- ffmpeg-vaapi added VDSFC Scaling support
- ffmpeg-vaapi added max_frame_size for encode
- ffmpeg-vaapi added GPB frame support for encode
- ffmpeg-qsv added adaptive_i and adaptive_b support for hevc encode
- ffmpeg-qsv added min/max qp control for I/P/B frames
- ffmpeg-qsv added ROI support for h264/h265 encode
- ffmpeg-qsv supported yuyv422/y210 format direct input mode for encode
- ffmpeg added gaussian filter through Vulkan
- ffmpeg added stitching filter through libxcam library
- ffmpeg video analysis added BasicVSR super resolution support
- ffmpeg video analysis added FRVSR super resolution
2022Q1:
- ffmpeg_qsv added av1 encode support
- supported av1 decode frame split bsf feature in ffmpeg core
- fixed a hevc 10bit run2run issue on some legacy platforms for ffmpeg_qsv
2021Q4:
- buffer sharing between media and vulkan
- support 0YUV, YUY2, Y210, Y410, P012, Y212, Y412 on Windows when using d3d11 device
- hevc main10 sp encoding
Intel ffmpeg patches upstream 2023q2 queue
FFmpeg-vaapi and FFmpeg-qsv upstream patches commits tested:
- cartwheel-ffmpeg: https://github.com/intel/cartwheel-ffmpeg/releases/tag/2023q2 (tag: 2023q2)
Supported Intel Platforms:
- ATS-M
- DG2
- RPL-S (Raptor Lake-S/P)
- ADL-S (Alder Lake-S/P/N)
- SG1/DG1
- RKL (Rocket Lake)
- TGL (Tiger Lake)
- ICL (Ice Lake)
- JSL (Jasper Lake)/EHL (Elkhart Lake)
- KBLx (KBL/Kaby Lake; CFL/Coffee Lake; WHL/Whiskey Lake; CML/Comet Lake; AML/Amber Lake)
Tested Features:
- Decode: AVC/H264, HEVC/H265 (8, 10, 12bit), AV1 (8, 10bit), VP9 (8, 10, 12bit), VP8, JPEG/MJPEG, MPEG2
- Encode: AV1(8, 10bit), AVC/H264, HEVC/H265 (8, 10bit), VP9 (8, 10bit), VP8, JPEG/MJPEG, MPEG2
- VPP: procamp (brightness/contrast/saturation/hue), csc, deinterlace, denoise, scale, sharpen, mirroring, rotation, transpose
Supported Features among Intel platforms:
For features supported on each Intel platform, please refer to links below:
- decode/encode features: https://github.com/intel/media-driver/#decodingencoding-features
- VPP features: https://github.com/intel/media-driver/#video-processing-features
Build configures
FFmpeg build configure:
- #./configure --prefix=$ROOT_INSTALL_DIR --enable-shared --enable-vaapi --enable-libvpl
- #make
- #make install
Reference Configure Used: Intel Libva/iHD driver, MediaSDK, oneVPL and oneVPL GPU Runtime
- Media driver: https://github.com/intel/media-driver/releases/tag/intel-media-23.2.4
- VPL Dispatcher: https://github.com/oneapi-src/oneVPL/releases/tag/v2023.3.0
- VPL Runtime: https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-23.2.4
- Media SDK: https://github.com/Intel-Media-SDK/MediaSDK/releases/tag/intel-mediasdk-23.2.2
- Libva: https://github.com/intel/libva/releases/tag/2.19.0
- Libva-utils: https://github.com/intel/libva-utils/releases/tag/2.19.0
- Gmmlib: https://github.com/intel/gmmlib/releases/tag/intel-gmmlib-22.3.7
Binary:
these components binary of media stack (LibVA/iHD/OneVPL/GmmLib) can be found from https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-23.2.4
Contactors:
Please contact [email protected], if you have any question.
New Detail
2023Q2:
- ffmpeg-vaapi added passthrough mode for lavfi/{denoise, procamp, scale, sharpness}_vaapi filters
- ffmpeg-vaapi/qsv add auto hwmap filter
- ffmpeg-qsv add openvino2.0 support
2023Q1:
FFmpeg:
- ffmpeg-qsv and ffmpeg-vaapi added hstack_qsv, vstack_qsv and xstack_qsv filter support
- ffmpeg-qsv and ffmpeg-vaapi added gopconcat bsf support. This filter will concat gop from different streams to make a new stream, which helps to run encoder on multi-gpu platform
- ffmpeg-vaapi support RGB* format clips for vp9 decode
2022Q4:
- ffmpeg added new RPL-P platform support
- ffmpeg added new ADL-N platform support
- ffmpeg-qsv added av1 encode adaptive_i/b support
- ffmpeg-qsv added hevc encode support HDR info support
- ffmpeg-qsv added hevc encode 12bit (p012, y212, xv36) support
- ffmpeg-qsv decoder support to ouput hdr info
- ffmpeg-qsv change gop option to ”open“ by default
- ffmpeg-qsv added vpp_qsv scale mode can be applied to color conversion
- ffmpeg-qsv added vpp_qsv support p010 system memory input
- ffmpeg-vaapi refined overlay vaapi filter and added more options like framesync
- ffmpeg-vaapi added hevc encode 12bit (p012, y212, xv36) support
2022Q3:
- FFmpeg added new RPL-S platform support
- ffmpeg-vaapi added av1 encode support
- ffmpeg-vaapi can select related hw codec to do decode automatically, a example cmd line for decode "ffmpeg -hwccel vaapi -i av1.mp4 -f null -"
- ffmpeg-qsv h265 encode added adaptive_i/b support
- ffmpeg-qsv vpp scaling add model select through oneVPL which supports EU, VDBOX or VEBOX. User can use option of "scale_mode" to select which hardware model
- ffmpeg dnn: OpenVINO full GPU detect and classify support
- ffmpeg dnn: enabled libtorch as one of FFmpeg DNN backend
2022Q2:
- ffmpeg-vaapi added VDSFC Scaling support
- ffmpeg-vaapi added max_frame_size for encode
- ffmpeg-vaapi added GPB frame support for encode
- ffmpeg-qsv added adaptive_i and adaptive_b support for hevc encode
- ffmpeg-qsv added min/max qp control for I/P/B frames
- ffmpeg-qsv added ROI support for h264/h265 encode
- ffmpeg-qsv supported yuyv422/y210 format direct input mode for encode
- ffmpeg added gaussian filter through Vulkan
- ffmpeg added stitching filter through libxcam library
- ffmpeg video analysis added BasicVSR super resolution support
- ffmpeg video analysis added FRVSR super resolution
2022Q1:
- ffmpeg_qsv added av1 encode support
- supported av1 decode frame split bsf feature in ffmpeg core
- fixed a hevc 10bit run2run issue on some legacy platforms for ffmpeg_qsv
2021Q4:
- buffer sharing between media and vulkan
- support 0YUV, YUY2, Y210, Y410, P012, Y212, Y412 on Windows when using d3d11 device
- hevc main10 sp encoding
Intel ffmpeg patches upstream 2023q1 queue
FFmpeg-vaapi and FFmpeg-qsv upstream patches commits tested:
- cartwheel-ffmpeg: https://github.com/intel/cartwheel-ffmpeg/releases/tag/2023q1 (tag: 2023q1)
Supported Intel Platforms:
- ATS-M
- DG2
- RPL-S (Raptor Lake-S/P)
- ADL-S (Alder Lake-S/P/N)
- SG1/DG1
- RKL (Rocket Lake)
- TGL (Tiger Lake)
- ICL (Ice Lake)
- JSL (Jasper Lake)/EHL (Elkhart Lake)
- KBLx (KBL/Kaby Lake; CFL/Coffee Lake; WHL/Whiskey Lake; CML/Comet Lake; AML/Amber Lake)
Tested Features:
- Decode: AVC/H264, HEVC/H265 (8, 10, 12bit), AV1 (8, 10bit), VP9 (8, 10, 12bit), VP8, JPEG/MJPEG, MPEG2, VC1
- Encode: AV1/AVC/H264, HEVC/H265 (8, 10bit), VP9 (8, 10bitt), VP8, JPEG/MJPEG, MPEG2
- VPP: procamp (brightness/contrast/saturation/hue), csc, deinterlace, denoise, scale, sharpen, mirroring, rotation, transpose
Supported Features among Intel platforms:
For features supported on each Intel platform, please refer to links below:
- decode/encode features: https://github.com/intel/media-driver/#decodingencoding-features
- VPP features: https://github.com/intel/media-driver/#video-processing-features
Build configures
FFmpeg build configure:
- #./configure --prefix=$ROOT_INSTALL_DIR --enable-shared --enable-vaapi --enable-libvpl
- #make
- #make install
Reference Configure Used: Intel Libva/iHD driver, MediaSDK, oneVPL and oneVPL GPU Runtime
- For detailed information about new features and improvements, please refer to links below:
- Media driver: https://github.com/intel/media-driver/releases/tag/intel-media-23.1.5
- VPL Dispatcher: https://github.com/oneapi-src/oneVPL/releases/tag/v2023.1.3
- VPL Runtime: https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-23.1.5
- Media SDK: https://github.com/Intel-Media-SDK/MediaSDK/releases/tag/intel-mediasdk-23.1.5
- Libva: https://github.com/intel/libva/releases/tag/2.18.0
- Libva-utils: https://github.com/intel/libva-utils/releases/tag/2.18.1
- Gmmlib: https://github.com/intel/gmmlib/releases/tag/intel-gmmlib-22.3.5
Binary:
these components binary of media stack (LibVA/iHD/OneVPL/GmmLib) can be found from https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-23.1.5
Contactors:
Please contact [email protected], if you have any question.
New Detail
2023Q1:
FFmpeg:
- ffmpeg-qsv and ffmpeg-vaapi added hstack_qsv, vstack_qsv and xstack_qsv filter support
- ffmpeg-qsv and ffmpeg-vaapi added gopconcat bsf support. This filter will concat gop from different streams to make a new stream, which helps to run encoder on multi-gpu platform
- ffmpeg-vaapi support RGB* format clips for vp9 decode
2022Q4:
- ffmpeg added new RPL-P platform support
- ffmpeg added new ADL-N platform support
- ffmpeg-qsv added av1 encode adaptive_i/b support
- ffmpeg-qsv added hevc encode support HDR info support
- ffmpeg-qsv added hevc encode 12bit (p012, y212, xv36) support
- ffmpeg-qsv decoder support to ouput hdr info
- ffmpeg-qsv change gop option to ”open“ by default
- ffmpeg-qsv added vpp_qsv scale mode can be applied to color conversion
- ffmpeg-qsv added vpp_qsv support p010 system memory input
- ffmpeg-vaapi refined overlay vaapi filter and added more options like framesync
- ffmpeg-vaapi added hevc encode 12bit (p012, y212, xv36) support
2022Q3:
- FFmpeg added new RPL-S platform support
- ffmpeg-vaapi added av1 encode support
- ffmpeg-vaapi can select related hw codec to do decode automatically, a example cmd line for decode "ffmpeg -hwccel vaapi -i av1.mp4 -f null -"
- ffmpeg-qsv h265 encode added adaptive_i/b support
- ffmpeg-qsv vpp scaling add model select through oneVPL which supports EU, VDBOX or VEBOX. User can use option of "scale_mode" to select which hardware model
- ffmpeg dnn: OpenVINO full GPU detect and classify support
- ffmpeg dnn: enabled libtorch as one of FFmpeg DNN backend
2022Q2:
- ffmpeg-vaapi added VDSFC Scaling support
- ffmpeg-vaapi added max_frame_size for encode
- ffmpeg-vaapi added GPB frame support for encode
- ffmpeg-qsv added adaptive_i and adaptive_b support for hevc encode
- ffmpeg-qsv added min/max qp control for I/P/B frames
- ffmpeg-qsv added ROI support for h264/h265 encode
- ffmpeg-qsv supported yuyv422/y210 format direct input mode for encode
- ffmpeg added gaussian filter through Vulkan
- ffmpeg added stitching filter through libxcam library
- ffmpeg video analysis added BasicVSR super resolution support
- ffmpeg video analysis added FRVSR super resolution
2022Q1:
- ffmpeg_qsv added av1 encode support
- supported av1 decode frame split bsf feature in ffmpeg core
- fixed a hevc 10bit run2run issue on some legacy platforms for ffmpeg_qsv
2021Q4:
- buffer sharing between media and vulkan
- support 0YUV, YUY2, Y210, Y410, P012, Y212, Y412 on Windows when using d3d11 device
- hevc main10 sp encoding
Intel ffmpeg patches upstream 2022q4 queue
Supported Intel Platforms:
- ATS-M
- DG2
- RPL-S (Raptor Lake-S/P)
- ADL-S (Alder Lake-S/P/N)
- SG1/DG1
- RKL (Rocket Lake)
- TGL (Tiger Lake)
- ICL (Ice Lake)
- JSL (Jasper Lake)/EHL (Elkhart Lake)
- KBLx (KBL/Kaby Lake; CFL/Coffee Lake; WHL/Whiskey Lake; CML/Comet Lake; AML/Amber Lake)
Tested Features:
- Decode: AVC/H264, HEVC/H265 (8, 10, 12bit), AV1 (8, 10bit), VP9 (8, 10, 12bit), VP8, JPEG/MJPEG, MPEG2, VC1
- Encode: AV1/AVC/H264, HEVC/H265 (8, 10bit), VP9 (8, 10bitt), VP8, JPEG/MJPEG, MPEG2
- VPP: procamp (brightness/contrast/saturation/hue), csc, deinterlace, denoise, scale, sharpen, mirroring, rotation, transpose
Supported Features among Intel platforms:
For features supported on each Intel platform, please refer to links below:
- decode/encode features: https://github.com/intel/media-driver/#decodingencoding-features
- VPP features: https://github.com/intel/media-driver/#video-processing-features
Reference Configure Used: Intel Libva/iHD driver, MediaSDK, oneVPL and oneVPL GPU Runtime
- For detailed information about new features and improvements, please refer to links below:
- Media driver: https://github.com/intel/media-driver/releases/tag/intel-media-22.6.6
- VPL Dispatcher: https://github.com/oneapi-src/oneVPL/releases/tag/v2023.1.0
- VPL Runtime: https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-22.6.5
- Media SDK: https://github.com/Intel-Media-SDK/MediaSDK/releases/tag/intel-mediasdk-22.6.5
- Libva: https://github.com/intel/libva/releases/tag/2.17.0
- Libva-utils: https://github.com/intel/libva-utils/releases/tag/2.16.0
- Gmmlib: https://github.com/intel/gmmlib/releases/tag/intel-gmmlib-22.3.3
Contactors:
Please contact [email protected] or [email protected] or [email protected] or [email protected], if you have any question.
New Detail
2022Q4:
- ffmpeg added new RPL-P platform support
- ffmpeg added new ADL-N platform support
- ffmpeg-qsv added av1 encode adaptive_i/b support
- ffmpeg-qsv added hevc encode support HDR info support
- ffmpeg-qsv added hevc encode 12bit (p012, y212, xv36) support
- ffmpeg-qsv decoder support to ouput hdr info
- ffmpeg-qsv change gop option to ”open“ by default
- ffmpeg-qsv added vpp_qsv scale mode can be applied to color conversion
- ffmpeg-qsv added vpp_qsv support p010 system memory input
- ffmpeg-vaapi refined overlay vaapi filter and added more options like framesync
- ffmpeg-vaapi added hevc encode 12bit (p012, y212, xv36) support
2022Q3:
- FFmpeg added new RPL-S platform support
- ffmpeg-vaapi added av1 encode support
- ffmpeg-vaapi can select related hw codec to do decode automatically, a example cmd line for decode "ffmpeg -hwccel vaapi -i av1.mp4 -f null -"
- ffmpeg-qsv h265 encode added adaptive_i/b support
- ffmpeg-qsv vpp scaling add model select through oneVPL which supports EU, VDBOX or VEBOX. User can use option of "scale_mode" to select which hardware model
- ffmpeg dnn: OpenVINO full GPU detect and classify support
- ffmpeg dnn: enabled libtorch as one of FFmpeg DNN backend
2022Q2:
- ffmpeg-vaapi added VDSFC Scaling support
- ffmpeg-vaapi added max_frame_size for encode
- ffmpeg-vaapi added GPB frame support for encode
- ffmpeg-qsv added adaptive_i and adaptive_b support for hevc encode
- ffmpeg-qsv added min/max qp control for I/P/B frames
- ffmpeg-qsv added ROI support for h264/h265 encode
- ffmpeg-qsv supported yuyv422/y210 format direct input mode for encode
- ffmpeg added gaussian filter through Vulkan
- ffmpeg added stitching filter through libxcam library
- ffmpeg video analysis added BasicVSR super resolution support
- ffmpeg video analysis added FRVSR super resolution
2022Q1:
- ffmpeg_qsv added av1 encode support
- supported av1 decode frame split bsf feature in ffmpeg core
- fixed a hevc 10bit run2run issue on some legacy platforms for ffmpeg_qsv
2021Q4:
- buffer sharing between media and vulkan
- support 0YUV, YUY2, Y210, Y410, P012, Y212, Y412 on Windows when using d3d11 device
- hevc main10 sp encoding
DG2 FFMpeg 2022Q4 RC1 Release
Release detail please help to refer to https://github.com/intel-media-ci/cartwheel-ffmpeg/releases/tag/2022q3
Intel ffmpeg patches upstream 2022q3 queue
Supported Intel Platforms:
- ATS-M
- DG2
- RPL-S (Raptor Lake-S)
- ADL-S (Alder Lake-S)
- ADL-P (Alder Lake-P)
- DG1/SG1
- RKL (Rocket Lake)
- TGL (Tiger Lake)
- ICL (Ice Lake)
- JSL (Jasper Lake)/EHL (Elkhart Lake)
- KBLx (KBL/Kaby Lake; CFL/Coffee Lake; WHL/Whiskey Lake; CML/Comet Lake; AML/Amber Lake)
Tested Features:
- Decode: AVC/H264, HEVC/H265 (8, 10, 12bit), AV1 (8, 10bit), VP9 (8, 10, 12bit), VP8, JPEG/MJPEG, MPEG2, VC1
- Encode: AV1/AVC/H264, HEVC/H265 (8, 10bit), VP9 (8, 10bitt), VP8, JPEG/MJPEG, MPEG2
- VPP: procamp (brightness/contrast/saturation/hue), csc, deinterlace, denoise, scale, sharpen, mirroring, rotation, transpose
Supported Features among Intel platforms:
For features supported on each Intel platform, please refer to links below:
- decode/encode features: https://github.com/intel/media-driver/#decodingencoding-features
- VPP features: https://github.com/intel/media-driver/#video-processing-features
Reference Configure Used: Intel Libva/iHD driver, MediaSDK, oneVPL and oneVPL GPU Runtime
- For detailed information about new features and improvements, please refer to links below:
- Media driver: https://github.com/intel/media-driver/releases/tag/intel-media-22.5.4
- VPL Dispatcher: https://github.com/oneapi-src/oneVPL/releases/tag/v2022.2.2
- VPL Runtime: https://github.com/oneapi-src/oneVPL-intel-gpu/releases/tag/intel-onevpl-22.5.4
- Media SDK: Intel-Media-SDK/MediaSDK@070e7de
- Libva: https://github.com/intel/libva/releases/tag/2.16.0
- Libva-utils: https://github.com/intel/libva-utils/releases/tag/2.16.0
- Gmmlib: https://github.com/intel/gmmlib/releases/tag/intel-gmmlib-22.2.0
Contactors:
Please contact [email protected] or [email protected] or [email protected] or [email protected], if you have any question.
New Detail
2022Q3:
- FFmpeg added new RPL-S platform support
- ffmpeg-vaapi added av1 encode support
- ffmpeg-vaapi can select related hw codec to do decode automatically, a example cmd line for decode "ffmpeg -hwccel vaapi -i av1.mp4 -f null -"
- ffmpeg-qsv h265 encode added adaptive_i/b support
- ffmpeg-qsv vpp scaling add model select through oneVPL which supports EU, VDBOX or VEBOX. User can use option of "scale_mode" to select which hardware model
- ffmpeg dnn: OpenVINO full GPU detect and classify support
- ffmpeg dnn: enabled libtorch as one of FFmpeg DNN backend
2022Q2:
- ffmpeg-vaapi added VDSFC Scaling support
- ffmpeg-vaapi added max_frame_size for encode
- ffmpeg-vaapi added GPB frame support for encode
- ffmpeg-qsv added adaptive_i and adaptive_b support for hevc encode
- ffmpeg-qsv added min/max qp control for I/P/B frames
- ffmpeg-qsv added ROI support for h264/h265 encode
- ffmpeg-qsv supported yuyv422/y210 format direct input mode for encode
- ffmpeg added gaussian filter through Vulkan
- ffmpeg added stitching filter through libxcam library
- ffmpeg video analysis added BasicVSR super resolution support
- ffmpeg video analysis added FRVSR super resolution
2022Q1:
- ffmpeg_qsv added av1 encode support
- supported av1 decode frame split bsf feature in ffmpeg core
- fixed a hevc 10bit run2run issue on some legacy platforms for ffmpeg_qsv
2021Q4:
- buffer sharing between media and vulkan
- support 0YUV, YUY2, Y210, Y410, P012, Y212, Y412 on Windows when using d3d11 device
- hevc main10 sp encoding
Intel FFmpeg RPL-S Q3 Release Patch Upstream Queue RC1
Intel FFmpeg RPL-S Q3 Release Patch Upstream Queue RC1
Intel FFmpeg ATS-M Q3 Release Patch Upstream Queue RC1
Intel FFmpeg ATS-M Q3 Release Patch Upstream Queue RC1