project('gstreamer-full', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62.0',
default_options : ['buildtype=debugoptimized',
# Needed due to https://github.com/mesonbuild/meson/issues/1889,
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-devtools 1.21.90.
+This is GStreamer gst-devtools 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-devtools/gst-devtools-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-devtools', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'c_std=gnu99',
project('GStreamer manuals and tutorials', 'c',
- version: '1.21.90',
+ version: '1.22.0',
meson_version : '>= 0.62')
hotdoc_p = find_program('hotdoc')
"GST_AUDIO_FORMAT_INFO_IS_INTEGER",
"GST_AUDIO_FORMAT_INFO_IS_LITTLE_ENDIAN",
"GST_AUDIO_FORMAT_INFO_IS_SIGNED",
+ "GST_AUDIO_FORMAT_INFO_IS_VALID_RAW",
"GST_AUDIO_FORMAT_INFO_NAME",
"GST_AUDIO_FORMAT_INFO_WIDTH",
"GST_AUDIO_FORMAT_S16",
"GST_CAT_INFO",
"GST_CAT_INFO_OBJECT",
"GST_CAT_LEVEL_LOG",
+ "GST_CAT_LEVEL_LOG_ID",
"GST_CAT_LOG",
"GST_CAT_LOG_OBJECT",
"GST_CAT_MEMDUMP",
+ "GST_CAT_MEMDUMP_ID",
"GST_CAT_MEMDUMP_OBJECT",
"GST_CAT_TRACE",
"GST_CAT_TRACE_OBJECT",
"GST_DEBUG_GRAPH_SHOW_NON_DEFAULT_PARAMS",
"GST_DEBUG_GRAPH_SHOW_STATES",
"GST_DEBUG_GRAPH_SHOW_VERBOSE",
+ "GST_DEBUG_ID",
"GST_DEBUG_OBJECT",
"GST_DEBUG_PAD_NAME",
"GST_DEBUG_REGISTER_FUNCPTR",
"GST_ENCODING_CATEGORY_STORAGE_EDITING",
"GST_END_TEST",
"GST_ERROR",
+ "GST_ERROR_ID",
"GST_ERROR_OBJECT",
"GST_ERROR_SYSTEM",
"GST_EVENT",
"GST_FD_MEMORY_FLAG_MAP_PRIVATE",
"GST_FD_MEMORY_FLAG_NONE",
"GST_FIXME",
+ "GST_FIXME_ID",
"GST_FIXME_OBJECT",
"GST_FLAG_SET_MASK_EXACT",
"GST_FLOW_CUSTOM_ERROR",
"GST_H264_FRAME_PACKING_ROW_INTERLEAVING",
"GST_H264_FRAME_PACKING_SIDE_BY_SIDE",
"GST_H264_FRAME_PACKING_TEMPORAL_INTERLEAVING",
+ "GST_H264_FRAME_PACKING_TOP_BOTTOM",
"GST_H264_FRMAE_PACKING_TOP_BOTTOM",
"GST_H264_I_SLICE",
"GST_H264_NAL_AU_DELIMITER",
"GST_H265_SEI_REGISTERED_USER_DATA",
"GST_H265_SEI_TIME_CODE",
"GST_INFO",
+ "GST_INFO_ID",
"GST_INFO_OBJECT",
"GST_INSERT_BIN_API",
"GST_INSTALL_PLUGINS_CRASHED",
"GST_LOCK_FLAG_READWRITE",
"GST_LOCK_FLAG_WRITE",
"GST_LOG",
+ "GST_LOG_ID",
"GST_LOG_OBJECT",
"GST_MAKE_FOURCC",
"GST_MAP_CUDA",
"GST_MAP_VA",
"GST_MAP_WRITE",
"GST_MEMDUMP",
+ "GST_MEMDUMP_ID",
"GST_MEMDUMP_OBJECT",
"GST_MEMORY_CAST",
"GST_MEMORY_FLAGS",
"GST_NAVIGATION_MESSAGE_EVENT",
"GST_NAVIGATION_MESSAGE_INVALID",
"GST_NAVIGATION_MESSAGE_MOUSE_OVER",
- "GST_NAVIGATION_MODIFIER_MOD1_MASK",
- "GST_NAVIGATION_MODIFIER_MOD2_MASK",
- "GST_NAVIGATION_MODIFIER_MOD3_MASK",
- "GST_NAVIGATION_MODIFIER_MOD4_MASK",
- "GST_NAVIGATION_MODIFIER_MOD5_MASK",
"GST_NAVIGATION_MODIFIER_BUTTON1_MASK",
"GST_NAVIGATION_MODIFIER_BUTTON2_MASK",
"GST_NAVIGATION_MODIFIER_BUTTON3_MASK",
"GST_NAVIGATION_MODIFIER_LOCK_MASK",
"GST_NAVIGATION_MODIFIER_MASK",
"GST_NAVIGATION_MODIFIER_META_MASK",
+ "GST_NAVIGATION_MODIFIER_MOD1_MASK",
+ "GST_NAVIGATION_MODIFIER_MOD2_MASK",
+ "GST_NAVIGATION_MODIFIER_MOD3_MASK",
+ "GST_NAVIGATION_MODIFIER_MOD4_MASK",
+ "GST_NAVIGATION_MODIFIER_MOD5_MASK",
"GST_NAVIGATION_MODIFIER_NONE",
"GST_NAVIGATION_MODIFIER_SHIFT_MASK",
"GST_NAVIGATION_MODIFIER_SUPER_MASK",
"GST_TRACER_VALUE_SCOPE_PAD",
"GST_TRACER_VALUE_SCOPE_PROCESS",
"GST_TRACER_VALUE_SCOPE_THREAD",
+ "GST_TRACE_ID",
"GST_TRACE_OBJECT",
"GST_TRANSCODER",
"GST_TRANSCODER_CLASS",
"GST_VIDEO_FORMAT_INFO_IS_LE",
"GST_VIDEO_FORMAT_INFO_IS_RGB",
"GST_VIDEO_FORMAT_INFO_IS_TILED",
+ "GST_VIDEO_FORMAT_INFO_IS_VALID_RAW",
"GST_VIDEO_FORMAT_INFO_IS_YUV",
"GST_VIDEO_FORMAT_INFO_NAME",
"GST_VIDEO_FORMAT_INFO_N_COMPONENTS",
"GST_VIDEO_FORMAT_INFO_SCALE_WIDTH",
"GST_VIDEO_FORMAT_INFO_SHIFT",
"GST_VIDEO_FORMAT_INFO_STRIDE",
+ "GST_VIDEO_FORMAT_INFO_TILE_HEIGHT",
"GST_VIDEO_FORMAT_INFO_TILE_HS",
"GST_VIDEO_FORMAT_INFO_TILE_MODE",
+ "GST_VIDEO_FORMAT_INFO_TILE_SIZE",
+ "GST_VIDEO_FORMAT_INFO_TILE_STRIDE",
+ "GST_VIDEO_FORMAT_INFO_TILE_WIDTH",
"GST_VIDEO_FORMAT_INFO_TILE_WS",
"GST_VIDEO_FORMAT_INFO_W_SUB",
"GST_VIDEO_FORMAT_IYU1",
"GST_VULKAN_WINDOW_LOCK",
"GST_VULKAN_WINDOW_UNLOCK",
"GST_WARNING",
+ "GST_WARNING_ID",
"GST_WARNING_OBJECT",
"GST_WEBRTC_API",
"GST_WEBRTC_BUNDLE_POLICY_BALANCED",
"GST_WEBRTC_ERROR_INVALID_STATE",
"GST_WEBRTC_ERROR_SCTP_FAILURE",
"GST_WEBRTC_ERROR_SDP_SYNTAX_ERROR",
+ "GST_WEBRTC_ERROR_TYPE_ERROR",
"GST_WEBRTC_FEC_TYPE_NONE",
"GST_WEBRTC_FEC_TYPE_ULP_RED",
"GST_WEBRTC_ICE_COMPONENT_RTCP",
"GstAV1Enc:tile-columns",
"GstAV1Enc:tile-rows",
"GstAV1Enc:undershoot-pct",
+ "GstAV1EncEncPass",
+ "GstAV1EncEncPass::first-pass",
+ "GstAV1EncEncPass::one-pass",
+ "GstAV1EncEncPass::second-pass",
+ "GstAV1EncEncPass::third-pass",
"GstAV1EncEndUsageMode",
"GstAV1EncEndUsageMode::cbr",
"GstAV1EncEndUsageMode::cq",
"GstAV1EncEndUsageMode::q",
"GstAV1EncEndUsageMode::vbr",
+ "GstAV1EncKFMode",
+ "GstAV1EncKFMode::auto",
+ "GstAV1EncKFMode::disabled",
"GstAV1EncResizeMode",
"GstAV1EncResizeMode::fixed",
"GstAV1EncResizeMode::none",
"GstAV1EncSuperresMode::none",
"GstAV1EncSuperresMode::qthresh",
"GstAV1EncSuperresMode::random",
+ "GstAV1EncUsageProfile",
+ "GstAV1EncUsageProfile::all-intra",
+ "GstAV1EncUsageProfile::good-quality",
+ "GstAV1EncUsageProfile::realtime",
"GstAV1FilmGrainParams",
"GstAV1FrameHeaderOBU",
"GstAV1FrameOBU",
"GstAudioAggregator.parent",
"GstAudioAggregator:alignment-threshold",
"GstAudioAggregator:discont-wait",
+ "GstAudioAggregator:force-live",
"GstAudioAggregator:ignore-inactive-pads",
"GstAudioAggregator:output-buffer-duration",
"GstAudioAggregator:output-buffer-duration-fraction",
"GstAutoplugSelectResult::expose",
"GstAutoplugSelectResult::skip",
"GstAutoplugSelectResult::try",
+ "GstAvCodecCompliance",
+ "GstAvCodecCompliance::auto",
+ "GstAvCodecCompliance::experimental",
+ "GstAvCodecCompliance::normal",
+ "GstAvCodecCompliance::strict",
+ "GstAvCodecCompliance::unofficial",
+ "GstAvCodecCompliance::very-strict",
"GstAvWait",
"GstAvWait!asink",
"GstAvWait!asrc",
"GstCudaAllocator",
"GstCudaAllocator.parent",
"GstCudaAllocatorClass.parent_class",
+ "GstCudaBaseConvert",
"GstCudaBaseTransform",
"GstCudaBaseTransform:cuda-device-id",
"GstCudaBufferCopyType",
"GstCudaContextClass.parent_class",
"GstCudaConvert!sink",
"GstCudaConvert!src",
+ "GstCudaConvertScale!sink",
+ "GstCudaConvertScale!src",
"GstCudaDownload!sink",
"GstCudaDownload!src",
"GstCudaGraphicsResource",
"GstCudaMemory.context",
"GstCudaMemory.info",
"GstCudaMemory.mem",
+ "GstCudaMemoryCopy",
"GstCudaMemoryTransfer",
"GstCudaQuarkId",
"GstCudaScale!sink",
"GstD3D11CompositorBackground::checker",
"GstD3D11CompositorBackground::transparent",
"GstD3D11CompositorBackground::white",
+ "GstD3D11CompositorOperator",
+ "GstD3D11CompositorOperator::over",
+ "GstD3D11CompositorOperator::source",
"GstD3D11CompositorPad",
"GstD3D11CompositorPad:alpha",
+ "GstD3D11CompositorPad:gamma-mode",
"GstD3D11CompositorPad:height",
+ "GstD3D11CompositorPad:operator",
+ "GstD3D11CompositorPad:primaries-mode",
"GstD3D11CompositorPad:sizing-policy",
"GstD3D11CompositorPad:width",
"GstD3D11CompositorPad:xpos",
"GstD3D11Mpeg2Dec!src",
"GstD3D11Scale!sink",
"GstD3D11Scale!src",
+ "GstD3D11ScreenCaptureAPI",
+ "GstD3D11ScreenCaptureAPI::dxgi",
+ "GstD3D11ScreenCaptureAPI::wgc",
"GstD3D11ScreenCaptureSrc!src",
+ "GstD3D11TestSrc!src",
+ "GstD3D11TestSrcPattern",
+ "GstD3D11TestSrcPattern::black",
+ "GstD3D11TestSrcPattern::blue",
+ "GstD3D11TestSrcPattern::checkers-1",
+ "GstD3D11TestSrcPattern::checkers-2",
+ "GstD3D11TestSrcPattern::checkers-4",
+ "GstD3D11TestSrcPattern::checkers-8",
+ "GstD3D11TestSrcPattern::green",
+ "GstD3D11TestSrcPattern::red",
+ "GstD3D11TestSrcPattern::smpte",
+ "GstD3D11TestSrcPattern::snow",
+ "GstD3D11TestSrcPattern::white",
"GstD3D11Upload",
"GstD3D11Upload!sink",
"GstD3D11Upload!src",
"GstD3D11VideoSinkBin:sync",
"GstD3D11VideoSinkBin:throttle-time",
"GstD3D11VideoSinkBin:ts-offset",
+ "GstD3D11VideoSinkDisplayFormat",
+ "GstD3D11VideoSinkDisplayFormat::b8g8r8a8-unorm",
+ "GstD3D11VideoSinkDisplayFormat::r10g10b10a2-unorm",
+ "GstD3D11VideoSinkDisplayFormat::r8g8b8a8-unorm",
+ "GstD3D11VideoSinkDisplayFormat::unknown",
"GstD3D11Vp8Dec",
"GstD3D11Vp8Dec!sink",
"GstD3D11Vp8Dec!src",
"GstDownloadBuffer:temp-location",
"GstDownloadBuffer:temp-remove",
"GstDownloadBuffer:temp-template",
+ "GstDshowAudioSrc!src",
+ "GstDshowVideoSink!sink",
+ "GstDshowVideoSrc!src",
"GstDtlsConnectionState",
"GstDtlsConnectionState::closed",
"GstDtlsConnectionState::connected",
"GstFFMpegDeinterlace!sink",
"GstFFMpegDeinterlace!src",
"GstFFMpegDeinterlace:mode",
+ "GstFFMpegVidDec",
+ "GstFFMpegVidDec:std-compliance",
"GstFPSDisplaySink",
"GstFPSDisplaySink!sink",
"GstFPSDisplaySink::fps-measurements",
"GstFaceOverlay:x",
"GstFaceOverlay:y",
"GstFakeAudioSink!sink",
+ "GstFakeAudioSinkStateError",
+ "GstFakeAudioSinkStateError::none",
+ "GstFakeAudioSinkStateError::null-to-ready",
+ "GstFakeAudioSinkStateError::paused-to-playing",
+ "GstFakeAudioSinkStateError::paused-to-ready",
+ "GstFakeAudioSinkStateError::playing-to-paused",
+ "GstFakeAudioSinkStateError::ready-to-null",
+ "GstFakeAudioSinkStateError::ready-to-paused",
"GstFakeSink",
"GstFakeSink!sink",
"GstFakeSink::handoff",
"GstFakeVideoSinkAllocationMetaFlags",
"GstFakeVideoSinkAllocationMetaFlags::crop",
"GstFakeVideoSinkAllocationMetaFlags::overlay-composition",
+ "GstFakeVideoSinkStateError",
+ "GstFakeVideoSinkStateError::none",
+ "GstFakeVideoSinkStateError::null-to-ready",
+ "GstFakeVideoSinkStateError::paused-to-playing",
+ "GstFakeVideoSinkStateError::paused-to-ready",
+ "GstFakeVideoSinkStateError::playing-to-paused",
+ "GstFakeVideoSinkStateError::ready-to-null",
+ "GstFakeVideoSinkStateError::ready-to-paused",
"GstFdAllocator",
"GstFdAllocator.parent",
"GstFdAllocatorClass.parent_class",
"GstFdkAacEnc!sink",
"GstFdkAacEnc!src",
"GstFdkAacEnc:bitrate",
+ "GstFdkAacRateControl",
+ "GstFdkAacRateControl::cbr",
+ "GstFdkAacRateControl::vbr",
+ "GstFdkAacVbrPreset",
+ "GstFdkAacVbrPreset::high",
+ "GstFdkAacVbrPreset::low",
+ "GstFdkAacVbrPreset::medium",
+ "GstFdkAacVbrPreset::very-high",
+ "GstFdkAacVbrPreset::very-low",
"GstFestival",
"GstFestival!sink",
"GstFestival!src",
"GstGLVideoMixerInput:blend-function-dst-rgb",
"GstGLVideoMixerInput:blend-function-src-alpha",
"GstGLVideoMixerInput:blend-function-src-rgb",
+ "GstGLVideoMixerInput:crop-bottom",
+ "GstGLVideoMixerInput:crop-left",
+ "GstGLVideoMixerInput:crop-right",
+ "GstGLVideoMixerInput:crop-top",
"GstGLVideoMixerInput:height",
"GstGLVideoMixerInput:repeat-after-eos",
"GstGLVideoMixerInput:width",
"GstJpegDec!src",
"GstJpegDec:idct-method",
"GstJpegDec:max-errors",
+ "GstJpegDecoder",
"GstJpegEnc",
"GstJpegEnc!sink",
"GstJpegEnc!src",
"GstLiveAdder:latency",
"GstLockFlags",
"GstLogFunction",
+ "GstMFAacDec!sink",
+ "GstMFAacDec!src",
"GstMFAacEnc",
"GstMFAacEnc!sink",
"GstMFAacEnc!src",
"GstMFAacEnc:bitrate",
+ "GstMFAudioDecoder",
+ "GstMFAudioEncoder",
"GstMFH264Enc",
"GstMFH264Enc!sink",
"GstMFH264Enc!src",
"GstMFH264Enc:rc-mode",
"GstMFH264Enc:ref",
"GstMFH264Enc:vbv-buffer-size",
+ "GstMFH264EncAdaptiveMode",
+ "GstMFH264EncAdaptiveMode::framerate",
+ "GstMFH264EncAdaptiveMode::none",
"GstMFH264EncRCMode",
"GstMFH264EncRCMode::cbr",
"GstMFH264EncRCMode::pcvbr",
"GstMFH265EncRCMode",
"GstMFH265EncRCMode::cbr",
"GstMFH265EncRCMode::qvbr",
+ "GstMFMp3Dec!sink",
+ "GstMFMp3Dec!src",
"GstMFMp3Enc",
"GstMFMp3Enc!sink",
"GstMFMp3Enc!src",
"GstMFVP9EncRCMode",
"GstMFVP9EncRCMode::cbr",
"GstMFVP9EncRCMode::qvbr",
+ "GstMFVideoEncoder",
"GstMFVideoSrc",
"GstMFVideoSrc!src",
"GstMFVideoSrc:device-index",
"GstMplexFormat::vcd-still",
"GstMsdkAV1Dec!sink",
"GstMsdkAV1Dec!src",
+ "GstMsdkAV1Enc!sink",
+ "GstMsdkAV1Enc!src",
"GstMsdkDec",
"GstMsdkDec:async-depth",
"GstMsdkDec:hardware",
"GstNtpClock",
"GstNtpClock.clock",
"GstNtpClockClass.parent_class",
+ "GstNvAV1Dec!sink",
+ "GstNvAV1Dec!src",
+ "GstNvAutoGpuH264Enc!sink",
+ "GstNvAutoGpuH264Enc!src",
+ "GstNvAutoGpuH265Enc!sink",
+ "GstNvAutoGpuH265Enc!src",
"GstNvBaseEnc",
"GstNvBaseEnc:aq-strength",
"GstNvBaseEnc:bitrate",
"GstNvBaseEnc:spatial-aq",
"GstNvBaseEnc:strict-gop",
"GstNvBaseEnc:zerolatency",
+ "GstNvCudaH264Enc!sink",
+ "GstNvCudaH264Enc!src",
+ "GstNvCudaH265Enc!sink",
+ "GstNvCudaH265Enc!src",
+ "GstNvD3D11H264Enc!sink",
+ "GstNvD3D11H264Enc!src",
+ "GstNvD3D11H265Enc!sink",
+ "GstNvD3D11H265Enc!src",
"GstNvDec",
+ "GstNvDec:cuda-device-id",
"GstNvDec:max-display-delay",
"GstNvDevice0H264Enc",
"GstNvDevice0H265Enc",
+ "GstNvEncoder",
+ "GstNvEncoderPreset",
+ "GstNvEncoderPreset::default",
+ "GstNvEncoderPreset::hp",
+ "GstNvEncoderPreset::hq",
+ "GstNvEncoderPreset::lossless",
+ "GstNvEncoderPreset::lossless-hp",
+ "GstNvEncoderPreset::low-latency",
+ "GstNvEncoderPreset::low-latency-hp",
+ "GstNvEncoderPreset::low-latency-hq",
+ "GstNvEncoderRCMode",
+ "GstNvEncoderRCMode::cbr",
+ "GstNvEncoderRCMode::cbr-hq",
+ "GstNvEncoderRCMode::cbr-ld-hq",
+ "GstNvEncoderRCMode::cqp",
+ "GstNvEncoderRCMode::vbr",
+ "GstNvEncoderRCMode::vbr-hq",
"GstNvH264Enc",
"GstNvH264Enc!sink",
"GstNvH264Enc!src",
"GstNvH264Enc:temporal-aq",
"GstNvH264Enc:vbv-buffer-size",
"GstNvH264Enc:weighted-pred",
+ "GstNvH264SLDec!sink",
+ "GstNvH264SLDec!src",
"GstNvH265Enc",
"GstNvH265Enc!sink",
"GstNvH265Enc!src",
"GstNvH265Enc:temporal-aq",
"GstNvH265Enc:vbv-buffer-size",
"GstNvH265Enc:weighted-pred",
+ "GstNvH265SLDec!sink",
+ "GstNvH265SLDec!src",
"GstNvPreset",
"GstNvPreset::default",
"GstNvPreset::hp",
"GstNvRCMode::vbr",
"GstNvRCMode::vbr-hq",
"GstNvRCMode::vbr-minqp",
+ "GstNvVp8SLDec!sink",
+ "GstNvVp8SLDec!src",
+ "GstNvVp9SLDec!sink",
+ "GstNvVp9SLDec!src",
"GstOSXVideoSink!sink",
"GstObject",
"GstObject.flags",
"GstQrcodeOverlayCorrection::Approx 25%%",
"GstQrcodeOverlayCorrection::Approx 30%%",
"GstQrcodeOverlayCorrection::Approx 7%%",
+ "GstQsvAV1Enc!sink",
+ "GstQsvAV1Enc!src",
+ "GstQsvAV1EncRateControl",
+ "GstQsvAV1EncRateControl::cbr",
+ "GstQsvAV1EncRateControl::cqp",
+ "GstQsvAV1EncRateControl::vbr",
+ "GstQsvCodingOption",
+ "GstQsvCodingOption::off",
+ "GstQsvCodingOption::on",
+ "GstQsvCodingOption::unknown",
+ "GstQsvDecoder",
+ "GstQsvDecoder:adapter-luid",
+ "GstQsvEncoder",
+ "GstQsvEncoder:adapter-luid",
+ "GstQsvEncoder:low-latency",
+ "GstQsvEncoder:target-usage",
+ "GstQsvH264Dec!sink",
+ "GstQsvH264Dec!src",
+ "GstQsvH264Enc!sink",
+ "GstQsvH264Enc!src",
+ "GstQsvH264EncRCLookAheadDS",
+ "GstQsvH264EncRCLookAheadDS::2x",
+ "GstQsvH264EncRCLookAheadDS::4x",
+ "GstQsvH264EncRCLookAheadDS::off",
+ "GstQsvH264EncRCLookAheadDS::unknown",
+ "GstQsvH264EncRateControl",
+ "GstQsvH264EncRateControl::avbr",
+ "GstQsvH264EncRateControl::cbr",
+ "GstQsvH264EncRateControl::cqp",
+ "GstQsvH264EncRateControl::icq",
+ "GstQsvH264EncRateControl::la-hrd",
+ "GstQsvH264EncRateControl::la-icq",
+ "GstQsvH264EncRateControl::la-vbr",
+ "GstQsvH264EncRateControl::qvbr",
+ "GstQsvH264EncRateControl::vbr",
+ "GstQsvH264EncRateControl::vcm",
+ "GstQsvH264EncSeiInsertMode",
+ "GstQsvH264EncSeiInsertMode::disabled",
+ "GstQsvH264EncSeiInsertMode::insert",
+ "GstQsvH264EncSeiInsertMode::insert-and-drop",
+ "GstQsvH265Dec!sink",
+ "GstQsvH265Dec!src",
+ "GstQsvH265Enc!sink",
+ "GstQsvH265Enc!src",
+ "GstQsvH265EncRateControl",
+ "GstQsvH265EncRateControl::cbr",
+ "GstQsvH265EncRateControl::cqp",
+ "GstQsvH265EncRateControl::icq",
+ "GstQsvH265EncRateControl::qvbr",
+ "GstQsvH265EncRateControl::vbr",
+ "GstQsvH265EncRateControl::vcm",
+ "GstQsvH265EncSeiInsertMode",
+ "GstQsvH265EncSeiInsertMode::disabled",
+ "GstQsvH265EncSeiInsertMode::insert",
+ "GstQsvH265EncSeiInsertMode::insert-and-drop",
+ "GstQsvJpegDec!sink",
+ "GstQsvJpegDec!src",
+ "GstQsvJpegEnc!sink",
+ "GstQsvJpegEnc!src",
+ "GstQsvVP9Dec!sink",
+ "GstQsvVP9Dec!src",
+ "GstQsvVP9Enc!sink",
+ "GstQsvVP9Enc!src",
+ "GstQsvVP9EncRateControl",
+ "GstQsvVP9EncRateControl::cbr",
+ "GstQsvVP9EncRateControl::cqp",
+ "GstQsvVP9EncRateControl::icq",
+ "GstQsvVP9EncRateControl::vbr",
"GstQtOverlay",
"GstQtOverlay!sink",
"GstQtOverlay!src",
"GstRTSPClientClass.setup_request",
"GstRTSPClientClass.teardown_request",
"GstRTSPClientClass.tunnel_http_response",
+ "GstRTSPClientClass::adjust_error_code",
"GstRTSPClientClass::adjust_play_mode",
"GstRTSPClientClass::adjust_play_response",
"GstRTSPClientClass::announce_request",
"GstRTSPLowerTrans",
"GstRTSPMedia",
"GstRTSPMedia.parent",
+ "GstRTSPMedia::handle-message",
"GstRTSPMedia::new-state",
"GstRTSPMedia::new-stream",
"GstRTSPMedia::prepared",
"GstTwoLamePadding::never",
"GstTypeFind",
"GstTypeFind.data",
+ "GstTypeFindData",
"GstTypeFindElement",
"GstTypeFindElement!sink",
"GstTypeFindElement!src",
"GstVPXEncTuning",
"GstVPXEncTuning::psnr",
"GstVPXEncTuning::ssim",
+ "GstVaAV1Dec!sink",
+ "GstVaAV1Dec!src",
"GstVaAllocator",
+ "GstVaBaseEnc",
+ "GstVaBaseEnc:device-path",
"GstVaBaseTransform",
+ "GstVaBaseTransform:device-path",
+ "GstVaCompositor!sink_%u",
+ "GstVaCompositor!src",
+ "GstVaCompositorPad",
+ "GstVaCompositorPad:alpha",
+ "GstVaCompositorPad:height",
+ "GstVaCompositorPad:width",
+ "GstVaCompositorPad:xpos",
+ "GstVaCompositorPad:ypos",
"GstVaDeinterlace!sink",
"GstVaDeinterlace!src",
"GstVaDeinterlaceMethods",
"GstVaFeature",
"GstVaH264Dec!sink",
"GstVaH264Dec!src",
+ "GstVaH264Enc!sink",
+ "GstVaH264Enc!src",
"GstVaH265Dec!sink",
"GstVaH265Dec!src",
"GstVaImplementation",
+ "GstVaJpegDec!sink",
+ "GstVaJpegDec!src",
"GstVaMpeg2Dec!sink",
"GstVaMpeg2Dec!src",
"GstVaPool",
"GstVaPostProc!sink",
"GstVaPostProc!src",
+ "GstVaScaleMethod",
+ "GstVaScaleMethod::default",
+ "GstVaScaleMethod::fast",
+ "GstVaScaleMethod::hq",
"GstVaVp8Dec!sink",
"GstVaVp8Dec!src",
"GstVaVp9Dec!sink",
"GstVideoAggregator",
"GstVideoAggregator.aggregator",
"GstVideoAggregator.info",
+ "GstVideoAggregator:force-live",
"GstVideoAggregatorClass.aggregate_frames",
"GstVideoAggregatorClass.create_output_buffer",
"GstVideoAggregatorClass.find_best_format",
"GstVideoFormatInfo.poffset",
"GstVideoFormatInfo.shift",
"GstVideoFormatInfo.tile_hs",
+ "GstVideoFormatInfo.tile_info",
"GstVideoFormatInfo.tile_mode",
"GstVideoFormatInfo.tile_ws",
"GstVideoFormatInfo.unpack_format",
"GstVideoTestSrcPattern::spokes",
"GstVideoTestSrcPattern::white",
"GstVideoTestSrcPattern::zone-plate",
+ "GstVideoTileInfo",
+ "GstVideoTileInfo.height",
+ "GstVideoTileInfo.size",
+ "GstVideoTileInfo.stride",
+ "GstVideoTileInfo.width",
"GstVideoTileMode",
"GstVideoTileType",
"GstVideoTimeCode",
"GstWasapi2Src:low-latency",
"GstWasapi2Src:mute",
"GstWasapi2Src:volume",
+ "GstWasapi2SrcLoopbackMode",
+ "GstWasapi2SrcLoopbackMode::default",
+ "GstWasapi2SrcLoopbackMode::exclude-process-tree",
+ "GstWasapi2SrcLoopbackMode::include-process-tree",
"GstWasapiDeviceRole",
"GstWasapiDeviceRole::comms",
"GstWasapiDeviceRole::console",
"GstWebRTCBin:turn-server",
"GstWebRTCBinPad",
"GstWebRTCBinPad:transceiver",
+ "GstWebRTCBinSinkPad",
+ "GstWebRTCBinSinkPad:msid",
+ "GstWebRTCBinSrcPad",
+ "GstWebRTCBinSrcPad:msid",
"GstWebRTCBundlePolicy",
"GstWebRTCDTLSSetup",
"GstWebRTCDTLSTransport",
"GstWebRTCICEClass::add_turn_server",
"GstWebRTCICEClass::find_transport",
"GstWebRTCICEClass::gather_candidates",
+ "GstWebRTCICEClass::get_http_proxy",
"GstWebRTCICEClass::get_is_controller",
"GstWebRTCICEClass::get_local_candidates",
"GstWebRTCICEClass::get_remote_candidates",
"GstWebRTCICEClass::get_stun_server",
"GstWebRTCICEClass::get_turn_server",
"GstWebRTCICEClass::set_force_relay",
+ "GstWebRTCICEClass::set_http_proxy",
"GstWebRTCICEClass::set_is_controller",
"GstWebRTCICEClass::set_local_credentials",
"GstWebRTCICEClass::set_on_ice_candidate",
"GstWebvttEnc!src",
"GstWebvttEnc:duration",
"GstWebvttEnc:timestamp",
+ "GstWicDecoder",
+ "GstWicJpegDec!sink",
+ "GstWicJpegDec!src",
+ "GstWicPngDec!sink",
+ "GstWicPngDec!src",
"GstWildmidiDec",
"GstWildmidiDec!sink",
"GstWildmidiDec!src",
"GstWildmidiDec:log-volume-scale",
"GstWildmidiDec:output-buffer-size",
"GstWildmidiDec:reverb",
+ "GstWin32IpcVideoSink!sink",
+ "GstWin32IpcVideoSrc!src",
"GstWpeSrc",
"GstWpeSrc!audio_%u",
"GstWpeSrc!src",
"RTPSession:sources",
"RTPSession:stats",
"RTPSession:twcc-feedback-interval",
+ "RTPSession:update-ntp64-header-ext",
"RTPSource",
"RTPSource:disable-rtcp",
"RTPSource:is-csrc",
"RsnDvdBin!video",
"RsnDvdBin:device",
"SCENARIO_ACTION_CHECK_ERROR",
+ "SCENARIO_ACTION_ENDED_EARLY",
"SCENARIO_ACTION_EXECUTION_ERROR",
"SCENARIO_ACTION_EXECUTION_ISSUE",
"SCENARIO_ACTION_TIMEOUT",
"_GstH265SPS.sps_3d_extension_flag",
"_GstH265SPS.sps_extension_4bits",
"_GstH265SPS.sps_extension_flag",
+ "_GstH265SPS.sps_extension_params",
"_GstH265SPS.sps_extnsion_params",
"_GstH265SPS.sps_multilayer_extension_flag",
"_GstH265SPS.sps_range_extension_flag",
"__GST_BYTE_READER_GET_PEEK_BITS_UNCHECKED",
"__GST_BYTE_WRITER_CREATE_WRITE_FUNC",
"__GST_CAT_MEMDUMP_LOG",
+ "__GST_CAT_MEMDUMP_LOG_ID",
"__GST_PACKAGE_RELEASE_DATETIME",
"__GST_PRINT_CHAR",
"__GST_SIGN",
"av1enc:buf-sz",
"av1enc:cpu-used",
"av1enc:drop-frame",
+ "av1enc:enc-pass",
"av1enc:end-usage",
+ "av1enc:keyframe-max-dist",
+ "av1enc:keyframe-mode",
+ "av1enc:lag-in-frames",
"av1enc:max-quantizer",
"av1enc:min-quantizer",
"av1enc:overshoot-pct",
"av1enc:tile-columns",
"av1enc:tile-rows",
"av1enc:undershoot-pct",
+ "av1enc:usage-profile",
"av1parse",
"avcodeccontext-audio-service-type",
"avcodeccontext-audio-service-type::co",
"count",
"cpureport",
"cudaconvert",
+ "cudaconvertscale",
+ "cudaconvertscale:add-borders",
"cudadownload",
"cudascale",
+ "cudascale:add-borders",
"cudaupload",
"curlfilesink",
"curlfilesink:create-dirs",
"d3d11av1dec:device-id",
"d3d11av1dec:vendor-id",
"d3d11colorconvert",
+ "d3d11colorconvert:gamma-mode",
+ "d3d11colorconvert:primaries-mode",
"d3d11compositor",
"d3d11compositor:adapter",
"d3d11compositor:background",
"d3d11compositorelement:background",
"d3d11convert",
"d3d11convert:add-borders",
+ "d3d11convert:border-color",
+ "d3d11convert:gamma-mode",
+ "d3d11convert:primaries-mode",
"d3d11deinterlace",
"d3d11deinterlace:adapter",
"d3d11deinterlace:device-id",
"d3d11mpeg2dec:vendor-id",
"d3d11scale",
"d3d11scale:add-borders",
+ "d3d11scale:border-color",
"d3d11screencapturesrc",
+ "d3d11screencapturesrc:adapter",
+ "d3d11screencapturesrc:capture-api",
+ "d3d11screencapturesrc:crop-height",
+ "d3d11screencapturesrc:crop-width",
+ "d3d11screencapturesrc:crop-x",
+ "d3d11screencapturesrc:crop-y",
"d3d11screencapturesrc:monitor-handle",
"d3d11screencapturesrc:monitor-index",
+ "d3d11screencapturesrc:show-border",
"d3d11screencapturesrc:show-cursor",
+ "d3d11screencapturesrc:window-handle",
+ "d3d11testsrc",
+ "d3d11testsrc:adapter",
+ "d3d11testsrc:is-live",
+ "d3d11testsrc:pattern",
"d3d11upload",
"d3d11videosink",
"d3d11videosink::begin-draw",
"d3d11videosink::draw",
+ "d3d11videosink::present",
"d3d11videosink:adapter",
"d3d11videosink:async",
"d3d11videosink:blocksize",
+ "d3d11videosink:display-format",
"d3d11videosink:draw-on-shared-texture",
+ "d3d11videosink:emit-present",
"d3d11videosink:enable-last-sample",
"d3d11videosink:enable-navigation-events",
"d3d11videosink:force-aspect-ratio",
"d3d11videosink:fullscreen",
"d3d11videosink:fullscreen-toggle-mode",
+ "d3d11videosink:gamma-mode",
"d3d11videosink:last-sample",
"d3d11videosink:max-bitrate",
"d3d11videosink:max-lateness",
+ "d3d11videosink:primaries-mode",
"d3d11videosink:processing-deadline",
"d3d11videosink:qos",
"d3d11videosink:render-delay",
+ "d3d11videosink:rotate-method",
"d3d11videosink:show-preroll-frame",
"d3d11videosink:stats",
"d3d11videosink:sync",
"decklinkaudiosink:device-number",
"decklinkaudiosink:discont-wait",
"decklinkaudiosink:hw-serial-number",
+ "decklinkaudiosink:persistent-id",
"decklinkaudiosrc",
"decklinkaudiosrc:alignment-threshold",
"decklinkaudiosrc:buffer-size",
"decklinkaudiosrc:device-number",
"decklinkaudiosrc:discont-wait",
"decklinkaudiosrc:hw-serial-number",
+ "decklinkaudiosrc:persistent-id",
"decklinkvideosink",
"decklinkvideosink:afd-bar-line",
"decklinkvideosink:cc-line",
"decklinkvideosink:keyer-mode",
"decklinkvideosink:mapping-format",
"decklinkvideosink:mode",
+ "decklinkvideosink:persistent-id",
"decklinkvideosink:profile",
"decklinkvideosink:timecode-format",
"decklinkvideosink:video-format",
"decklinkvideosrc:output-afd-bar",
"decklinkvideosrc:output-cc",
"decklinkvideosrc:output-stream-time",
+ "decklinkvideosrc:persistent-id",
"decklinkvideosrc:profile",
"decklinkvideosrc:signal",
"decklinkvideosrc:skip-first-time",
"downloadbuffer:temp-location",
"downloadbuffer:temp-remove",
"downloadbuffer:temp-template",
+ "dshowadec_mp3",
+ "dshowadec_mp3!sink",
+ "dshowadec_mp3!src",
+ "dshowadec_mpeg_1_2",
+ "dshowadec_mpeg_1_2!sink",
+ "dshowadec_mpeg_1_2!src",
+ "dshowadec_wma1",
+ "dshowadec_wma1!sink",
+ "dshowadec_wma1!src",
+ "dshowadec_wma2",
+ "dshowadec_wma2!sink",
+ "dshowadec_wma2!src",
+ "dshowadec_wma3",
+ "dshowadec_wma3!sink",
+ "dshowadec_wma3!src",
+ "dshowadec_wma4",
+ "dshowadec_wma4!sink",
+ "dshowadec_wma4!src",
+ "dshowadec_wms",
+ "dshowadec_wms!sink",
+ "dshowadec_wms!src",
+ "dshowaudiosrc",
+ "dshowaudiosrc:device",
+ "dshowaudiosrc:device-index",
+ "dshowaudiosrc:device-name",
+ "dshowvdec_cinepak",
+ "dshowvdec_cinepak!sink",
+ "dshowvdec_cinepak!src",
+ "dshowvdec_divx3",
+ "dshowvdec_divx3!sink",
+ "dshowvdec_divx3!src",
+ "dshowvdec_divx4",
+ "dshowvdec_divx4!sink",
+ "dshowvdec_divx4!src",
+ "dshowvdec_divx5",
+ "dshowvdec_divx5!sink",
+ "dshowvdec_divx5!src",
+ "dshowvdec_mpeg1",
+ "dshowvdec_mpeg1!sink",
+ "dshowvdec_mpeg1!src",
+ "dshowvdec_mpeg4",
+ "dshowvdec_mpeg4!sink",
+ "dshowvdec_mpeg4!src",
+ "dshowvdec_msmpeg4",
+ "dshowvdec_msmpeg4!sink",
+ "dshowvdec_msmpeg4!src",
+ "dshowvdec_msmpeg41",
+ "dshowvdec_msmpeg41!sink",
+ "dshowvdec_msmpeg41!src",
+ "dshowvdec_msmpeg42",
+ "dshowvdec_msmpeg42!sink",
+ "dshowvdec_msmpeg42!src",
+ "dshowvdec_msmpeg43",
+ "dshowvdec_msmpeg43!sink",
+ "dshowvdec_msmpeg43!src",
+ "dshowvdec_wmv1",
+ "dshowvdec_wmv1!sink",
+ "dshowvdec_wmv1!src",
+ "dshowvdec_wmv2",
+ "dshowvdec_wmv2!sink",
+ "dshowvdec_wmv2!src",
+ "dshowvdec_wmv3",
+ "dshowvdec_wmv3!sink",
+ "dshowvdec_wmv3!src",
+ "dshowvdec_wmva",
+ "dshowvdec_wmva!sink",
+ "dshowvdec_wmva!src",
+ "dshowvdec_wmvp",
+ "dshowvdec_wmvp!sink",
+ "dshowvdec_wmvp!src",
+ "dshowvdec_wvc1",
+ "dshowvdec_wvc1!sink",
+ "dshowvdec_wvc1!src",
+ "dshowvdec_xvid",
+ "dshowvdec_xvid!sink",
+ "dshowvdec_xvid!src",
+ "dshowvideosink",
+ "dshowvideosink:force-aspect-ratio",
+ "dshowvideosink:fullscreen",
+ "dshowvideosink:renderer",
+ "dshowvideosrc",
+ "dshowvideosrc:device",
+ "dshowvideosrc:device-index",
+ "dshowvideosrc:device-name",
"dtlsdec",
"dtlsdec::on-key-received",
"dtlsdec:connection-id",
"fbdevsink:device",
"fdkaacdec",
"fdkaacenc",
+ "fdkaacenc:afterburner",
"fdkaacenc:bitrate",
+ "fdkaacenc:peak-bitrate",
+ "fdkaacenc:rate-control",
+ "fdkaacenc:vbr-preset",
"fdsink",
"fdsink:fd",
"fdsrc",
"ges_timeline_append_layer",
"ges_timeline_commit",
"ges_timeline_commit_sync",
+ "ges_timeline_disable_edit_apis",
"ges_timeline_element_add_child_property",
"ges_timeline_element_copy",
"ges_timeline_element_edit",
"ges_timeline_freeze_commit",
"ges_timeline_get_auto_transition",
"ges_timeline_get_duration",
+ "ges_timeline_get_edit_apis_disabled",
"ges_timeline_get_element",
"ges_timeline_get_frame_at",
"ges_timeline_get_frame_time",
"gst_aggregator_finish_buffer_list",
"gst_aggregator_get_allocator",
"gst_aggregator_get_buffer_pool",
+ "gst_aggregator_get_force_live",
"gst_aggregator_get_ignore_inactive_pads",
"gst_aggregator_get_latency",
"gst_aggregator_negotiate",
"gst_aggregator_pad_pop_buffer",
"gst_aggregator_peek_next_sample",
"gst_aggregator_selected_samples",
+ "gst_aggregator_set_force_live",
"gst_aggregator_set_ignore_inactive_pads",
"gst_aggregator_set_latency",
"gst_aggregator_set_src_caps",
"gst_child_proxy_get",
"gst_child_proxy_get_child_by_index",
"gst_child_proxy_get_child_by_name",
+ "gst_child_proxy_get_child_by_name_recurse",
"gst_child_proxy_get_children_count",
"gst_child_proxy_get_property",
"gst_child_proxy_get_valist",
"gst_debug_log",
"gst_debug_log_default",
"gst_debug_log_get_line",
+ "gst_debug_log_id",
+ "gst_debug_log_id_literal",
+ "gst_debug_log_id_valist",
"gst_debug_log_literal",
"gst_debug_log_valist",
"gst_debug_message_get",
+ "gst_debug_message_get_id",
"gst_debug_print_stack_trace",
"gst_debug_remove_log_function",
"gst_debug_remove_log_function_by_data",
"gst_event_type_get_flags",
"gst_event_type_get_name",
"gst_event_type_to_quark",
+ "gst_event_type_to_sticky_ordering",
"gst_event_unref",
"gst_event_writable_structure",
"gst_fd_allocator_alloc",
"gst_transcoder_signal_adapter_get_transcoder",
"gst_transcoder_state_get_name",
"gst_trigger_control_source_new",
+ "gst_type_find_data_free",
+ "gst_type_find_data_get_caps",
+ "gst_type_find_data_get_probability",
+ "gst_type_find_data_get_typefind",
+ "gst_type_find_data_new",
"gst_type_find_factory_call_function",
"gst_type_find_factory_get_caps",
"gst_type_find_factory_get_extensions",
"gst_type_find_helper_for_data",
"gst_type_find_helper_for_data_with_caps",
"gst_type_find_helper_for_data_with_extension",
- "gst_type_find_list_factories_for_caps",
"gst_type_find_helper_for_extension",
"gst_type_find_helper_get_range",
"gst_type_find_helper_get_range_full",
+ "gst_type_find_list_factories_for_caps",
"gst_type_find_peek",
"gst_type_find_register",
"gst_type_find_suggest",
"gst_va_allocator_flush",
"gst_va_allocator_get_format",
"gst_va_allocator_new",
+ "gst_va_allocator_peek_display",
"gst_va_allocator_prepare_buffer",
"gst_va_allocator_set_format",
"gst_va_allocator_set_hacks",
"gst_va_buffer_create_aux_surface",
"gst_va_buffer_get_aux_surface",
"gst_va_buffer_get_surface",
+ "gst_va_buffer_peek_display",
"gst_va_context_query",
"gst_va_display_drm_new_from_path",
"gst_va_display_get_implementation",
"gst_va_handle_context_query",
"gst_va_handle_set_context",
"gst_va_memory_get_surface",
+ "gst_va_memory_peek_display",
"gst_va_pool_new",
"gst_va_pool_new_with_config",
"gst_va_pool_requires_video_meta",
"gst_webrtc_data_channel_on_message_string",
"gst_webrtc_data_channel_on_open",
"gst_webrtc_data_channel_send_data",
+ "gst_webrtc_data_channel_send_data_full",
"gst_webrtc_data_channel_send_string",
+ "gst_webrtc_data_channel_send_string_full",
"gst_webrtc_dtls_transport_new",
"gst_webrtc_dtls_transport_set_transport",
"gst_webrtc_error_quark",
"gst_webrtc_ice_candidate_stats_free",
"gst_webrtc_ice_find_transport",
"gst_webrtc_ice_gather_candidates",
+ "gst_webrtc_ice_get_http_proxy",
"gst_webrtc_ice_get_is_controller",
"gst_webrtc_ice_get_local_candidates",
"gst_webrtc_ice_get_remote_candidates",
"gst_webrtc_ice_get_stun_server",
"gst_webrtc_ice_get_turn_server",
"gst_webrtc_ice_set_force_relay",
+ "gst_webrtc_ice_set_http_proxy",
"gst_webrtc_ice_set_is_controller",
"gst_webrtc_ice_set_local_credentials",
"gst_webrtc_ice_set_on_ice_candidate",
"input-selector",
"input-selector:active-pad",
"input-selector:cache-buffers",
+ "input-selector:drop-backwards",
"input-selector:n-pads",
"input-selector:sync-mode",
"input-selector:sync-streams",
"kmssink:plane-properties",
"kmssink:render-rectangle",
"kmssink:restore-crtc",
+ "kmssink:skip-vsync",
"ksvideosrc",
"ksvideosrc:device-index",
"ksvideosrc:device-name",
"matroskamux:version",
"matroskamux:writing-app",
"matroskaparse",
+ "mfaacdec",
"mfaacenc",
"mfaacenc:bitrate",
"mfh264enc",
"mfh264enc:adapter-luid",
+ "mfh264enc:adaptive-mode",
"mfh264enc:bframes",
"mfh264enc:bitrate",
"mfh264enc:cabac",
"mfh264enc:gop-size",
"mfh264enc:low-latency",
"mfh264enc:max-bitrate",
+ "mfh264enc:max-qp",
+ "mfh264enc:min-qp",
"mfh264enc:qp",
"mfh264enc:qp-b",
"mfh264enc:qp-i",
"mfh265enc:gop-size",
"mfh265enc:low-latency",
"mfh265enc:max-bitrate",
+ "mfh265enc:max-qp",
+ "mfh265enc:min-qp",
"mfh265enc:qp",
"mfh265enc:qp-b",
"mfh265enc:qp-i",
"mfh265enc:qp-p",
"mfh265enc:quality-vs-speed",
"mfh265enc:rc-mode",
+ "mfh265enc:ref",
"mfh265enc:vbv-buffer-size",
+ "mfmp3dec",
"mfmp3enc",
"mfmp3enc:bitrate",
"mfvideosrc",
"mplex:system-headers",
"mplex:vbr",
"msdkav1dec",
+ "msdkav1enc",
+ "msdkav1enc:b-pyramid",
+ "msdkav1enc:num-tile-cols",
+ "msdkav1enc:num-tile-rows",
+ "msdkav1enc:p-pyramid",
"msdkh264dec",
"msdkh264dec:output-order",
"msdkh264enc",
"nlesource",
"nleurisource",
"nleurisource:uri",
+ "nvautogpuh264enc",
+ "nvautogpuh264enc:adapter-luid",
+ "nvautogpuh264enc:aq-strength",
+ "nvautogpuh264enc:aud",
+ "nvautogpuh264enc:b-adapt",
+ "nvautogpuh264enc:b-frames",
+ "nvautogpuh264enc:bitrate",
+ "nvautogpuh264enc:cabac",
+ "nvautogpuh264enc:const-quality",
+ "nvautogpuh264enc:cuda-device-id",
+ "nvautogpuh264enc:gop-size",
+ "nvautogpuh264enc:i-adapt",
+ "nvautogpuh264enc:max-bitrate",
+ "nvautogpuh264enc:max-qp-b",
+ "nvautogpuh264enc:max-qp-i",
+ "nvautogpuh264enc:max-qp-p",
+ "nvautogpuh264enc:min-qp-b",
+ "nvautogpuh264enc:min-qp-i",
+ "nvautogpuh264enc:min-qp-p",
+ "nvautogpuh264enc:nonref-p",
+ "nvautogpuh264enc:preset",
+ "nvautogpuh264enc:qp-b",
+ "nvautogpuh264enc:qp-i",
+ "nvautogpuh264enc:qp-p",
+ "nvautogpuh264enc:rate-control",
+ "nvautogpuh264enc:rc-lookahead",
+ "nvautogpuh264enc:repeat-sequence-header",
+ "nvautogpuh264enc:spatial-aq",
+ "nvautogpuh264enc:strict-gop",
+ "nvautogpuh264enc:temporal-aq",
+ "nvautogpuh264enc:vbv-buffer-size",
+ "nvautogpuh264enc:weighted-pred",
+ "nvautogpuh264enc:zero-reorder-delay",
+ "nvautogpuh265enc",
+ "nvautogpuh265enc:adapter-luid",
+ "nvautogpuh265enc:aq-strength",
+ "nvautogpuh265enc:aud",
+ "nvautogpuh265enc:b-adapt",
+ "nvautogpuh265enc:b-frames",
+ "nvautogpuh265enc:bitrate",
+ "nvautogpuh265enc:const-quality",
+ "nvautogpuh265enc:cuda-device-id",
+ "nvautogpuh265enc:gop-size",
+ "nvautogpuh265enc:i-adapt",
+ "nvautogpuh265enc:max-bitrate",
+ "nvautogpuh265enc:max-qp-b",
+ "nvautogpuh265enc:max-qp-i",
+ "nvautogpuh265enc:max-qp-p",
+ "nvautogpuh265enc:min-qp-b",
+ "nvautogpuh265enc:min-qp-i",
+ "nvautogpuh265enc:min-qp-p",
+ "nvautogpuh265enc:nonref-p",
+ "nvautogpuh265enc:preset",
+ "nvautogpuh265enc:qp-b",
+ "nvautogpuh265enc:qp-i",
+ "nvautogpuh265enc:qp-p",
+ "nvautogpuh265enc:rate-control",
+ "nvautogpuh265enc:rc-lookahead",
+ "nvautogpuh265enc:repeat-sequence-header",
+ "nvautogpuh265enc:spatial-aq",
+ "nvautogpuh265enc:strict-gop",
+ "nvautogpuh265enc:temporal-aq",
+ "nvautogpuh265enc:vbv-buffer-size",
+ "nvautogpuh265enc:weighted-pred",
+ "nvautogpuh265enc:zero-reorder-delay",
+ "nvav1dec",
+ "nvav1dec:cuda-device-id",
+ "nvcudah264enc",
+ "nvcudah264enc:aq-strength",
+ "nvcudah264enc:aud",
+ "nvcudah264enc:b-adapt",
+ "nvcudah264enc:b-frames",
+ "nvcudah264enc:bitrate",
+ "nvcudah264enc:cabac",
+ "nvcudah264enc:const-quality",
+ "nvcudah264enc:cuda-device-id",
+ "nvcudah264enc:gop-size",
+ "nvcudah264enc:i-adapt",
+ "nvcudah264enc:max-bitrate",
+ "nvcudah264enc:max-qp-b",
+ "nvcudah264enc:max-qp-i",
+ "nvcudah264enc:max-qp-p",
+ "nvcudah264enc:min-qp-b",
+ "nvcudah264enc:min-qp-i",
+ "nvcudah264enc:min-qp-p",
+ "nvcudah264enc:nonref-p",
+ "nvcudah264enc:preset",
+ "nvcudah264enc:qp-b",
+ "nvcudah264enc:qp-i",
+ "nvcudah264enc:qp-p",
+ "nvcudah264enc:rate-control",
+ "nvcudah264enc:rc-lookahead",
+ "nvcudah264enc:repeat-sequence-header",
+ "nvcudah264enc:spatial-aq",
+ "nvcudah264enc:strict-gop",
+ "nvcudah264enc:temporal-aq",
+ "nvcudah264enc:vbv-buffer-size",
+ "nvcudah264enc:weighted-pred",
+ "nvcudah264enc:zero-reorder-delay",
+ "nvcudah265enc",
+ "nvcudah265enc:aq-strength",
+ "nvcudah265enc:aud",
+ "nvcudah265enc:b-adapt",
+ "nvcudah265enc:b-frames",
+ "nvcudah265enc:bitrate",
+ "nvcudah265enc:const-quality",
+ "nvcudah265enc:cuda-device-id",
+ "nvcudah265enc:gop-size",
+ "nvcudah265enc:i-adapt",
+ "nvcudah265enc:max-bitrate",
+ "nvcudah265enc:max-qp-b",
+ "nvcudah265enc:max-qp-i",
+ "nvcudah265enc:max-qp-p",
+ "nvcudah265enc:min-qp-b",
+ "nvcudah265enc:min-qp-i",
+ "nvcudah265enc:min-qp-p",
+ "nvcudah265enc:nonref-p",
+ "nvcudah265enc:preset",
+ "nvcudah265enc:qp-b",
+ "nvcudah265enc:qp-i",
+ "nvcudah265enc:qp-p",
+ "nvcudah265enc:rate-control",
+ "nvcudah265enc:rc-lookahead",
+ "nvcudah265enc:repeat-sequence-header",
+ "nvcudah265enc:spatial-aq",
+ "nvcudah265enc:strict-gop",
+ "nvcudah265enc:temporal-aq",
+ "nvcudah265enc:vbv-buffer-size",
+ "nvcudah265enc:weighted-pred",
+ "nvcudah265enc:zero-reorder-delay",
+ "nvd3d11h264enc",
+ "nvd3d11h264enc:adapter-luid",
+ "nvd3d11h264enc:aq-strength",
+ "nvd3d11h264enc:aud",
+ "nvd3d11h264enc:b-adapt",
+ "nvd3d11h264enc:b-frames",
+ "nvd3d11h264enc:bitrate",
+ "nvd3d11h264enc:cabac",
+ "nvd3d11h264enc:const-quality",
+ "nvd3d11h264enc:gop-size",
+ "nvd3d11h264enc:i-adapt",
+ "nvd3d11h264enc:max-bitrate",
+ "nvd3d11h264enc:max-qp-b",
+ "nvd3d11h264enc:max-qp-i",
+ "nvd3d11h264enc:max-qp-p",
+ "nvd3d11h264enc:min-qp-b",
+ "nvd3d11h264enc:min-qp-i",
+ "nvd3d11h264enc:min-qp-p",
+ "nvd3d11h264enc:nonref-p",
+ "nvd3d11h264enc:preset",
+ "nvd3d11h264enc:qp-b",
+ "nvd3d11h264enc:qp-i",
+ "nvd3d11h264enc:qp-p",
+ "nvd3d11h264enc:rate-control",
+ "nvd3d11h264enc:rc-lookahead",
+ "nvd3d11h264enc:repeat-sequence-header",
+ "nvd3d11h264enc:spatial-aq",
+ "nvd3d11h264enc:strict-gop",
+ "nvd3d11h264enc:temporal-aq",
+ "nvd3d11h264enc:vbv-buffer-size",
+ "nvd3d11h264enc:weighted-pred",
+ "nvd3d11h264enc:zero-reorder-delay",
+ "nvd3d11h265enc",
+ "nvd3d11h265enc:adapter-luid",
+ "nvd3d11h265enc:aq-strength",
+ "nvd3d11h265enc:aud",
+ "nvd3d11h265enc:b-adapt",
+ "nvd3d11h265enc:b-frames",
+ "nvd3d11h265enc:bitrate",
+ "nvd3d11h265enc:const-quality",
+ "nvd3d11h265enc:gop-size",
+ "nvd3d11h265enc:i-adapt",
+ "nvd3d11h265enc:max-bitrate",
+ "nvd3d11h265enc:max-qp-b",
+ "nvd3d11h265enc:max-qp-i",
+ "nvd3d11h265enc:max-qp-p",
+ "nvd3d11h265enc:min-qp-b",
+ "nvd3d11h265enc:min-qp-i",
+ "nvd3d11h265enc:min-qp-p",
+ "nvd3d11h265enc:nonref-p",
+ "nvd3d11h265enc:preset",
+ "nvd3d11h265enc:qp-b",
+ "nvd3d11h265enc:qp-i",
+ "nvd3d11h265enc:qp-p",
+ "nvd3d11h265enc:rate-control",
+ "nvd3d11h265enc:rc-lookahead",
+ "nvd3d11h265enc:repeat-sequence-header",
+ "nvd3d11h265enc:spatial-aq",
+ "nvd3d11h265enc:strict-gop",
+ "nvd3d11h265enc:temporal-aq",
+ "nvd3d11h265enc:vbv-buffer-size",
+ "nvd3d11h265enc:weighted-pred",
+ "nvd3d11h265enc:zero-reorder-delay",
"nvh264dec",
"nvh264dec!sink",
"nvh264dec!src",
"nvh264enc:temporal-aq",
"nvh264enc:vbv-buffer-size",
"nvh264enc:weighted-pred",
+ "nvh264sldec",
+ "nvh264sldec:cuda-device-id",
"nvh265dec",
"nvh265dec!sink",
"nvh265dec!src",
"nvh265enc:temporal-aq",
"nvh265enc:vbv-buffer-size",
"nvh265enc:weighted-pred",
+ "nvh265sldec",
+ "nvh265sldec:cuda-device-id",
"nvjpegdec",
"nvjpegdec!sink",
"nvjpegdec!src",
"nvvp8dec",
"nvvp8dec!sink",
"nvvp8dec!src",
+ "nvvp8sldec",
+ "nvvp8sldec:cuda-device-id",
"nvvp9dec",
"nvvp9dec!sink",
"nvvp9dec!src",
+ "nvvp9sldec",
+ "nvvp9sldec:cuda-device-id",
"oggaviparse",
"oggdemux",
"oggmux",
"playbin3:current-uri",
"playbin3:flags",
"playbin3:force-aspect-ratio",
+ "playbin3:instant-uri",
"playbin3:mute",
"playbin3:ring-buffer-max-size",
"playbin3:sample",
"plugin-decklink",
"plugin-deinterlace",
"plugin-directfb",
+ "plugin-directshow",
"plugin-directsoundsrc",
"plugin-dtls",
"plugin-dtmf",
"plugin-webp",
"plugin-webrtc",
"plugin-webrtcdsp",
+ "plugin-wic",
"plugin-wildmidi",
+ "plugin-win32ipc",
"plugin-winks",
"plugin-winscreencap",
"plugin-wpe",
"qmlglsrc:window",
"qroverlay",
"qroverlay:data",
+ "qsvav1enc",
+ "qsvav1enc:bitrate",
+ "qsvav1enc:gop-size",
+ "qsvav1enc:max-bitrate",
+ "qsvav1enc:qp-i",
+ "qsvav1enc:qp-p",
+ "qsvav1enc:rate-control",
+ "qsvav1enc:ref-frames",
+ "qsvh264dec",
+ "qsvh264enc",
+ "qsvh264enc:avbr-accuracy",
+ "qsvh264enc:avbr-convergence",
+ "qsvh264enc:b-frames",
+ "qsvh264enc:bitrate",
+ "qsvh264enc:cabac",
+ "qsvh264enc:cc-insert",
+ "qsvh264enc:disable-hrd-conformance",
+ "qsvh264enc:gop-size",
+ "qsvh264enc:icq-quality",
+ "qsvh264enc:idr-interval",
+ "qsvh264enc:max-bitrate",
+ "qsvh264enc:max-qp-b",
+ "qsvh264enc:max-qp-i",
+ "qsvh264enc:max-qp-p",
+ "qsvh264enc:min-qp-b",
+ "qsvh264enc:min-qp-i",
+ "qsvh264enc:min-qp-p",
+ "qsvh264enc:qp-b",
+ "qsvh264enc:qp-i",
+ "qsvh264enc:qp-p",
+ "qsvh264enc:qvbr-quality",
+ "qsvh264enc:rate-control",
+ "qsvh264enc:rc-lookahead",
+ "qsvh264enc:rc-lookahead-ds",
+ "qsvh264enc:ref-frames",
+ "qsvh265dec",
+ "qsvh265enc",
+ "qsvh265enc:b-frames",
+ "qsvh265enc:bitrate",
+ "qsvh265enc:cc-insert",
+ "qsvh265enc:disable-hrd-conformance",
+ "qsvh265enc:gop-size",
+ "qsvh265enc:icq-quality",
+ "qsvh265enc:idr-interval",
+ "qsvh265enc:max-bitrate",
+ "qsvh265enc:max-qp-b",
+ "qsvh265enc:max-qp-i",
+ "qsvh265enc:max-qp-p",
+ "qsvh265enc:min-qp-b",
+ "qsvh265enc:min-qp-i",
+ "qsvh265enc:min-qp-p",
+ "qsvh265enc:qp-b",
+ "qsvh265enc:qp-i",
+ "qsvh265enc:qp-p",
+ "qsvh265enc:qvbr-quality",
+ "qsvh265enc:rate-control",
+ "qsvh265enc:ref-frames",
+ "qsvjpegdec",
+ "qsvjpegenc",
+ "qsvjpegenc:quality",
+ "qsvvp9dec",
+ "qsvvp9enc",
+ "qsvvp9enc:bitrate",
+ "qsvvp9enc:gop-size",
+ "qsvvp9enc:icq-quality",
+ "qsvvp9enc:max-bitrate",
+ "qsvvp9enc:qp-i",
+ "qsvvp9enc:qp-p",
+ "qsvvp9enc:rate-control",
+ "qsvvp9enc:ref-frames",
"qtdemux",
"qtmoovrecover",
"qtmoovrecover:broken-input",
"rtpbin:rtp-profile",
"rtpbin:sdes",
"rtpbin:ts-offset-smoothing-factor",
+ "rtpbin:update-ntp64-header-ext",
"rtpbin:use-pipeline-clock",
"rtpbvdepay",
"rtpbvpay",
"rtpsession:sdes",
"rtpsession:stats",
"rtpsession:twcc-stats",
+ "rtpsession:update-ntp64-header-ext",
"rtpsession:use-pipeline-clock",
"rtpsink",
"rtpsink:address",
"rtptheorapay",
"rtptheorapay:config-interval",
"rtpulpfecdec",
+ "rtpulpfecdec:passthrough",
"rtpulpfecdec:pt",
"rtpulpfecdec:recovered",
"rtpulpfecdec:storage",
"rtpvp8pay:picture-id-mode",
"rtpvp8pay:picture-id-offset",
"rtpvp9depay",
+ "rtpvp9depay:request-keyframe",
+ "rtpvp9depay:wait-for-keyframe",
"rtpvp9pay",
"rtpvp9pay:picture-id-mode",
"rtpvrawdepay",
"rtspclientsink:proxy",
"rtspclientsink:proxy-id",
"rtspclientsink:proxy-pw",
+ "rtspclientsink:publish-clock-mode",
"rtspclientsink:retry",
"rtspclientsink:rtp-blocksize",
"rtspclientsink:rtx-time",
"rtspsrc::new-manager",
"rtspsrc::on-sdp",
"rtspsrc::push-backchannel-buffer",
+ "rtspsrc::push-backchannel-sample",
"rtspsrc::request-rtcp-key",
"rtspsrc::select-stream",
"rtspsrc::set-parameter",
"uridecodebin3:current-uri",
"uridecodebin3:download",
"uridecodebin3:force-sw-decoders",
+ "uridecodebin3:instant-uri",
"uridecodebin3:ring-buffer-max-size",
"uridecodebin3:source",
"uridecodebin3:suburi",
"urisourcebin:download",
"urisourcebin:high-watermark",
"urisourcebin:low-watermark",
+ "urisourcebin:parse-streams",
"urisourcebin:ring-buffer-max-size",
"urisourcebin:source",
"urisourcebin:statistics",
"vaapisink:signal-handoffs",
"vaapisink:view-id",
"vaapivc1dec",
+ "vaav1dec",
+ "vaav1dec:device-path",
+ "vacompositor",
+ "vacompositor:device-path",
+ "vacompositor:scale-method",
"vadeinterlace",
"vadeinterlace:method",
"vah264dec",
+ "vah264dec:device-path",
+ "vah264enc",
+ "vah264enc:aud",
+ "vah264enc:b-frames",
+ "vah264enc:b-pyramid",
+ "vah264enc:bitrate",
+ "vah264enc:cabac",
+ "vah264enc:cc-insert",
+ "vah264enc:cpb-size",
+ "vah264enc:dct8x8",
+ "vah264enc:i-frames",
+ "vah264enc:key-int-max",
+ "vah264enc:max-qp",
+ "vah264enc:mbbrc",
+ "vah264enc:min-qp",
+ "vah264enc:num-slices",
+ "vah264enc:qpb",
+ "vah264enc:qpi",
+ "vah264enc:qpp",
+ "vah264enc:ref-frames",
+ "vah264enc:target-percentage",
+ "vah264enc:target-usage",
+ "vah264enc:trellis",
"vah265dec",
+ "vah265dec:device-path",
+ "vajpegdec",
+ "vajpegdec:device-path",
"value",
"valve",
"valve:drop",
"valve:drop-mode",
"vampeg2dec",
+ "vampeg2dec:device-path",
"vapostproc",
+ "vapostproc:add-borders",
"vapostproc:disable-passthrough",
+ "vapostproc:scale-method",
"vavp8dec",
+ "vavp8dec:device-path",
"vavp9dec",
+ "vavp9dec:device-path",
"vc1parse",
"vertigotv",
"vertigotv:speed",
"wasapi2src:device",
"wasapi2src:dispatcher",
"wasapi2src:loopback",
+ "wasapi2src:loopback-mode",
+ "wasapi2src:loopback-target-pid",
"wasapi2src:low-latency",
"wasapi2src:mute",
"wasapi2src:volume",
"webrtcbin:connection-state",
"webrtcbin:current-local-description",
"webrtcbin:current-remote-description",
+ "webrtcbin:http-proxy",
"webrtcbin:ice-agent",
"webrtcbin:ice-connection-state",
"webrtcbin:ice-gathering-state",
"webvttenc",
"webvttenc:duration",
"webvttenc:timestamp",
+ "wicjpegdec",
+ "wicpngdec",
"wildmididec",
"wildmididec:enhanced-resampling",
"wildmididec:log-volume-scale",
"wildmididec:output-buffer-size",
"wildmididec:reverb",
+ "win32ipcvideosink",
+ "win32ipcvideosink:pipe-name",
+ "win32ipcvideosrc",
+ "win32ipcvideosrc:pipe-name",
+ "win32ipcvideosrc:processing-deadline",
"wmv1-encoder-cmp-func",
"wmv1-encoder-cmp-func::bit",
"wmv1-encoder-cmp-func::chroma",
"zbar:message",
"zebrastripe",
"zebrastripe:threshold"
-]
+]
\ No newline at end of file
-1.21
\ No newline at end of file
+1.22
\ No newline at end of file
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-editing-services 1.21.90.
+This is GStreamer gst-editing-services 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-editing-services/gst-editing-services-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-editing-services', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'buildtype=debugoptimized' ])
-project('gst-examples', 'c', version : '1.21.90', license : 'LGPL')
+project('gst-examples', 'c', version : '1.22.0', license : 'LGPL')
cc = meson.get_compiler('c')
m_dep = cc.find_library('m', required : false)
-project('gst-integration-testsuites', [], version: '1.21.90', meson_version : '>= 0.62', license: 'LGPL')
+project('gst-integration-testsuites', [], version: '1.22.0', meson_version : '>= 0.62', license: 'LGPL')
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-libav 1.21.90.
+This is GStreamer gst-libav 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-libav/gst-libav-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-libav', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'buildtype=debugoptimized' ])
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-omx 1.21.90.
+This is GStreamer gst-omx 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-omx/gst-omx-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-omx', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'buildtype=debugoptimized' ])
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-plugins-bad 1.21.90.
+This is GStreamer gst-plugins-bad 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-plugins-bad/gst-plugins-bad-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-plugins-bad', 'c', 'cpp',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'buildtype=debugoptimized' ])
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-plugins-base 1.21.90.
+This is GStreamer gst-plugins-base 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-plugins-base/gst-plugins-base-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-plugins-base', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'buildtype=debugoptimized' ])
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-plugins-good 1.21.90.
+This is GStreamer gst-plugins-good 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
"construct": false,
"construct-only": false,
"controllable": false,
- "default": "GStreamer 1.21.90 FLV muxer",
+ "default": "GStreamer 1.22.0 FLV muxer",
"mutable": "null",
"readable": true,
"type": "gchararray",
"construct": false,
"construct-only": false,
"controllable": false,
- "default": "GStreamer 1.21.90 FLV muxer",
+ "default": "GStreamer 1.22.0 FLV muxer",
"mutable": "null",
"readable": true,
"type": "gchararray",
"construct": false,
"construct-only": false,
"controllable": false,
- "default": "GStreamer/1.21.90",
+ "default": "GStreamer/1.22.0",
"mutable": "null",
"readable": true,
"type": "gchararray",
"construct": false,
"construct-only": false,
"controllable": false,
- "default": "GStreamer 1.21.90",
+ "default": "GStreamer 1.22.0",
"mutable": "null",
"readable": true,
"type": "gchararray",
"construct": false,
"construct-only": false,
"controllable": false,
- "default": "GStreamer souphttpsrc 1.21.90 ",
+ "default": "GStreamer souphttpsrc 1.22.0 ",
"mutable": "null",
"readable": true,
"type": "gchararray",
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-plugins-good/gst-plugins-good-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-plugins-good', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'buildtype=debugoptimized' ])
directory=gst-plugins-rs
url=https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs.git
push-url=git@gitlab.freedesktop.org:gstreamer/gst-plugins-rs.git
-revision=gstreamer-1.21.90
+revision=gstreamer-1.22.0
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-plugins-ugly 1.21.90.
+This is GStreamer gst-plugins-ugly 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-plugins-ugly/gst-plugins-ugly-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-plugins-ugly', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'buildtype=debugoptimized' ])
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-python 1.21.90.
+This is GStreamer gst-python 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-python/gst-python-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-python', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'c_std=gnu99',
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gst-rtsp-server 1.21.90.
+This is GStreamer gst-rtsp-server 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
"construct": false,
"construct-only": false,
"controllable": false,
- "default": "GStreamer/1.21.90",
+ "default": "GStreamer/1.22.0",
"mutable": "null",
"readable": true,
"type": "gchararray",
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gst-rtsp-server/gst-rtsp-server-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gst-rtsp-server', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : ['warning_level=1', 'buildtype=debugoptimized'])
-project('gstreamer-sharp', ['cs', 'c'], version: '1.21.90',
+project('gstreamer-sharp', ['cs', 'c'], version: '1.22.0',
meson_version : '>= 0.62', license: 'LGPL')
if host_machine.system() == 'osx'
public const string ENCODING_CATEGORY_ONLINE_SERVICE = @"online-service";
public const string ENCODING_CATEGORY_STORAGE_EDITING = @"storage-editing";
public const int PLUGINS_BASE_VERSION_MAJOR = 1;
- public const int PLUGINS_BASE_VERSION_MICRO = 90;
- public const int PLUGINS_BASE_VERSION_MINOR = 21;
+ public const int PLUGINS_BASE_VERSION_MICRO = 0;
+ public const int PLUGINS_BASE_VERSION_MINOR = 22;
public const int PLUGINS_BASE_VERSION_NANO = 0;
#endregion
}
public const int VALUE_LESS_THAN = -1;
public const int VALUE_UNORDERED = 2;
public const int VERSION_MAJOR = 1;
- public const int VERSION_MICRO = 90;
- public const int VERSION_MINOR = 21;
+ public const int VERSION_MICRO = 0;
+ public const int VERSION_MINOR = 22;
public const int VERSION_NANO = 0;
#endregion
}
<constant value="1" ctype="gint" gtype="gint" name="VALUE_GREATER_THAN" />
<constant value="-1" ctype="gint" gtype="gint" name="VALUE_LESS_THAN" />
<constant value="2" ctype="gint" gtype="gint" name="VALUE_UNORDERED" />
- <constant value="1" ctype="gint" gtype="gint" name="VERSION_MAJOR" />
- <constant value="90" ctype="gint" gtype="gint" name="VERSION_MICRO" />
- <constant value="21" ctype="gint" gtype="gint" name="VERSION_MINOR" />
- <constant value="0" ctype="gint" gtype="gint" name="VERSION_NANO" />
+ <constant value="1" ctype="gint" gtype="gint" name="VERSION_MAJOR" />
+ <constant value="0" ctype="gint" gtype="gint" name="VERSION_MICRO" />
+ <constant value="22" ctype="gint" gtype="gint" name="VERSION_MINOR" />
+ <constant value="0" ctype="gint" gtype="gint" name="VERSION_NANO" />
</object>
<class name="Parse" cname="GstParse" disable_void_ctor="1">
<method name="ParseBinFromDescription" cname="gst_parse_bin_from_description" shared="true">
<constant value="file-extension" ctype="gchar*" gtype="gchar*" name="ENCODING_CATEGORY_FILE_EXTENSION" />
<constant value="online-service" ctype="gchar*" gtype="gchar*" name="ENCODING_CATEGORY_ONLINE_SERVICE" />
<constant value="storage-editing" ctype="gchar*" gtype="gchar*" name="ENCODING_CATEGORY_STORAGE_EDITING" />
- <constant value="1" ctype="gint" gtype="gint" name="PLUGINS_BASE_VERSION_MAJOR" />
- <constant value="90" ctype="gint" gtype="gint" name="PLUGINS_BASE_VERSION_MICRO" />
- <constant value="21" ctype="gint" gtype="gint" name="PLUGINS_BASE_VERSION_MINOR" />
- <constant value="0" ctype="gint" gtype="gint" name="PLUGINS_BASE_VERSION_NANO" />
+ <constant value="1" ctype="gint" gtype="gint" name="PLUGINS_BASE_VERSION_MAJOR" />
+ <constant value="0" ctype="gint" gtype="gint" name="PLUGINS_BASE_VERSION_MICRO" />
+ <constant value="22" ctype="gint" gtype="gint" name="PLUGINS_BASE_VERSION_MINOR" />
+ <constant value="0" ctype="gint" gtype="gint" name="PLUGINS_BASE_VERSION_NANO" />
</object>
</namespace>
<namespace name="Gst.Rtp" library="gstrtp-1.0-0.dll">
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer gstreamer-vaapi 1.21.90.
+This is GStreamer gstreamer-vaapi 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gstreamer-vaapi/gstreamer-vaapi-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gstreamer-vaapi', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'buildtype=debugoptimized' ])
GStreamer 1.22 Release Notes
-GStreamer 1.22 has not been released yet. It is scheduled for release
-around in January 2023.
-
-1.21.x is the unstable development version that is being developed in
-the git master branch and which will eventually result in 1.22, and
-1.21.90 is the first release candidate for 1.22 (rc1) in that series
-
-A feature freeze is now into effect for the 1.21 branch, but newly-added
-API might still change until the final 1.22.0 stable release, and minor
-features may also still be added until then.
-
-1.22 will be backwards-compatible to the stable 1.20, 1.18, 1.16, 1.14,
-1.12, 1.10, 1.8, 1.6,, 1.4, 1.2 and 1.0 release series.
+GStreamer 1.22.0 was originally released on 23 January 2023.
See https://gstreamer.freedesktop.org/releases/1.22/ for the latest
version of this document.
-Last updated: Thursday 12 January 2023, 15:00 UTC (log)
+Last updated: Monday 23 January 2023, 17:00 UTC (log)
Introduction
Highlights
-- this section will be completed in due course
+- AV1 video codec support improvements
+- New HLS, DASH and Microsoft Smooth Streaming adaptive streaming
+ clients
+- Qt6 support for rendering video inside a QML scene
+- Minimal builds optimised for binary size, including only the
+ individual elements needed
+- Playbin3, Decodebin3, UriDecodebin3, Parsebin enhancements and
+ stabilisation
+- WebRTC simulcast support and support for Google Congestion Control
+- WebRTC-based media server ingestion/egress (WHIP/WHEP) support
+- New easy to use batteries-included WebRTC sender plugin
+- Easy RTP sender timestamp reconstruction for RTP and RTSP
+- ONVIF timed metadata support
+- New fragmented MP4 muxer and non-fragmented MP4 muxer
+- New plugins for Amazon AWS storage and audio transcription services
+- New gtk4paintablesink and gtkwaylandsink renderers
+- New videocolorscale element that can convert and scale in one go for
+ better performance
+- High bit-depth video improvements
+- Touchscreen event support in navigation API
+- Rust plugins now shipped in macOS and Windows/MSVC binary packages
+- H.264/H.265 timestamp correction elements for PTS/DTS reconstruction
+ before muxers
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capturing/rendering on Linux
+- Video4Linux2 hardware accelerated decoder improvements
+- CUDA integration and Direct3D11 integration and plugin improvements
+- New H.264 / AVC, H.265 / HEVC and AV1 hardware-accelerated video
+ encoders for AMD GPUs using the Advanced Media Framework (AMF) SDK
+- applemedia: H.265 / HEVC video encoding + decoding support
+- androidmedia: H.265 / HEVC video encoding support
+- New “force-live” property for audiomixer, compositor, glvideomixer,
+ d3d11compositor etc.
+- Lots of new plugins, features, performance improvements and bug
+ fixes
Major new features and changes
-Noteworthy new features and API
+AV1 video codec support improvements
+
+AV1 is a royalty free next-generation video codec by AOMedia and a free
+alternative to H.265/HEVC.
+
+While supported in earlier versions of GStreamer already, this release
+saw a lot of improvements across the board:
+
+- Support for hardware encoding and decoding via VAAPI/VA, AMF, D3D11,
+ NVCODEC, QSV and Intel MediaSDK. Hardware codecs for AV1 are slowly
+ becoming available in embedded systems and desktop GPUs (AMD, Intel,
+ NVIDIA), and these can now be used via GStreamer.
+
+- New AV1 RTP payloader and depayloader elements.
+
+- New encoder settings in the AOM reference encoder-based av1enc
+ element.
+
+- Various improvements in the AV1 parser and in the MP4/Matroska/WebM
+ muxers/demuxers.
+
+- dav1d and rav1e based software decoder/encoder elements shipped as
+ part of the binaries.
+
+- AV1 parser improvements and various bugfixes all over the place.
+
+Touchscreen event support in Navigation API
+
+The Navigation API supports the sending of key press events and mouse
+events through a GStreamer pipeline. Typically these will be picked up
+by a video sink on which these events happen and then the event is
+transmitted into the pipeline so it can be handled by elements inside
+the pipeline if it wasn’t handled by the application.
+
+This has traditionally been used for DVD menu support, but can also be
+used to forward such inputs to source elements that render a web page
+using a browser engine such as WebKit or Chromium.
+
+This API has now gained support for touchscreen events, and this has
+been implemented in various plugins such as the GTK, Qt, XV, and x11
+video sinks as well as the wpevideosrc element.
+
+GStreamer CUDA integration
+
+- New gst-cuda library
+- integration with D3D11 and NVIDIA dGPU NVMM elements
+- new cudaconvertscale element
+
+GStreamer Direct3D11 integration
+
+- New gst-d3d11 public library
+ - gst-d3d11 library is not integrated with GStreamer documentation
+ system yet. Please refer to the examples
+- d3d11screencapture: Add Windows Graphics Capture API based capture
+ mode, including Win32 application window capturing
+- d3d11videosink and d3d11convert can support flip/rotation and crop
+ meta
+- d3d11videosink: New emit-present property and present signal so that
+ applications can overlay an image on Direct3D11 swapchain’s
+ backbuffer via Direct3D/Direct2D APIs. See also C++ and Rust
+ examples
+- d3d11compositor supports YUV blending/composing without intermediate
+ RGB(A) conversion to improve performance
+- Direct3D11 video decoders are promoted to GST_RANK_PRIMARY or
+ higher, except for the MPEG2 decoder
+
+H.264/H.265 timestamp correction elements
+
+- Muxers are often picky and need proper PTS/DTS timestamps set on the
+ input buffers, but that can be a problem if the encoded input media
+ stream comes from a source that doesn’t provide proper signalling of
+ DTS, such as is often the case for RTP, RTSP and WebRTC streams or
+ Matroska container files. Theoretically parsers should be able to
+ fix this up, but it would probably require fairly invasive changes
+ in the parsers, so two new elements h264timestamper and
+ h265timestamper bridge the gap in the meantime and can reconstruct
+ missing PTS/DTS.
+
+Easy sender timestamp reconstruction for RTP and RTSP
+
+- it was always possible to reconstruct and retrieve the original RTP
+ sender timestamps in GStreamer, but required a fair bit of
+ understanding of the internal mechanisms and the right property
+ configuration and clock setup.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that if set puts the
+ original absolute reconstructed sender timestamps on the output
+ buffers via a meta. This is particularly useful if the sender is
+ synced to an NTP clock or PTP clock. The original sender timestamps
+ are either based on the RTCP NTP times, NTP RTP header extensions
+ (RFC6051) or RFC7273-style clock signalling.
+
+Qt6 support
+
+- new qml6glsink element for Qt6 similar to the existing Qt5 element.
+ Matching source and overlay elements will hopefully follow in the
+ near future.
+
+OpenGL + Video library enhancements
+
+- Support for new video formats (NV12_4L4, NV12_16L32S, NV12_8L128,
+ NV12_10BE_8L128) and dmabuf import in more formats (Y410, Y212_LE,
+ Y212_BE, Y210, NV21, NV61)
+
+- Improved support for tiled formats with arbitrary tile dimensions,
+ as needed by certain hardware decoders/encoders
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- OpenGL support for gst_video_sample_convert():
+
+ - Used for video snapshotting and thumbnailing, to convert buffers
+ retrieved from appsinks or sink “last-sample” properties in
+ JPG/PNG thumbnails.
+ - This function can now take samples and buffers backed by GL
+ textures as input and will automatically plug a gldownload
+ element in that case.
+
+High bit-depth support (10, 12, 16 bits per component value) improvements
+
+- compositor can now handle any supported input format and also mix
+ high-bitdepth (10-16 bit) formats (naively)
+
+- videoflip has gained support for higher bit depth formats.
+
+- vp9enc, vp9dec now support 12-bit formats and also 10-bit 4:4:4
+
+WebRTC
+
+- Allow insertion of bandwidth estimation elements e.g. for Google
+ Congestion Control (GCC) support
+
+- Initial support for sending or receiving simulcast streams
+
+- Support for asynchronous host resolution for STUN/TURN servers
+
+- GstWebRTCICE was split into base classes and implementation to make
+ it possible to plug custom ICE implementations
+
+- webrtcsink: batteries-included WebRTC sender (Rust)
+
+- whipsink: WebRTC HTTP ingest (WHIP) to a MediaServer (Rust)
+
+- whepsrc: WebRTC HTTP egress (WHEP) from a MediaServer (Rust)
+
+- Many other improvements and bug fixes
+
+New HLS, DASH and MSS adaptive streaming clients
+
+A new set of “adaptive demuxers” to support HLS, DASH and MSS adaptive
+streaming protocols has been added. They provide improved performance,
+new features and better stream compatibility compared to the previous
+elements. These new elements require a “streams-aware” pipeline such as
+playbin3, uridecodebin3 or urisourcebin.
+
+The previous elements’ design prevented implementing several use-cases
+and fixing long-standing issues. The new elements were re-designed from
+scratch to tackle those:
+
+- Scheduling Only 3 threads are present, regardless of the number of
+ streams selected. One in charge of downloading fragments and
+ manifests, one in charge of outputting parsed data downstream, and
+ one in charge of scheduling. This improves performance, resource
+ usage and latency.
+
+- Better download control The elements now directly control the
+ scheduling and download of manifests and fragments using libsoup
+ directly instead of depending on external elements for downloading.
+
+- Stream selection, only the selected streams are downloaded. This
+ improves bandwith usage. Switching stream is done in such a way to
+ ensure there are no gaps, meaning the new stream will be switched to
+ only once enough data for it has been downloaded.
+
+- Internal parsing, the downloaded streams are parsed internally. This
+ allows the element to fully respect the various specifications and
+ offer accurate buffering, seeking and playback. This is especially
+ important for HLS streams which require parsing for proper
+ positioning of streams.
+
+- Buffering and adaptive rate switching, the new elements handle
+ buffering internally which allows them to have a more accurate
+ visibility of which bandwith variant to switch to.
+
+Playbin3, Decodebin3, UriDecodebin3, Parsebin improvements
+
+The “new” playback elements introduced in 1.18 (playbin3 and its various
+components) have been refactored to allow more use-cases and improve
+performance. They are no longer considered experimental, so applications
+using the legacy playback elements (playbin and (uri)decodebin) can
+migrate to the new components to benefit from these improvements.
+
+- Gapless The “gapless” feature allows files and streams to be
+ fetched, buffered and decoded in order to provide a “gapless”
+ output. This feature has been refactored extensively in the new
+ components:
+ - A single (uri)decodebin3 (and therefore a single set of
+ decoders) is used. This improves memory and cpu usage, since on
+ identical codecs a single decoder will be used.
+ - The “next” stream to play will be pre-rolled “just-in-time”
+ thanks to the buffering improvements in urisourcebin (see below)
+ - This feature is now handled at the uridecodebin3 level.
+ Applications that wish to have a “gapless” stream and process it
+ (instead of just outputting it, for example for transcoding,
+ retransmission, …) can now use uridecodebin3 directly. Note that
+ a streamsynchronizer element is required in that case.
+- Buffering improvements The urisourcebin element is in charge of
+ fetching and (optionally) buffering/downloading the stream. It has
+ been extended and improved:
+ - When the parse-streams property is used (by default in
+ uridecodebin3 and playbin3), compatible streams will be demuxed
+ and parsed (via parsebin) and buffering will be done on the
+ elementary streams. This provides a more accurate handling of
+ buffering. Previously buffering was done on a best-effort basis
+ and was mostly wrong (i.e. downloading more than needed).
+ - Applications can use urisourcebin with this property as a
+ convenient way of getting elementary streams from a given URI.
+ - Elements can handle buffering themselves (such as the new
+ adaptive demuxers) by answering the GST_QUERY_BUFFERING query.
+ In that case urisourcebin will not handle it.
+- Stream Selection Efficient stream selection was previously only
+ possible within decodebin3. The downside is that this meant that
+ upstream elements had to provide all the streams from which to chose
+ from, which is inefficient. With the addition of the
+ GST_QUERY_SELECTABLE query, this can now be handled by elements
+ upstream (i.e. sources)
+ - Elements that can handle stream selection internally (such as
+ the new adaptive demuxer elements) answer that query, and handle
+ the stream selection events themselves.
+ - In this case, decodebin3 will always process all streams that
+ are provided to it.
+- Instant URI switching This new feature allows switching URIs
+ “instantly” in playbin3 (and uridecodebin3) without having to change
+ states. This mimics switching channels on a television.
+ - If compatible, decoders will be re-used, providing lower
+ latency/cpu/memory than by switching states.
+ - This is enabled by setting the instant-uri property to true,
+ setting the URI to switch to immediately, and then disabling the
+ instant-uri property again afterwards.
+- playbin3, decodebin3, uridecodebin3, parsebin, and urisrc are no
+ longer experimental
+ - They were originally marked as ‘technology preview’ but have
+ since seen extensive usage in production settings, so are
+ considered ready for general use now.
+
+Fraunhofer AAC audio encoder HE-AAC and AAC-LD profile support
+
+- fdkaacenc:
+ - Support for encoding to HE-AACv1 and HE-AACv2 profile
+ - Support for encoding to AAC Low Delay (LD) profile
+ - Advanced bitrate control options via new “rate-control”,
+ “vbr-preset”, “peak-bitrate”, and “afterburner” properties
+
+RTP rapid synchronization support in the RTP stack (RFC6051)
+
+RTP provides several mechanisms how streams can be synchronized relative
+to each other, and how absolute sender times for RTP packets can be
+obtained. One of these mechanisms is via RTCP, which has the
+disadvantage that the synchronization information is only distributed
+out-of-band and usually some time after the start.
+
+GStreamer’s RTP stack, specifically the rtpbin, rtpsession and
+rtpjitterbuffer elements, now also have support for retrieving and
+sending the same synchronization information in-band via RTP header
+extensions according to RFC6051 (Rapid Synchronisation of RTP Flows).
+Only 64-bit timestamps are supported currently.
+
+This provides per packet synchronization information from the very
+beginning of a stream and allows accurate inter-stream, and (depending
+on setup) inter-device, synchronization at the receiver side.
+
+ONVIF XML Timed Metadata support
+
+The ONVIF standard implemented by various security cameras also
+specifies a format for timed metadata that is transmitted together with
+the audio/video streams, usually over RTSP.
+
+Support for this timed metadata is implemented in the MP4 demuxer now as
+well as the new fragmented MP4 muxer and the new non-fragmented MP4
+muxer from the GStreamer Rust plugins. Additionally, the new onvif
+plugin ‒ which is part of the GStreamer Rust plugins ‒ provides general
+elements for handling the metadata and e.g. overlaying certain parts of
+it over a video stream.
+
+As part of this support for absolute UTC times was also implemented
+according to the requirements of the ONVIF standards in the
+corresponding elements.
+
+MP3 gapless playback support
+
+While MP3 can probably considered a legacy format at this point, a new
+feature was added with this release.
+
+When playing back plain MP3 files, i.e. outside a container format,
+switches between files can now be completely gapless if the required
+metadata is provided inside the file. There is no standardized metadata
+for this, but the LAME MP3 encoder writes metadata that can be parsed by
+the mpegaudioparse element now and forwarded to decoders for ensuring
+removal of padding samples at the front and end of MP3 files.
+
+“force-live” property for audio + video aggregators
+
+This is a quality of life fix for playout and streaming applications
+where it is common to have audio and video mixer elements that should
+operate in live mode from the start and produce output continuously.
+
+Often one would start a pipeline without any inputs hooked up to these
+mixers in the beginning, and up until now there was no way to easily
+force these elements into live mode from the start. One would have to
+add an initial live video or audio test source as dummy input to achieve
+this.
+
+The new “force-live” property makes these audio and video aggregators
+start in live mode without the need for any dummy inputs, which is
+useful for scenarios where inputs are only added after starting the
+pipeline.
+
+This new property should usually be used in connection with the
+“min-upstream-latency” property, i.e. you should always set a non-0
+minimum upstream latency then.
+
+This is now supported in all GstAudioAggregator and GstVideoAggregator
+subclasses such as audiomixer, audiointerleave, compositor,
+glvideomixer, d3d11compositor, etc.
+
+New elements and plugins
+
+- new cudaconvertscale element that can convert and scale in one pass
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
+
+- new h264timestamper and h265timestamper elements to reconstruct
+ missing pts/dts from inputs that might not provide them such as
+ e.g. RTP/RTSP/WebRTC inputs (see above)
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- new msdkav1enc AV1 video encoder element
+
+- new nvcudah264enc, nvcudah265enc, nvd3d11h264enc, and nvd3d11h265enc
+ NVIDIA GPU encoder elements to support zero-copy encoding, via CUDA
+ and Direct3D11 APIs, respectively
+
+- new nvautogpuh264enc and nvautogpuh265enc NVIDIA GPU encoder
+ elements: The auto GPU elements will automatically select a target
+ GPU instance in case multiple NVIDIA desktop GPUs are present, also
+ taking into account the input memory. On Windows CUDA or Direct3D11
+ mode will be determined by the elements automatically as well. Those
+ new elements are useful if target GPU and/or API mode (either CUDA
+ or Direct3D11 in case of Windows) is undeterminable from the encoder
+ point of view at the time when pipeline is configured, and therefore
+ lazy target GPU and/or API selection are required in order to avoid
+ unnecessary memory copy operations.
+
+- new nvav1dec AV1 NVIDIA desktop GPU decoder element
+
+- new qml6glsink element to render video with Qt6
+
+- qsv: New Intel OneVPL/MediaSDK (a.k.a Intel Quick Sync) based
+ decoder and encoder elements, with gst-d3d11 (on Windows) and gst-va
+ (on Linux) integration
-- this section will be filled in in due course
+ - Support multi-GPU environment, for example, concurrent video
+ encoding using Intel iGPU and dGPU in a single pipeline
+ - H.264 / H.265 / VP9 and JPEG decoders
+ - H.264 / H.265 / VP9 / AV1 / JPEG encoders with dynamic encoding
+ bitrate update
+ - New plugin does not require external SDK for building on Windows
-New elements
+- vulkanoverlaycompositor: new vulkan overlay compositor element to
+ overlay upstream GstVideoOverlayCompositonMeta onto the video
+ stream.
-- this section will be filled in in due course
+- vulkanshaderspv: performs operations with SPIRV shaders in Vulkan
+
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements for Windows
+
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- Many exciting new Rust elements, see Rust section below
New element features and additions
-- this section will be filled in in due course
+- audioconvert: Dithering now uses a slightly slower, less biased PRNG
+ which results in better quality output. Also dithering can now be
+ enabled via the new “dithering-threshold” property for target bit
+ depths of more than 20 bits.
+
+- av1enc: Add “keyframe-max-dist” property for controlling max
+ distance between keyframes, as well as “enc-pass”, “keyframe-mode”,
+ “lag-in-frames” and “usage-profile” properties.
+
+- cccombiner: new “output-padding” property
+
+- decklink: Add support for 4k DCI, 8k/UHD2 and 8k DCI modes
+
+- dvbsubenc: Support for >SD resolutions is working correctly now.
+
+- fdkaacenc: Add HE-AAC / HE-AACv2 profile support
+
+- glvideomixer: New “crop-left,”crop-right, “crop-top” and
+ “crop-bottom” pad properties for cropping inputs
+
+- gssink: new ‘content-type’ property. Useful when one wants to upload
+ a video as video/mp4 instead of ’video/quicktime` for example.
+
+- jpegparse: Rewritten using the common parser library
+
+- msdk:
+
+ - new msdkav1enc AV1 video encoder element
+ - msdk decoders: Add support for Scaler Format Converter (SFC) on
+ supported Intel platforms for hardware accelerated conversion
+ and scaling
+ - msdk encoders: support import of dmabuf, va memory and D3D11
+ memory
+ - msdk encoders: add properties for low delay bitrate control and
+ max frame sizes for I/P frames
+ - msdkh264enc, msdkh265enc: more properties to control intra
+ refresh
+ - note that on systems with multi GPUs the Windows D3D11
+ integration might only work reliably if the Intel GPU is the
+ primary GPU
+
+- mxfdemux: Add support for Canon XF-HEVC
+
+- openaptx: Support the freeaptx library
+
+- qroverlay:
+
+ - new “qrcode-case-sensitive” property allows encoding case
+ sensitive strings like wifi SSIDs or passwords.
+ - added the ability to pick up data to render from an
+ upstream-provided custom GstQROverlay meta
+
+- qtdemux: Add support for ONVIF XML Timed MetaData and AVC-Intra
+ video
+
+- rfbsrc now supports the uri handler interface, so applications can
+ use RFB/VNC sources in uridecodebin(3) and playbin, with
+ e.g. rfb://:password@10.1.2.3:5903?shared=1
+
+- rtponviftimestamp: Add support for using reference timestamps
+
+- rtpvp9depay now has the same keyframe-related properties as
+ rtpvp8depay and rtph264depay: “request-keyframe” and
+ “wait-for-keyframe”
+
+- rtspsrc: Various RTSP servers are using invalid URL operations for
+ constructing the control URL. Until GStreamer 1.16 these worked
+ correctly because GStreamer was just appending strings itself to
+ construct the control URL, but starting version 1.18 the correct URL
+ operations were used. With GStreamer 1.22, rtspsrc now first tries
+ with the correct control URL and if that fails it will retry with
+ the wrongly constructed control URL to restore support for such
+ servers.
+
+- rtspsrc and rtpjitterbuffer gained a new
+ “add-reference-timestamp-meta” property that makes them put the
+ unmodified original sender timestamp on output buffers for NTP or
+ PTP clock synced senders
+
+- srtsrc, srtsink: new “auto-reconnect” property to make it possible
+ to disable automatic reconnects (in caller mode) and make the
+ elements post an error immediately instead; also stats improvements
+
+- srtsrc: new “keep-listening” property to avoid EOS on disconnect and
+ keep the source running while it waits for a new connection.
+
+- videocodectestsink: added YUV 4:2:2 support
+
+- wasapi2src: Add support for process loopback capture
+
+- wpesrc: Add support for modifiers in key/touch/pointer events
Plugin and library moves
-- this section will be filled in in due course
+- The xingmux plugin has been moved from gst-plugins-ugly into
+ gst-plugins-good.
-- There were no plugin moves or library moves in this cycle.
+- The various Windows directshow plugins in gst-plugins-bad have been
+ unified into a single directshow plugin.
Plugin removals
-The following elements or plugins have been removed:
-
-- this section will be filled in in due course
+- The dxgiscreencapsrc element has been removed, use
+ d3d11screencapturesrc instead
Miscellaneous API additions
-- this section will be filled in in due course
+- GST_AUDIO_FORMAT_INFO_IS_VALID_RAW() and
+ GST_VIDEO_FORMAT_INFO_IS_VALID_RAW() can be used to check if a
+ GstAudioFormatInfo or GstVideoFormatInfo has been initialised to a
+ valid raw format.
+
+- Video SEI meta: new GstVideoSEIUserDataUnregisteredMeta to carry
+ H.264 and H.265 metadata from SEI User Data Unregistered messages.
+
+- vulkan: Expose gst_vulkan_result_to_string()
Miscellaneous performance, latency and memory optimisations
-- this section will be filled in in due course
+- liborc 0.4.33 adds support for aarch64 (64-bit ARM) architecture
+ (not enabled by default on Windows yet though) and improvements for
+ 32-bit ARM and should greatly enhance performance for certain
+ operations that use ORC.
+
+- as always there have been plenty of performance, latency and memory
+ optimisations all over the place.
Miscellaneous other changes and enhancements
-- this section will be filled in in due course
+- the audio/video decoder base classes will not consider decoding
+ errors a hard error by default anymore but will continue trying to
+ decode. Previously more than 10 consecutive errors were considered a
+ hard error but this caused various partially broken streams to fail.
+ The threshold is configurable via the “max-errors” property.
+
+- compatibility of the GStreamer PTP clock implementation with
+ different PTP server implementations was improved, and
+ synchronization is achieved successfully in various scenarios that
+ failed before.
Tracing framework and debugging improvements
-- this section will be filled in in due course
+New tracers
+
+- buffer-lateness: Records lateness of buffers and the reported
+ latency for each pad in a CSV file. Comes with a script for
+ visualisation.
+
+- pipeline-snapshot: Creates a .dot file of all pipelines in the
+ application whenever requested via SIGUSR1 (on UNIX systems)
+
+- queue-levels: Records queue levels for each queue in a CSV file.
+ Comes with a script for visualisation.
+
+Debug logging system improvements
+
+- new log macros GST_LOG_ID, GST_DEBUG_ID, GST_INFO_ID,
+ GST_WARNING_ID, GST_ERROR_ID, and GST_TRACE_ID allow passing a
+ string identifier instead of a GObject. This makes it easier to log
+ non-gobject-based items and also has performance benefits.
Tools
-- this section will be filled in in due course
+- gst-play-1.0 gained a --no-position command line option to suppress
+ position/duration queries, which can be useful to reduce debug log
+ noise.
+
+GStreamer FFMPEG wrapper
+
+- Fixed bitrate management and timestamp inaccuracies for video
+ encoders
+
+- Fix synchronization issues and errors created by the (wrong)
+ forwarding of upstream segment events by ffmpeg demuxers.
+
+- Clipping meta support for gapless mp3 playback
GStreamer RTSP server
-- this section will be filled in in due course
+- Add RFC5576 Source-specific media attribute to the SDP media for
+ signalling the CNAME
+
+- Add support for adjusting request response on pipeline errors
+
+ - Give the application the possibility to adjust the error code
+ when responding to a request. For that purpose the pipeline’s
+ bus messages are emitted to subscribers through a
+ “handle-message” signal. The subscribers can then check those
+ messages for errors and adjust the response error code by
+ overriding the virtual method
+ GstRTSPClientClass::adjust_error_code().
+
+- Add gst_rtsp_context_set_token() method to make it possible to set
+ the RTSPToken on some RTSPContext from bindings such as the Python
+ bindings.
+
+- rtspclientsink gained a “publish-clock-mode” property to configure
+ whether the pipeline clock should be published according to RFC7273
+ (RTP Clock Source Signalling), similar to the same API on
+ GstRTSPMedia.
+
+GStreamer VA-API support
+
+- Development activity has shifted towards the new va plugin, with
+ gstreamer-vaapi now basically in maintenance-only mode. Most of the
+ below refers to the va plugin (not gstreamer-vaapi).
+
+- new gst-va library for GStreamer VA-API integration
+
+- vajpegdec: new JPEG decoder
+
+- vah264enc, vah265enc: new H.264/H.265 encoders
+
+- vah264lpenc, vah265lpenc: new low power mode encoders
+
+- vah265enc: Add extended formats support such as 10/12 bits, 4:2:2
+ and 4:4:4
+
+- Support encoder reconfiguration
+
+- vacompositor: Add new compositor element using the VA-API VPP
+ interface
+
+- vapostproc:
+
+ - new “scale-method” property
+ - Process HDR caps if supported
+ - parse video orientation from tags
+
+- vaapipostproc: Enable the use of DMA-Buf import and export
+ (gstreamer-vaapi)
+
+GStreamer Video4Linux2 support
-GStreamer VAAPI
+- Added support for Mediatek Stateless CODEC (VP8, H.264, VP9)
-- this section will be filled in in due course
+- Stateless H.264 interlaced decoder support
+
+- Stateless H.265 decoder support
+
+- Stateful decoder support for driver resolution change events
+
+- Stateful decoding support fixes for NXP/Amphion driver
+
+- Support for hardware crop in v4l2src
+
+- Conformance test improvement for stateful decoders
+
+- Fixes for Raspberry Pi CODEC
GStreamer OMX
-- this section will be filled in in due course
+- There were no changes in this module
GStreamer Editing Services and NLE
-- this section will be filled in in due course
+- Handle compositors that are bins around the actual compositor
+ implementation (like glvideomixers which wraps several elements)
+
+- Add a mode to disable timeline editing API so the user can be in
+ full control of its layout (meaning that the user is responsible for
+ ensuring its validity/coherency)
+
+- Add a new fade-in transition type
+
+- Add support for non-1/1 PAR source videos
+
+- Fix frame accuracy when working with very low framerate streams
GStreamer validate
-- this section will be filled in in due course
+- Clean up and stabilize API so we can now generate rust bindings
+
+- Enhance the appsrc-push action type allowing to find tune the
+ buffers more in details
+
+- Add an action type to verify currently configured pad caps
+
+- Add a way to run checks from any thread after executing a ‘wait’
+ action. This is useful when waiting on a signal and want to check
+ the value of a property right when it is emited for example.
GStreamer Python Bindings
-- this section will be filled in in due course
+- Add a Gst.init_python() function to be called from plugins which
+ will initialise everything needed for the GStreamer Python bindings
+ but not call Gst.init() again since this will have been called
+ already.
+
+- Add support for the GstURIHandlerInterface that allows elements to
+ advertise what URI protocols they support.
GStreamer C# Bindings
-- this section will be filled in in due course
+- Fix AppSrc and AppSink constructors
+
+- The C# bindings have yet to be updated to include new 1.22 API,
+ which requires improvements in various places in the bindings /
+ binding generator stack. See issue #1718 in GitLab for more
+ information and to track progress.
GStreamer Rust Bindings and Rust Plugins
The GStreamer Rust bindings are released separately with a different
release cadence that’s tied to gtk-rs, but the latest release has
-already been updated for the upcoming new GStreamer 1.22 API.
+already been updated for the new GStreamer 1.22 API. Check the bindings
+release notes for details of the changes since 0.18, which was released
+around GStreamer 1.20.
gst-plugins-rs, the module containing GStreamer plugins written in Rust,
-has also seen lots of activity with many new elements and plugins.
-
-What follows is a list of elements and plugins available in
-gst-plugins-rs, so people don’t miss out on all those potentially useful
-elements that have no C equivalent.
-
-- FIXME: add new elements
-
-Rust audio plugins
-
-- audiornnoise: New element for audio denoising which implements the
- noise removal algorithm of the Xiph RNNoise library, in Rust
-- rsaudioecho: Port of the audioecho element from gst-plugins-good
- rsaudioloudnorm: Live audio loudness normalization element based on
- the FFmpeg af_loudnorm filter
-- claxondec: FLAC lossless audio codec decoder element based on the
- pure-Rust claxon implementation
-- csoundfilter: Audio filter that can use any filter defined via the
- Csound audio programming language
-- lewtondec: Vorbis audio decoder element based on the pure-Rust
- lewton implementation
-
-Rust video plugins
-
-- cdgdec/cdgparse: Decoder and parser for the CD+G video codec based
- on a pure-Rust CD+G implementation, used for example by karaoke CDs
-- cea608overlay: CEA-608 Closed Captions overlay element
-- cea608tott: CEA-608 Closed Captions to timed-text (e.g. VTT or SRT
- subtitles) converter
-- tttocea608: CEA-608 Closed Captions from timed-text converter
-- mccenc/mccparse: MacCaption Closed Caption format encoder and parser
-- sccenc/sccparse: Scenarist Closed Caption format encoder and parser
-- dav1dec: AV1 video decoder based on the dav1d decoder implementation
- by the VLC project
-- rav1enc: AV1 video encoder based on the fast and pure-Rust rav1e
- encoder implementation
-- rsflvdemux: Alternative to the flvdemux FLV demuxer element from
- gst-plugins-good, not feature-equivalent yet
-- rsgifenc/rspngenc: GIF/PNG encoder elements based on the pure-Rust
- implementations by the image-rs project
-
-Rust text plugins
-
-- textwrap: Element for line-wrapping timed text (e.g. subtitles) for
- better screen-fitting, including hyphenation support for some
- languages
-
-Rust network plugins
-
-- reqwesthttpsrc: HTTP(S) source element based on the Rust
- reqwest/hyper HTTP implementations and almost feature-equivalent
- with the main GStreamer HTTP source souphttpsrc
-- s3src/s3sink: Source/sink element for the Amazon S3 cloud storage
-- awstranscriber: Live audio to timed text transcription element using
- the Amazon AWS Transcribe API
-
-Generic Rust plugins
-
-- sodiumencrypter/sodiumdecrypter: Encryption/decryption element based
- on libsodium/NaCl
-- togglerecord: Recording element that allows to pause/resume
- recordings easily and considers keyframe boundaries
-- fallbackswitch/fallbacksrc: Elements for handling potentially
- failing (network) sources, restarting them on errors/timeout and
- showing a fallback stream instead
-- threadshare: Set of elements that provide alternatives for various
- existing GStreamer elements but allow to share the streaming threads
- between each other to reduce the number of threads
-- rsfilesrc/rsfilesink: File source/sink elements as replacements for
- the existing filesrc/filesink elements
+has also seen lots of activity with many new elements and plugins. A
+list of all Rust plugins and elements provided with the 0.9 release can
+be found in the repository.
+
+- 33% of GStreamer commits are now in Rust (bindings + plugins), and
+ the Rust plugins module is also where most of the new plugins are
+ added these days.
+
+- The Rust plugins are now shipped as part of the Windows MSVC + macOS
+ binary packages. See below for the list of shipped plugins and the
+ status of Rust support in cerbero.
+
+- The Rust plugins are also part of the documentation on the GStreamer
+ website now.
+
+- Rust plugins can be used from any programming language. To the
+ outside they look just like a plugin written in C or C++.
+
+New Rust plugins and elements
+
+- rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec
+- gtk4paintablesink: a GTK4 video sink that provides a GdkPaintable
+ for rendering a video in any place inside a GTK UI. Supports
+ zero-copy rendering via OpenGL on Linux and macOS.
+- ndi: source, sink and device provider for NewTek NDI protocol
+- onvif: Various elements for parsing, RTP (de)payloading, overlaying
+ of ONVIF timed metadata.
+- livesync: Element for converting a live stream into a continuous
+ stream without gaps and timestamp jumps while preserving live
+ latency requirements.
+- raptorq: Encoder/decoder elements for the RaptorQ FEC mechanism that
+ can be used for RTP streams (RFC6330).
+
+WebRTC elements
+
+- webrtcsink: a WebRTC sink (batteries included WebRTC sender with
+ specific signalling)
+- whipsink: WebRTC HTTP ingest (WHIP) to MediaServer
+- whepsrc: WebRTC HTTP egress (WHEP) from MediaServer
+- rtpgccbwe: RTP bandwidth estimator based on the Google Congestion
+ Control algorithm (GCC), used by webrtcsink
+
+Amazon AWS services
+
+- awss3src / awss3sink: A source and sink element to talk to the
+ Amazon S3 object storage system.
+- awss3hlssink: A sink element to store HLS streams on Amazon S3.
+- awstranscriber: an element wrapping the AWS Transcriber service.
+- awstranscribeparse: an element parsing the packets of the AWS
+ Transcriber service.
+
+Video Effects (videofx)
+
+- roundedcorners: Element to make the corners of a video rounded via
+ the alpha channel.
+- colordetect: A pass-through filter able to detect the dominant
+ color(s) on incoming frames, using color-thief.
+- videocompare: Compare similarity of video frames. The element can
+ use different hashing algorithms like Blockhash, DSSIM, and others.
+
+New MP4 muxer + Fragmented MP4 muxer
+
+- fmp4mux: New fragmented MP4/ISOBMFF/CMAF muxer for generating
+ e.g. DASH/HLS media fragments.
+- isomp4mux: New non-fragmented, normal MP4 muxer.
+
+Both plugins provides elements that replace the existing qtmux/mp4mux
+element from gst-plugins-good. While not feature-equivalent yet, the new
+codebase and using separate elements for the fragment and non-fragmented
+case allows for easier extensability in the future.
+
+Cerbero Rust support
+
+- Starting this release, cerbero has support for building and shipping
+ Rust code on Linux, Windows (MSVC) and macOS. The Windows (MSVC) and
+ macOS binaries also ship the GStreamer Rust plugins in this release.
+ Only dynamic plugins are built and shipped currently.
+
+- Preliminary support for Android, iOS and Windows (MinGW) exists but
+ more work is needed. Check the tracker issue for more details about
+ future work.
+
+- The following plugins are included currently: audiofx, aws, cdg,
+ claxon, closedcaption, dav1d, fallbackswitch, ffv1, fmp4, gif,
+ hlssink3, hsv, json, livesync, lewton, mp4, ndi, onvif, rav1e,
+ regex, reqwest, raptorq, png, rtp, textahead, textwrap, threadshare,
+ togglerecord, tracers, uriplaylistbin, videofx, webrtc, webrtchttp.
Build and Dependencies
-- this section will be filled in in due course
+- meson 0.62 or newer is required
-- GLib >= 2.64 is now required (technically it still says >= 2.62 but
- the plan is to bump that to 2.64 soon once some CI issues are sorted
- out)
+- GLib >= 2.62 is now required (but GLib >= 2.64 is strongly
+ recommended)
- libnice >= 0.1.21 is now required and contains important fixes for
GStreamer’s WebRTC stack.
-gst-build
+- liborc >= 0.4.33 is recommended for 64-bit ARM support and 32-bit
+ ARM improvements
+
+- onnx: OnnxRT >= 1.13.1 is now required
+
+- openaptx: can now be built against libfreeaptx
+
+- opencv: allow building against any 4.x version
+
+- shout: libshout >= 2.4.3 is now required
-- this section will be filled in in due course
+- gstreamer-vaapi’s Meson build options have been switched from a
+ custom combo type (yes/no/auto) to the built-in Meson feature type
+ (enabled/disabled/auto)
+
+- The GStreamer Rust plugins module gst-plugins-rs is now considered
+ an essential part of the GStreamer plugin offering and packagers and
+ distributors are strongly encouraged to package and ship those
+ plugins alongside the existing plugin modules.
+
+- we now make use of Meson’s install tags feature which allows
+ selective installation of installl components and might be useful
+ for packagers.
+
+Monorepo build (gst-build)
+
+- new “orc-source” build option to allow build against a
+ system-installed liborc instead of forcing the use of orc as a
+ subproject.
+
+- GStreamer command line tools can now be linked to the gstreamer-full
+ library if it’s built
Cerbero
Cerbero is a meta build system used to build GStreamer plus dependencies
on platforms where dependencies are not readily available, such as
-Windows, Android, iOS and macOS.
+Windows, Android, iOS, and macOS.
General improvements
-- this section will be filled in in due course
+- Rust support was added for all support configurations, controlled by
+ the rust variant; see above for more details
+- All pkgconfig files are now reliably relocatable without requiring
+ pkg-config --define-prefix. This also fixes statically linking with
+ GStreamer plugins using the corresponding pkgconfig files.
+- New documentation on how to build a custom GStreamer repository
+ using Cerbero, please see the README
+- HTTPS certificate checking is enabled for downloads on all platforms
+ now
+- Fetching now automatically retries on error for robustness against
+ transient errors
+- Support for building the new Qt6 plugin was added
+- pkgconfig files for various recipes were fixed
+- Several recipes were updated to newer versions
+- New plugins: adaptivedemux2 aes codectimestamper dav1d
+- New libraries: cuda webrtcnice
macOS / iOS
-- this section will be filled in in due course
+- Added support for running Cerbero on ARM64 macOS
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+- Apple bitcode support was dropped, since Apple has deprecated it
+- macOS installer now correctly advertises support for both x86_64 and
+ arm64
+- macOS framework now ships the gst-rtsp-server-1.0 library
+- Various fixes were made to make static linking to gstreamer
+ libraries and plugins work correctly on macOS
+- When statically linking to the applemedia plugin using Xcode 13, you
+ will need to pass -fno-objc-msgsend-selector-stubs which works
+ around a backwards-incompatible change in Xcode 14. This is not
+ required for the rest of GStreamer at present, but will be in the
+ future.
+- macOS installer now shows the GStreamer logo correctly
Windows
-- this section will be filled in in due course
+- MSVC is now required by default on Windows, and the Visual Studio
+ variant is enabled by default
+ - To build with MinGW, use the mingw variant
+- Visual Studio props files were updated for newer Visual Studio
+ versions
+- Visual Studio 2015 support was dropped
+- MSYS2 is now supported as the base instead of MSYS. Please see the
+ README for more details. Some advantages include:
+ - Faster build times, since parallel make works
+ - Faster bootstrap, since some tools are provided by MSYS2
+ - Other speed-ups due to using MSYS2 tools instead of MSYS
+- Faster download by using powershell instead of hand-rolled Python
+ code
+- Many recipes were ported from Autotools to Meson, speeding up the
+ build
+- Universal Windows Platform is no longer supported, and binaries are
+ no longer shipped for it
+- New documentation on how to force a specific Visual Studio
+ installation in Cerbero, please see the README
+- New plugins: qsv wavpack directshow amfcodec wic win32ipc
+- New libraries: d3d11
Windows MSI installer
-- this section will be filled in in due course
+- Universal Windows Platform prebuilt binaries are no longer available
Linux
-- this section will be filled in in due course
+- Various fixes for RHEL/CentOS 7 support
+- Added support for running on Linux ARM64
Android
-- this section will be filled in in due course
+- Android support now requires Android API version 21 (Lollipop)
+- Support for Android Gradle plugin 7.2
Platform-specific changes and improvements
Android
-- this section will be filled in in due course
+- Android SDK 21 is required now as minimum SDK version
+
+- androidmedia: Add H.265 / HEVC video encoder mapping
+
+- Implement JNI_OnLoad() to register static plugins etc. automatically
+ in case GStreamer is loaded from Java using System.loadLibrary(),
+ which is also useful for the gst-full deployment scenario.
+
+Apple macOS and iOS
+
+- The GLib version shipped with the GStreamer binaries does not
+ initialize an NSApp and does not run a NSRunLoop on the main thread
+ anymore. This was a custom GLib patch and caused it to behave
+ different from the GLib shipped by Homebrew or anybody else.
+
+ The change was originally introduced because various macOS APIs
+ require a NSRunLoop to run on the main thread to function correctly
+ but as this change will never get merged into GLib and it was
+ reverted for 1.22. Applications that relied on this behaviour should
+ move to the new gst_macos_main() function, which also does not
+ require the usage of a GMainLoop.
-macOS and iOS
+ See e.g. gst-play.c for an example for the usage of
+ gst_macos_main().
-- this section will be filled in in due course
+- GStreamer.framework and all libraries in it are now relocatable,
+ which means they use LC_RPATH entries to find dependencies instead
+ of using an absolute path. If you link to GStreamer using the
+ pkgconfig files, no action is necessary. However, if you use the
+ framework directly or link to the libraries inside the framework by
+ hand, then you need to pass -Wl,-rpath,<path_to_libdir> to the
+ linker.
+
+- avfvideosrc: Allow specifying crop coordinates during screen capture
+
+- vtenc, vtdec: H.265 / HEVC video encoding + decoding support
+
+- osxaudiosrc: Support a device as both input and output
+
+ - osxaudiodeviceprovider now probes devices more than once to
+ determine if the device can function as both an input AND and
+ output device. Previously, if the device provider detected that
+ a device had any output capabilities, it was treated solely as
+ an Audio/Sink. This caused issues for devices that have both
+ input and output capabilities (for example, USB interfaces for
+ professional audio have both input and output channels). Such
+ devicesare now listed as both an Audio/Sink as well as an
+ Audio/Source.
+
+- osxaudio: support hidden devices on macOS
+
+ - These are devices that will not be shown in the macOS UIs and
+ that cannot be retrieved without having the specific UID of the
+ hidden device. There are cases when you might want to have a
+ hidden device, for example when having a virtual speaker that
+ forwards the data to a virtual hidden input device from which
+ you can then grab the audio. The blackhole project supports
+ these hidden devices and this change provides a way that if the
+ device id is a hidden device it will use it instead of checkinf
+ the hardware list of devices to understand if the device is
+ valid.
Windows
-- this section will be filled in in due course
+- win32ipcvideosink, win32ipcvideosrc: new shared memory videosrc/sink
+ elements
+
+- wasapi2: Add support for process loopback capture for a specified
+ PID (requires Windows 11/Windows Server 2022)
- The Windows universal UWP build is currently non-functional and will
need updating after the recent GLib upgrade. It is unclear if anyone
is using these binaries, so if you are please make yourself known.
+- wicjpegdec, wicpngdec: Windows Imaging Component (WIC) based JPEG
+ and PNG decoder elements.
+
+- mfaacdec, mfmp3dec: Windows MediaFoundation AAC and MP3 decoders
+
+- The uninstalled development environment supports PowerShell 7 now
+
Linux
-- this section will be filled in in due course
+- Improved design for DMA buffer sharing and modifier handling for
+ hardware-accelerated video decoders/encoders/filters and
+ capture/rendering on Linux and Linux-like system.
+
+- kmssink
+
+ - new “fd” property which allows an application to provide their
+ own opened DRM device fd handle to kmssink. That way an
+ application can lease multiple fd’s from a DRM master to display
+ on different CRTC outputs at the same time with multiple kmssink
+ instances, for example.
+ - new “skip-vsync” property to achieve full framerate with legacy
+ emulation in drivers.
+ - HDR10 infoframe support
+
+- va plugin and gstreamer-vaapi improvements (see above)
+
+- waylandsink: Add “rotate-method” property and “render-rectangle”
+ property
+
+- new gtkwaylandsink element based on gtksink, but similar to
+ waylandsink and uses Wayland APIs directly instead of rendering with
+ Gtk/Cairo primitives. This approach is only compatible with Gtk3,
+ and like gtksink this element only supports Gtk3.
Documentation improvements
-- this section will be filled in in due course
+- The GStreamer Rust plugins are now included and documented in the
+ plugin documentation.
Possibly Breaking Changes
-- this section will be filled in in due course
+- the Opus audio RTP payloader and depayloader no longer accept the
+ lower case encoding-format=multiopus but instead produce and accept
+ only the upper case variant encoding-format=MULTIOPUS, since those
+ should always be upper case in GStreamer (caps fields are always
+ case sensitive). This should hopefully only affect applications
+ where RTP caps are set manually and multi-channel audio (>= 3
+ channels) is used.
+
+- wpesrc: the URI handler protocols changed from wpe:// and web:// to
+ web+http://, web+https://, and web+file:// which means URIs are RFC
+ 3986 compliant and the source can simply strip the prefix from the
+ protocol.
+
+- The Windows screen capture element dxgiscreencapsrc has been
+ removed, please use d3d11screencapturesrc instead.
+
+- On Android the minimum supported Android API version is now version
+ 21 and has been increased from 16.
+
+- On macOS, the GLib version shipped with the GStreamer binaries will
+ no longer initialize an NSApp or run an NSRunLoop on the main
+ thread. See macOS/iOS section above for details.
+
+- decklink: The decklink plugin is now using the 12.2.2 version of the
+ SDK and will not work with drivers older than version 12.
-- the Opus audio payloader and depayloader no longer accept the lower
- case encoding-format=multiopus but instead produce and accept only
- the upper case variant encoding-format=MULTIOPUS, since those should
- always be upper case in GStreamer (caps fields are always case
- sensitive). This should hopefully only affect applications where RTP
- caps are set manually and multi-channel audio (>= 3 channels) is
- used.
+- On iOS Apple Bitcode support was removed from the binaries. This
+ feature is deprecated since XCode 14 and not used on the App Store
+ anymore.
+
+- The MP4/Matroska/WebM muxers now require the “stream-format” to be
+ provided as part of the AV1 caps as only the original “obu-stream”
+ format is supported in these containers and not the “annexb” format.
Known Issues
-- this section will be filled in in due course
+- The Windows UWP build in Cerbero needs fixing after the recent GLib
+ upgrade (see above)
+
+- The C# bindings have not been updated to include new 1.22 API yet
+ (see above)
+
+Statistics
+
+- 4072 commits
+
+- 2224 Merge Requests
+
+- 716 Issues
+
+- 200+ Contributors
+
+- ~33% of all commits and Merge Requests were in Rust modules
+
+- 4747 files changed
-- Known regressions/blockers:
+- 469633 lines added
- - FIXME
+- 209842 lines deleted
-- GStreamer may fail to build the hotdoc documentation with the Meson
- 0.64.0 release owing to a Meson bug. This should only affect systems
- where hotdoc is installed, and will be fixed in Meson 0.64.1 by
- Meson PR 10982 in combination with GStreamer MR 3352. In the
- meantime, users can pass -Ddoc=disabled or downgrade to an older
- Meson version (< 0.64.0).
+- 259791 lines added (net)
Contributors
Ádám Balázs, Adam Doupe, Adrian Fiergolski, Adrian Perez de Castro, Alba
Mendez, Aleix Conchillo Flaqué, Aleksandr Slobodeniuk, Alicia Boya
García, Alireza Miryazdi, Andoni Morales Alastruey, Andrew Pritchard,
-Arun Raghavan, Bastian Krause, Bastien Nocera, Benjamin Gaignard, Brad
-Hards, Branko Subasic, Bruce Liang, Camilo Celis Guzman, Carlos
-Falgueras García, Carlos Rafael Giani, Célestin Marot, Christopher
-Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Corentin Damman,
-Corentin Noël, Damian Hobson-Garcia, Daniel Almeida, Daniel Morin,
-Daniel Stone, Daniels Umanovskis, Danny Smith, David Svensson Fors,
-Devin Anderson, Diogo Goncalves, Dmitry Osipenko, Dongil Park, Doug
-Nazar, Edward Hervey, Eli Schwartz, Elliot Chen, Enrique Ocaña González,
-Eric Knapp, Erwann Gouesbet, Fabian Orccon, Fabrice Fontaine, Fan F He,
-fduncanh, Filip Hanes, Florian Zwoch, François Laignel, Fuga Kato,
-George Kiagiadakis, Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua
-Hu, Havard Graff, Heiko Becker, He Junyan, Hoonhee Lee, Hosang Lee, Hou
-Qi, Ignacio Casal Quinteiro, Ignazio Pillai, Igor V. Kovalenko, Jakub
-Adam, James Cowgill, James Hilliard, Jan Alexander Steffens (heftig),
-Jan Schmidt, Jianhui Dai, jinsl00000, Johan Sternerup, Jonas Bonn, Jonas
-Danielsson, Jordan Petridis, Joseph Donofry, Jose Quaresma, Julian
-Bouzas, Junsoo Park, Justin Chadwell, Khem Raj, Krystian Wojtas, László
-Károlyi, Linus Svensson, Loic Le Page, Loïc Le Page, Ludvig Rappe, Marc
-Leeman, Marek Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum,
-Martin Reboredo, Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew
-Waters, Matthias Clasen, Matthias Fuchs, Mengkejiergeli Ba, MG
-Lolenstine, Michael Gruner, Michal Kubiak, Mikhail Fludkov, Ming Qian,
-Myles Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête,
-Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter Stensson,
-Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr Brzeziński,
-Piotrek Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral,
-Raul Tambre, Robert Mader, Robert Rosengren, Rouven Czerwinski, Ruben
-Gonzalez, Sam Van Den Berge, Sanchayan Maity, Sangchul Lee, Sebastian
-Dröge, Sebastian Fricke, Sebastian Groß, Sebastian Mueller, Sebastian
-Wick, Sergei Kovalev, Seungha Yang, Sherrill Lin, Shingo Kitagawa,
-Stéphane Cerveau, Thibault Saunier, Tim Mooney, Tim-Philipp Müller,
-Tomasz Andrzejak, Tom Schuring, Tong Wu, toor, Tristan Matthews, Tulio
-Beloqui, U. Artie Eoff, Víctor Manuel Jáquez Leal, Vincent Cheah Beng
-Keat, Vivia Nikolaidou, Vivienne Watermeier, WANG Xuerui, Wojciech
-Kapsa, Wonchul Lee, Wu Tong, Xabier Rodriguez Calvar, Xavier Claessens,
-Yatin Maan, Yeongjin Jeong, Zebediah Figura, Zhao Zhili, Zhiyuan Liu,
+Arun Raghavan, A. Wilcox, Bastian Krause, Bastien Nocera, Benjamin
+Gaignard, Bill Hofmann, Bo Elmgreen, Boyuan Zhang, Brad Hards, Branko
+Subasic, Bruce Liang, Bunio FH, byran77, Camilo Celis Guzman, Carlos
+Falgueras García, Carlos Rafael Giani, Célestin Marot, Christian Wick,
+Christopher Obbard, Christoph Reiter, Chris Wiggins, Chun-wei Fan, Colin
+Kinloch, Corentin Damman, Corentin Noël, Damian Hobson-Garcia, Daniel
+Almeida, Daniel Morin, Daniel Stone, Daniels Umanovskis, Danny Smith,
+David Svensson Fors, Devin Anderson, Diogo Goncalves, Dmitry Osipenko,
+Dongil Park, Doug Nazar, Edward Hervey, ekwange, Eli Schwartz, Elliot
+Chen, Enrique Ocaña González, Eric Knapp, Erwann Gouesbet, Evgeny
+Pavlov, Fabian Orccon, Fabrice Fontaine, Fan F He, F. Duncanh, Filip
+Hanes, Florian Zwoch, François Laignel, Fuga Kato, George Kiagiadakis,
+Guillaume Desmottes, Gu Yanjie, Haihao Xiang, Haihua Hu, Havard Graff,
+Heiko Becker, He Junyan, Henry Hoegelow, Hiero32, Hoonhee Lee, Hosang
+Lee, Hou Qi, Hugo Svirak, Ignacio Casal Quinteiro, Ignazio Pillai, Igor
+V. Kovalenko, Jacek Skiba, Jakub Adam, James Cowgill, James Hilliard,
+Jan Alexander Steffens (heftig), Jan Lorenz, Jan Schmidt, Jianhui Dai,
+jinsl00000, Johan Sternerup, Jonas Bonn, Jonas Danielsson, Jordan
+Petridis, Joseph Donofry, Jose Quaresma, Julian Bouzas, Junsoo Park,
+Justin Chadwell, Khem Raj, Krystian Wojtas, László Károlyi, Linus
+Svensson, Loïc Le Page, Ludvig Rappe, Marc Leeman, Marek Olejnik, Marek
+Vasut, Marijn Suijten, Mark Nauwelaerts, Martin Dørum, Martin Reboredo,
+Mart Raudsepp, Mathieu Duponchelle, Matt Crane, Matthew Waters, Matthias
+Clasen, Matthias Fuchs, Mengkejiergeli Ba, MGlolenstine, Michael Gruner,
+Michiel Konstapel, Mikhail Fludkov, Ming Qian, Mingyang Ma, Myles
+Inglis, Nicolas Dufresne, Nirbheek Chauhan, Olivier Crête, Pablo Marcos
+Oltra, Patricia Muscalu, Patrick Griffis, Paweł Stawicki, Peter
+Stensson, Philippe Normand, Philipp Zabel, Pierre Bourré, Piotr
+Brzeziński, Rabindra Harlalka, Rafael Caricio, Rafael Sobral, Rafał
+Dzięgiel, Raul Tambre, Robert Mader, Robert Rosengren, Rodrigo
+Bernardes, Rouven Czerwinski, Ruben Gonzalez, Sam Van Den Berge,
+Sanchayan Maity, Sangchul Lee, Sebastian Dröge, Sebastian Fricke,
+Sebastian Groß, Sebastian Mueller, Sebastian Wick, Sergei Kovalev,
+Seungha Yang, Seungmin Kim, sezanzeb, Sherrill Lin, Shingo Kitagawa,
+Stéphane Cerveau, Talha Khan, Taruntej Kanakamalla, Thibault Saunier,
+Tim Mooney, Tim-Philipp Müller, Tomasz Andrzejak, Tom Schuring, Tong Wu,
+toor, Tristan Matthews, Tulio Beloqui, U. Artie Eoff, Víctor Manuel
+Jáquez Leal, Vincent Cheah Beng Keat, Vivia Nikolaidou, Vivienne
+Watermeier, WANG Xuerui, Wojciech Kapsa, Wonchul Lee, Wu Tong, Xabier
+Rodriguez Calvar, Xavier Claessens, Yatin Mann, Yeongjin Jeong, Zebediah
+Figura, Zhao Zhili, Zhiyuaniu, مهدي شينون (Mehdi Chinoune),
… and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
1.22.0
-1.22.0 is scheduled to be released in January 2023.
+1.22.0 was originally released on 23 January 2023.
Schedule for 1.24
------------------------------------------------------------------------
These release notes have been prepared by Tim-Philipp Müller with
-contributions from …
+contributions from Edward Hervey, Matthew Waters, Nicolas Dufresne,
+Nirbheek Chauhan, Olivier Crête, Sebastian Dröge, Seungha Yang, and
+Thibault Saunier.
License: CC BY-SA 4.0
-This is GStreamer core 1.21.90.
+This is GStreamer core 1.22.0.
-The GStreamer team is thrilled to announce a first release candidate of a new
-major feature release of your favourite cross-platform multimedia framework!
+The GStreamer team is thrilled to announce a new major feature release
+of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and
other improvements.
The 1.22 release series adds new features on top of the 1.20 series and is
part of the API and ABI-stable 1.x release series.
-Full release notes will soon be available at:
+Full release notes can be found at:
https://gstreamer.freedesktop.org/releases/1.22/
<release>
<Version>
+ <revision>1.22.0</revision>
+ <branch>main</branch>
+ <name></name>
+ <created>2023-01-23</created>
+ <file-release rdf:resource="https://gstreamer.freedesktop.org/src/gstreamer/gstreamer-1.22.0.tar.xz" />
+ </Version>
+ </release>
+
+ <release>
+ <Version>
<revision>1.21.90</revision>
<branch>main</branch>
<name></name>
project('gstreamer', 'c',
- version : '1.21.90',
+ version : '1.22.0',
meson_version : '>= 0.62',
default_options : [ 'warning_level=1',
'buildtype=debugoptimized' ])
projects / platform / upstream / gstreamer.git / commitdiff