Jordan Petridis [Mon, 2 Dec 2019 16:23:27 +0000 (18:23 +0200)]
windows: Migrate to windows 1809 base
Rebuild the windows docker image against the current ltsc [1]
of server 2019. This requires moving some of the msys setup
to the runner job cause it causes docker build to hang
Switch the job tags so they now use the 1809 runner, instead
of 1607.
Tweak the PATHs in the msys job so bash doesn't complain about
slashes..
Lastly, increase the timeout of the windows jobs, as msys2
installs its deps at runtime
[1] https://docs.microsoft.com/en-us/windows-server/get-started-19/servicing-channels-19
Matthew Waters [Mon, 2 Dec 2019 23:37:16 +0000 (10:37 +1100)]
gitlab: build cerbero android/ios for gst-docs examples
Jordan Petridis [Mon, 2 Dec 2019 22:53:02 +0000 (00:53 +0200)]
ci_template: Increase the timeout of gst-builds more
Need to take into account I/O needed to upload artficats
and download docker images.
Jordan Petridis [Sun, 1 Dec 2019 12:46:27 +0000 (14:46 +0200)]
ci_template: Bump the timeout limit from 10 to 15min for windows
Jordan Petridis [Thu, 28 Nov 2019 12:59:30 +0000 (14:59 +0200)]
ci_template: set per-job timeouts for builds
In case a build gets stuck for whatever reason,
happens from time to time on windows,
try to baild out quickly.
For cerbero builds, set the timeout to 3h which
according to the docs should also be able to
override the project defined timeout
Fix #19
https://docs.gitlab.com/ce/ci/yaml/README.html#timeout
Jordan Petridis [Mon, 25 Nov 2019 13:51:52 +0000 (15:51 +0200)]
ci_template: Use a host-mapped volume for the ccache directory
Use hardcoded path for the cache, so it will be shared by
all jobs of all gstreamer projects running on the same runner host. This
should increase the hit rate and decrease the worst case storage used.
Adaptation of https://gitlab.freedesktop.org/mesa/mesa/merge_requests/2818
See https://gitlab.freedesktop.org/freedesktop/freedesktop/issues/120
Matthew Waters [Thu, 28 Nov 2019 01:55:51 +0000 (12:55 +1100)]
update for macos 10.15 making / read-only
We've moved the host cached cerbero directory to /Users/gst-ci/cerbero
instead now.
Jordan Petridis [Fri, 22 Nov 2019 15:23:15 +0000 (17:23 +0200)]
ci_template.yml: Update the windows image used
Jordan Petridis [Fri, 22 Nov 2019 13:44:56 +0000 (15:44 +0200)]
docker/windows: update the version of various deps we install
Jordan Petridis [Thu, 21 Nov 2019 14:21:50 +0000 (16:21 +0200)]
ci_template: skip unnecessary jobs for gst-integration-testsuites
Close #42
Jordan Petridis [Tue, 19 Nov 2019 13:47:38 +0000 (15:47 +0200)]
ci_template: set the TIMEOUT_FACTOR of gst-validate-launcher to 2
We have lots of tests that timeout on the CI due to a high load
of jobs on the CI runners. Let's try giving them a bit more time
and see how its going.
Nirbheek Chauhan [Sun, 10 Nov 2019 09:56:48 +0000 (15:26 +0530)]
ci_template.yml: Use the new docker cerbero-fedora image
This has nasm temporarily added in it using
https://gitlab.freedesktop.org/gstreamer/gst-ci/merge_requests/179
Nirbheek Chauhan [Sat, 9 Nov 2019 22:57:14 +0000 (04:27 +0530)]
docker/cerbero: Temporarily add nasm to the system setup
We will later install it as part of the cerbero bootstrap step when
generating the image after
https://gitlab.freedesktop.org/gstreamer/cerbero/merge_requests/320 is
merged.
Jordan Petridis [Thu, 7 Nov 2019 10:51:29 +0000 (11:51 +0100)]
citemplate: Tag test jobs to only run on the dedicated runners
Avoid spreading the jobs on lower power runners which ends
up trippling the execution time of the testsuites and/or timing out.
Thibault Saunier [Mon, 12 Aug 2019 21:17:03 +0000 (17:17 -0400)]
docker: Stop using mdv and use bat to colorize markdown
Thibault Saunier [Mon, 12 Aug 2019 21:15:47 +0000 (17:15 -0400)]
Revert "gitlab: Set COLUMNS and width variable to make terminal_markdown_view happy"
This reverts commit
157f94fb62da7582fce90c85bf2338999d83b7cc.
Víctor Manuel Jáquez Leal [Fri, 25 Oct 2019 15:38:43 +0000 (17:38 +0200)]
ci_template: remove gstreamer-vaapi control in test tag
Since now gstreamer-vaapi is blacklisted in
validate (https://gitlab.freedesktop.org/gstreamer/gst-devtools/merge_requests/134)
there is no need to make exceptions in the CI. This patch removes
those exceptions.
Jordan Petridis [Thu, 24 Oct 2019 12:13:03 +0000 (15:13 +0300)]
ci_template: refresh the docker images used for the CI
Jordan Petridis [Fri, 9 Aug 2019 10:27:37 +0000 (13:27 +0300)]
ci_template: update the fedora image to a newer build
Among other things, it includes the wpe dependencies !148 and
glslc !145
U. Artie Eoff [Wed, 9 Oct 2019 15:37:01 +0000 (08:37 -0700)]
ci_template: avoid check.gstreamer-vaapi
Check tests are being added to gstreamer/gstreamer-vaapi!181.
However, gstreamer-vaapi inherently requires specific hardware
drivers and platforms to function. The CI does not provide this
level of driver/platform selection. Thus, avoid running any
check tests in gstreamer-vaapi.
Jordan Petridis [Wed, 11 Sep 2019 14:39:14 +0000 (17:39 +0300)]
ci_template: Add an auto-retry policy
Its common that docker will throw transient errors, especially
on the windows runner. If such the case, automatically retry
the job.
Matthew Waters [Tue, 24 Sep 2019 02:39:11 +0000 (12:39 +1000)]
Revert "docker/cerbero/fedora install openssl-devel libraries"
This reverts commit
4a8beec41044e21ffeec73b7e58d0afaf112e689.
Matthew Waters [Thu, 19 Sep 2019 15:47:52 +0000 (01:47 +1000)]
gitlab: update cerbero docker image used
Matthew Waters [Tue, 24 Sep 2019 01:33:46 +0000 (11:33 +1000)]
docker/cerbero/fedora install openssl-devel libraries
Temporary workaround until cerbero installs the library itself
Jordan Petridis [Mon, 9 Sep 2019 13:01:08 +0000 (16:01 +0300)]
docker: improve logging of the setup scripts
Jordan Petridis [Wed, 11 Sep 2019 14:41:06 +0000 (17:41 +0300)]
docker/fedora: install debuginfo for python3-libs as well
Jordan Petridis [Thu, 5 Sep 2019 19:53:20 +0000 (22:53 +0300)]
.gitlab-ci.yml: Rename the UID variable in the docker build job
UID is a read-only protected variable in bash 5.0+
Jordan Petridis [Wed, 11 Sep 2019 13:50:27 +0000 (16:50 +0300)]
.gitlab-ci.yml: export artifacts for the fedora build job
20f5d7d646e7c941d71bb7264a9ba6b868982be3 stopped exporting artifacts
from the .build template which broke the local jobs since they
no longer exported the builddir.
Jordan Petridis [Fri, 6 Sep 2019 15:22:55 +0000 (18:22 +0300)]
fedora/docker: remove the fedora openh264 package
The cisco repository has been problematic for a while causing
dnf to error due to some gpg issue and break the pipe in non-interactive
ttys.
```
Importing GPG key 0xCFC659B9:
Userid : "Fedora (30) <fedora-30-primary@fedoraproject.org>"
Fingerprint: F1D8 EC98 F241 AAF2 0DF6 9420 EF3C 111F CFC6 59B9
From : /etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-30-x86_64
The command '/bin/sh -c /usr/bin/sh /root/prepare.sh && /usr/bin/sh /root/cleanup.sh' returned a non-zero code: 141
```
https://gitlab.freedesktop.org/gstreamer/gst-ci/-/jobs/573870
We do have a meson subproject for openh264 nowdays in gst-build
and it will get enabled automatically once the distro package
is no longer there.
Matthew Waters [Thu, 12 Sep 2019 03:05:37 +0000 (13:05 +1000)]
gitlab: build the ios examples in the cerbero repository
Nirbheek Chauhan [Wed, 11 Sep 2019 07:45:21 +0000 (13:15 +0530)]
gitlab: Rename all cross jobs to have a cross- prefix
For consistency, and to differentiate, f.ex., cross-windows jobs from
native windows jobs.
Nirbheek Chauhan [Tue, 10 Sep 2019 09:08:18 +0000 (14:38 +0530)]
gitlab: Windows Cerbero jobs are cross
Change the name to avoid confusion.
Matthew Waters [Tue, 10 Sep 2019 07:45:17 +0000 (17:45 +1000)]
gitlab: remove needs from ios examples job
needs and manual jobs do not really get along
https://gitlab.com/gitlab-org/gitlab-ce/issues/66602
Matthew Waters [Wed, 28 Aug 2019 16:00:28 +0000 (02:00 +1000)]
gitlab: add ios app build testing
Edward Hervey [Thu, 5 Sep 2019 15:25:37 +0000 (17:25 +0200)]
docker: Upgrade cerbero image to use fedora 30
Jordan Petridis [Fri, 9 Aug 2019 11:31:07 +0000 (14:31 +0300)]
ci_template: Only export artifacts for the main fedora build job
We are only using the builddir of the main fedora job to run
tests, the rest where exported by accident. Its especially
problematic cause static build eat a bunch of space and take
an eternity to be uploaded.
Part of #32
Thibault Saunier [Tue, 27 Aug 2019 23:30:49 +0000 (19:30 -0400)]
ci: Cleanup gst-docs build
Make sure to build against the plain fedora build and avoid
building useless things when inside gst-docs
Víctor Manuel Jáquez Leal [Thu, 29 Aug 2019 11:23:51 +0000 (13:23 +0200)]
gitlab: no need of vaapi nor omx on windows builds
Matthew Waters [Fri, 30 Aug 2019 01:57:06 +0000 (11:57 +1000)]
gitlab: enable werror for macos builds
Matthew Waters [Mon, 26 Aug 2019 07:46:28 +0000 (17:46 +1000)]
gitlab: enable werror for android universal builds
Matthew Waters [Mon, 26 Aug 2019 10:57:16 +0000 (20:57 +1000)]
gitlab: add a clang gst-build job
Matthew Waters [Tue, 27 Aug 2019 11:26:28 +0000 (21:26 +1000)]
gitlab: use the new needs yaml key
Allows implementing a DAG where a dependant job can be built before the
entirety of the previous stage has completed.
Matthew Waters [Mon, 26 Aug 2019 11:56:40 +0000 (21:56 +1000)]
gitlab: renable gst-build werror after msvc CI merge
31cec0a2459b38ae64d8bbb3f2060d2d86f8f86f removed --werror from the
default meson args but did not add it back in all the correct places
Jordan Petridis [Mon, 1 Jul 2019 15:55:46 +0000 (18:55 +0300)]
docker/windows: refactorings to get it to work with the new runner
* Install git-lfs as its required now by gst-integration-suites
* Clone gst-build eache time to avoid dated gst-build checkouts
and overwritting .wrap files. Similar to !137
* Split the dockerfile and add a second run stage refresh the
powershell env inbetween calls
* Remove the msys2 workaround as its not needed anymore
Xavier Claessens [Sun, 25 Nov 2018 18:38:06 +0000 (13:38 -0500)]
Add Windows MSVC and MSYS2 builds
This adds 3 new jobs that build against msys2 x86_64, msvc 2017 x86
and msvc 2017 x86_64. For the msvc build, some subprojects (like libnice)
don't satisfy all their deps, and are getting automatically disabled.
This doesn't add jobs that run the test suite also. Will hopefully
get implemented later on.
Xavier Claessens [Sun, 25 Nov 2018 18:35:54 +0000 (13:35 -0500)]
Do not specify the compiler to use
Meson will autodetect ccache when available, and we don't always have
gcc available (upcoming MSVC job).
Thibault Saunier [Fri, 9 Aug 2019 15:36:00 +0000 (11:36 -0400)]
gitlab: Set COLUMNS and width variable to make terminal_markdown_view happy
Philippe Normand [Tue, 6 Aug 2019 10:06:46 +0000 (11:06 +0100)]
docker/fedora: Enable WPEWebKit support
These dependencies should enable the WPE plugin build in -bad.
See https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/839
Thibault Saunier [Wed, 7 Aug 2019 16:40:27 +0000 (12:40 -0400)]
Move to Fedora 30
Jordan Petridis [Mon, 15 Jul 2019 09:06:38 +0000 (12:06 +0300)]
docker/fedora: avoid hardcoding the fedora version in the setup script
Matthew Waters [Fri, 5 Jul 2019 03:19:41 +0000 (13:19 +1000)]
docker/fedora: add glslc to the install list
Enables building the vulkan plugin with shaders
Matthew Waters [Fri, 14 Jun 2019 10:59:19 +0000 (20:59 +1000)]
gitlab/cerbero: use the correct branch on fetch-cache
Matthew Waters [Sun, 16 Jun 2019 03:51:39 +0000 (13:51 +1000)]
gitlab: make non-cerbero iOS build manual
Matthew Waters [Sun, 16 Jun 2019 03:50:23 +0000 (13:50 +1000)]
Revert "CI: Disable build cerbero ios universal"
This reverts commit
34cb58f294881e59e0728de18913d4bab188ef62.
Nicolas Dufresne [Sat, 15 Jun 2019 20:49:49 +0000 (16:49 -0400)]
CI: Disable build cerbero ios universal
This fails because the master CI of cerbero/ never passed with, as a
result an older cerbero is being used.
Related to #29
Matthew Waters [Sun, 2 Jun 2019 07:17:04 +0000 (17:17 +1000)]
add iOS CI
Matthew Waters [Wed, 12 Jun 2019 05:38:14 +0000 (15:38 +1000)]
gitlab: consolidate stages
This now optimizes for a successful build.
Matthew Waters [Wed, 12 Jun 2019 15:00:04 +0000 (01:00 +1000)]
gitlab: update android docker image to the latest
Matthew Waters [Wed, 12 Jun 2019 04:26:10 +0000 (14:26 +1000)]
docker/android: cache gradle deps inside the docker image
Matthew Waters [Tue, 11 Jun 2019 05:50:41 +0000 (15:50 +1000)]
gst-build: clone gst-build directly instead of relying on the docker version
The git-update that is performed attempts to update gst-build however
will not use the updated git-update script for further operations. This
causes the CI to not use any updates to the git-update which is always
stuck on the version provided by the backing docker image.
Tim-Philipp Müller [Tue, 16 Apr 2019 12:06:38 +0000 (13:06 +0100)]
gitlab/ci_template: only run valgrind for MRs not master and stable branches
The valgrind runs are there to spot obvious problems during the dev phase,
not sure we really need to run them in full after each merge.
Should reduce load on the build bots a little.
If any problems slip in they will be picked up soon enough by
the MR jobs again.
Nicolas Dufresne [Fri, 7 Jun 2019 14:15:06 +0000 (10:15 -0400)]
gitlab: Update cerbero docker to the new MingW
Nicolas Dufresne [Wed, 5 Jun 2019 02:28:46 +0000 (22:28 -0400)]
docker: cerbero: Fix for mingw tarball rename
Jordan Petridis [Wed, 24 Apr 2019 05:42:27 +0000 (08:42 +0300)]
gitlab/build_manifest: allow for upstream branch to be specified
When the pipeline is based on top of a stable branch, we want
to track that branch isntead of the primary development branch.
This patch makes it so the upstream branch can be specified with
an env var.
part of #11
Nicolas Dufresne [Wed, 5 Jun 2019 13:54:17 +0000 (13:54 +0000)]
Revert "gitlab: build libnice as part of cerbero deps"
This reverts commit
478686faa76917bef6df32c73c538e05fb8f6813
Matthew Waters [Wed, 5 Jun 2019 06:12:56 +0000 (16:12 +1000)]
gitlab: build libnice as part of cerbero deps
Building the same libnice from the same tarball every time is not
useful.
Matthew Waters [Wed, 5 Jun 2019 05:49:13 +0000 (15:49 +1000)]
gitlab-ci: move overriden dist dir copy to after cache fetch
Otherwise, the cache will not be copied to the overriden dist dir for
the normal fast builds.
Matthew Waters [Mon, 1 Apr 2019 02:24:46 +0000 (13:24 +1100)]
add macos CI
Nirbheek Chauhan [Sat, 25 May 2019 11:48:12 +0000 (13:48 +0200)]
gitlab: Add static builds for gst-build
Thibault Saunier [Sat, 1 Jun 2019 00:12:55 +0000 (20:12 -0400)]
gitlab: Always run hotdoc from git
We are moving too fast in hotdoc and the overhead of
releasing and updating docker images is too big
Thibault Saunier [Mon, 27 May 2019 14:38:17 +0000 (10:38 -0400)]
doc: Use latest image with update hotdoc
Thibault Saunier [Wed, 29 May 2019 02:59:19 +0000 (22:59 -0400)]
fedora: Install gtk3 and gdk-pixbuf documentation
Jordan Petridis [Fri, 24 May 2019 15:32:16 +0000 (18:32 +0300)]
gitlab/ci_template: make sure that the fedora build job is never run on cerbero
We exclude cerbero in the .build template but that key
is getting overwritten since !126. Valgrind needs to be
fixed first in order to remove this and the previous
workarounds.
Jordan Petridis [Wed, 24 Apr 2019 06:58:31 +0000 (09:58 +0300)]
gitlab/build_manifest: add gst-sharp to the module list
Thibault Saunier [Thu, 16 May 2019 18:03:09 +0000 (14:03 -0400)]
gitlab: Fix mixup in excepting gst-docs to build the nodebug job
Thibault Saunier [Tue, 14 May 2019 16:03:49 +0000 (12:03 -0400)]
Add support to build the documentation
Since we can't run valgrind tests on fedora 30 yet (see
https://gitlab.freedesktop.org/gstreamer/gst-ci/merge_requests/125),
we build the nodebug variant with the F30 image and use the artifacts
of that build to build the documentation and not the main one.
Thibault Saunier [Tue, 14 May 2019 01:51:15 +0000 (21:51 -0400)]
gitlab: Run all valgrind jobs when running in gst-ci
Everything needs to be tested there as we might be updating the docker image
Thibault Saunier [Tue, 14 May 2019 01:48:36 +0000 (21:48 -0400)]
Revert "Add support for building the doc"
This reverts commit
58861fd41092c625caf9f577d9f84574654a7cca.
Thibault Saunier [Mon, 13 May 2019 23:35:55 +0000 (19:35 -0400)]
doc-importer: Update job name now that we build the API doc
Thibault Saunier [Fri, 19 Apr 2019 21:42:14 +0000 (17:42 -0400)]
gitlab: Do not "build nodebug fedora" on gst-docs
And do not build at all for gst-examples either
Thibault Saunier [Sun, 11 Nov 2018 02:34:59 +0000 (23:34 -0300)]
Add support for building the doc
Thibault Saunier [Mon, 13 May 2019 17:56:06 +0000 (13:56 -0400)]
docker: Always get latest hotdoc release
We had another little mistake to fix and that might
happen often in the future so let's use latest releases for
now.
Thibault Saunier [Mon, 13 May 2019 15:26:23 +0000 (11:26 -0400)]
docker: Update hotdoc to latest release
Tim-Philipp Müller [Thu, 2 May 2019 08:25:57 +0000 (09:25 +0100)]
gitlab/ci_template: no need to do cerbero builds for gstreamer-vaapi
Nicolas Dufresne [Thu, 2 May 2019 21:28:42 +0000 (17:28 -0400)]
gitlab: manifest: Use a cerbero ref with build
For non-cerbero builds, pick a cerbero reference for which a build has
completed. This will reduce the number of cache miss, hence reduce the
number of timeouts and slow build we are facing each time cerbero is
updated.
Fixes #16
Thibault Saunier [Wed, 1 May 2019 13:50:58 +0000 (09:50 -0400)]
gitlab: Check bugs resolutions when running the validate/ges testsuite
Thibault Saunier [Thu, 25 Apr 2019 20:48:02 +0000 (16:48 -0400)]
docker: Explicitely install flex before installing hotdoc
Thibault Saunier [Mon, 22 Apr 2019 16:56:06 +0000 (12:56 -0400)]
docker:fedora: Use meson 0.50.1
Thibault Saunier [Mon, 22 Apr 2019 16:25:29 +0000 (12:25 -0400)]
gitlab: Do not pass --force-sync in the launcher
We let subproject handle it for us now
Thibault Saunier [Sun, 11 Nov 2018 02:34:59 +0000 (23:34 -0300)]
docker: Install hotdoc and required packages to build the doc
Jordan Petridis [Tue, 12 Feb 2019 11:49:30 +0000 (13:49 +0200)]
Fedora docker: Bump to f30
Needed to get an upgraded ffmpeg.
Also required to have a new enough version of gobject-introspection
and remove all warnings
Thibault Saunier [Wed, 17 Apr 2019 15:05:11 +0000 (11:05 -0400)]
gitlab: ORC_CODE=backup is now set in validate GstCheck application
Thibault Saunier [Wed, 17 Apr 2019 14:06:32 +0000 (10:06 -0400)]
gitlab: Blacklist moved to the check testsuite directly
Thibault Saunier [Fri, 12 Apr 2019 22:26:38 +0000 (18:26 -0400)]
gitlab: Run valgrind on ges tests
blacklisting python tests for now as those are still leaky/need some python suppressions
Thibault Saunier [Sun, 7 Apr 2019 13:49:14 +0000 (09:49 -0400)]
gitlab: Dump launcher logs on failures
Thibault Saunier [Sun, 7 Apr 2019 13:48:42 +0000 (09:48 -0400)]
fedora: Install temrinal markdown viewer
To enhance the launcher output
Nicolas Dufresne [Sun, 7 Apr 2019 22:00:02 +0000 (18:00 -0400)]
gitlab: Disable integration test in cerbero repository
This is minimal fix for this job, we don't build the required
dependency.
Tim-Philipp Müller [Sat, 6 Apr 2019 16:45:22 +0000 (17:45 +0100)]
gitlab/ci_template: skip cerbero builds and integration tests for gst-omx
and the integration test for gstreamer-vaapi (we explicitly
remove the vaapi plugin when running integration tests).
Jordan Petridis [Fri, 5 Apr 2019 10:14:21 +0000 (13:14 +0300)]
gitlab/ci_template: Build gst-omx as well
Thibault Saunier [Thu, 4 Apr 2019 20:23:14 +0000 (17:23 -0300)]
gitlab: The launcher now generate the right suppression files list
See https://gitlab.freedesktop.org/gstreamer/gst-devtools/commit/
787939f7505407949a104539688905bc4057d2d4