Jordan Petridis [Tue, 8 Jan 2019 20:31:06 +0000 (22:31 +0200)]
gitlab/ci_template: blacklist another splitmux test
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/544
Jordan Petridis [Tue, 8 Jan 2019 15:10:19 +0000 (17:10 +0200)]
gitlab/ci_template: Blacklist another flvmux test
See https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/543
Nicolas Dufresne [Tue, 8 Jan 2019 18:22:02 +0000 (13:22 -0500)]
gitlab: Re-add ARCH parameter to cerbero deps jobs
This is required and was removed without proper testing.
Nicolas Dufresne [Tue, 18 Dec 2018 02:58:39 +0000 (21:58 -0500)]
CI: Add Win32 and Win64 cross builds
Jordan Petridis [Tue, 8 Jan 2019 06:15:29 +0000 (08:15 +0200)]
gitlab/ci_template: update the sha of the images
Jordan Petridis [Tue, 8 Jan 2019 06:13:07 +0000 (08:13 +0200)]
gitlab/ci_template: Factor out the image uris to variables
This avoids duplication and makes them easier to update and keep
in sync.
Nicolas Dufresne [Tue, 18 Dec 2018 02:38:06 +0000 (21:38 -0500)]
docker: cerbero: Add MingW cross toolchains
This runs the cross-win32 and cross-win64 bootstrap.
Sebastian Dröge [Mon, 7 Jan 2019 12:39:32 +0000 (14:39 +0200)]
gitlab: Unblacklist check.gst-plugins-good.elements_splitmux.test_splitmuxsrc_sparse_streams
Was caused by a bug in a MR.
Sebastian Dröge [Mon, 7 Jan 2019 12:33:50 +0000 (14:33 +0200)]
gitlab: Blacklist 4 more tests
check.gst-plugins-base.pipelines_tcp.test_that_tcpserversink_and_tcpclientsrc_are_symmetrical:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/221
check.gstreamer.elements_capsfilter.test_unfixed_downstream_caps:
https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/335
check.gst-rtsp-server.gst_rtspclientsink.test_record:
https://gitlab.freedesktop.org/gstreamer/gst-rtsp-server/issues/55
check.gst-plugins-good.elements_splitmux.test_splitmuxsrc_sparse_streams:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/542
Thibault Saunier [Thu, 3 Jan 2019 18:31:18 +0000 (19:31 +0100)]
gitlab: Stop blacklisting check.gst-devtools.validate_padmonitor.buffer
https://gitlab.freedesktop.org/gstreamer/gst-devtools/issues/34 has been closed
Nicolas Dufresne [Tue, 18 Dec 2018 19:05:37 +0000 (14:05 -0500)]
ci: Update cerbero docker image
This new image contains source cache, which should speed first fork and
cold cache cases.
Sebastian Dröge [Tue, 18 Dec 2018 16:52:24 +0000 (18:52 +0200)]
ci_template.yml: blacklist one more tests in check
check.gst-editing-services.nle_complex.test_one_expandable_another occasionally fails.
https://gitlab.freedesktop.org/gstreamer/gst-editing-services/issues/55
Nicolas Dufresne [Mon, 17 Dec 2018 19:07:56 +0000 (14:07 -0500)]
docker: cerbero: Add in-docker sources caching
As our runner cache in most of the time cold, and is always cold for new
contributors, which should greatly speedup the build.
Tim-Philipp Müller [Tue, 18 Dec 2018 11:07:04 +0000 (11:07 +0000)]
ci_template: blacklist flaky gst-devtools.validate_padmonitor.buffer test
https://gitlab.freedesktop.org/gstreamer/gst-devtools/issues/34
Sebastian Dröge [Mon, 17 Dec 2018 09:43:34 +0000 (11:43 +0200)]
ci_template.yml: blacklist one more tests in check
check.gst-plugins-bad.elements_netsim.netsim_stress occasionally fails.
https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/849
Sebastian Dröge [Fri, 14 Dec 2018 18:39:14 +0000 (20:39 +0200)]
ci_template.yml: Unblacklist test in check
gstpad.test_pad_probe_block_add_remove does not fail anymore.
https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/339
Jordan Petridis [Fri, 14 Dec 2018 12:09:10 +0000 (14:09 +0200)]
ci_template: bump the expiration time of artifacts
build job artifacts are the ones that consume much space, and
thus only set to 5 days, might lower it if space is an issue.
Otherwise rest job artifacts are just logs, text and xml files.
Jordan Petridis [Fri, 14 Dec 2018 12:11:17 +0000 (14:11 +0200)]
Revert "ci_template.yml: blacklist another test in check"
This reverts commit
d922144894e136b5237a20094411e15dd03be17e.
This was duplicate of
7f03e972eec5e94c66467b1e45e2ba9761f7bcc6
Jordan Petridis [Fri, 14 Dec 2018 11:33:48 +0000 (13:33 +0200)]
ci_template.yml: blacklist another test in check
check.gstreamer.gst_gstpad.test_pad_probe_block_add_remove
occasianlly fails.
https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/339
Sebastian Dröge [Fri, 14 Dec 2018 10:34:21 +0000 (12:34 +0200)]
ci_template.yml: blacklist two more tests in check
check.gst-plugins-bad.elements_shm.test_shm_live
check.gst-plugins-good.elements_splitmux.test_splitmuxsink_async
occasionally fail.
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/531
https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/847
Sebastian Dröge [Fri, 14 Dec 2018 09:59:48 +0000 (11:59 +0200)]
ci_template.yml: blacklist another test in check
gstpad.test_pad_probe_block_add_remove occasionally fails.
https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/339
Jordan Petridis [Thu, 13 Dec 2018 19:18:40 +0000 (21:18 +0200)]
ci_template.yml: blacklist another test in check
check.gst-plugins-good.elements_flvmux.test_incrementing_timestamps
occasianlly fails.
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/530
Xavier Claessens [Thu, 13 Dec 2018 18:37:38 +0000 (13:37 -0500)]
android: Use the new docker image
Xavier Claessens [Thu, 13 Dec 2018 14:45:58 +0000 (09:45 -0500)]
android: Use cross file shipped by gst-build
We want to test that cross files shipped by gst-build are working,
instead of a generating our own.
Xavier Claessens [Thu, 29 Nov 2018 20:12:51 +0000 (15:12 -0500)]
Rename 'android' docker image back to 'ubuntu'
There is no point in doing a different docker image for each build we
are going to do inside an Ubuntu distro. We can later use the same image
for native ubuntu builds, or other cross builds (e.g. android API 21,
etc).
Xavier Claessens [Thu, 29 Nov 2018 20:01:55 +0000 (15:01 -0500)]
Move Android NDK to /opt
It was installed in '/' which doesn't feel right. Installing it in /root
is also not correct because we want to run the build as user instead of
root in the future and cleanup.sh removes everything in /root. /opt
seems the best place because that's also the default location when
installing Android Studio.
Jordan Petridis [Thu, 13 Dec 2018 15:18:40 +0000 (17:18 +0200)]
ci_template: enable h264parse.test_parse_packetized test again
Remove check.gst-plugins-bad.elements_h264parse.test_parse_packetized
from the blacklist since the relevant issue [1] seems to have been
resolved with the following MR [2]
[1] https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/842
[2] https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/merge_requests/69
Nicolas Dufresne [Mon, 10 Dec 2018 00:42:21 +0000 (19:42 -0500)]
CI: Don't reset cache on fetch
This is not needed since we only do run without cache or from a deps
cache for the specific cerbero commit we are building. This will speed
up builds in cerbero/ project when the source cache is missing.
Jordan Petridis [Mon, 10 Dec 2018 15:35:57 +0000 (17:35 +0200)]
CI: Make the docker build and local jobs manual
While they are very useful, each time we create a branch,
gitlab tries to build all the images which is very resource
intesinve. Thus make all the local images and everything that
depends upon them a manual job and only trigger them before
merging an MR.
Jordan Petridis [Tue, 11 Dec 2018 20:57:46 +0000 (22:57 +0200)]
ci_template: another blacklisted test in check
gst-plugins-good.elements_rtpbin.test_sender_eos
is occasionally failing.
For more see:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/527
Jordan Petridis [Tue, 11 Dec 2018 18:33:18 +0000 (20:33 +0200)]
ci_template: Blacklist another test in check
gst-plugins-base.elements_multisocketsink.test_client_next_keyframe
is occasionally failing somehow in the CI.
For more see:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/516
Jordan Petridis [Tue, 11 Dec 2018 11:25:37 +0000 (13:25 +0200)]
ci_template: do not .test in the cerbero repo
We already disable the .build inhereted build jobs, and thus the
tests fail to run since they depend on them. Cerbero doesn't need
to run them anyway.
Jordan Petridis [Mon, 10 Dec 2018 19:35:38 +0000 (21:35 +0200)]
ci_template: Report ccache stats for build jobs
Jordan Petridis [Mon, 10 Dec 2018 18:35:29 +0000 (20:35 +0200)]
ci_template: blacklist a problematic test in check
Also pass --dump-on-failure in the job. While the logs are
artifacts and they are integrated in the MRs, its not as
convinient to findout out what is failling if you are looking
into just a job log, of a commit. Thus make it show logs are also
priting on stdout/stderr.
Jordan Petridis [Thu, 6 Dec 2018 20:20:14 +0000 (22:20 +0200)]
ci_template: Blacklist problematic tests
Jordan Petridis [Wed, 21 Nov 2018 15:24:00 +0000 (17:24 +0200)]
ci_template.yml: Run the check test suite!!!
Add a fedora job that runs the 'check' tests with
gst-validate-launcher. Its fairly well abstracted so the same
template can be used to add the rest of the test-suites fairly
soon.
Jordan Petridis [Wed, 21 Nov 2018 13:49:51 +0000 (15:49 +0200)]
Revert "ci_template.yml: Temporarly disable builddir artifact"
This reverts commit
6ddb35c3c400586520b0f1e39f6f5369d0f61b44.
A hotfix has been deployed, lets see how it goes.
Jordan Petridis [Mon, 10 Dec 2018 09:50:49 +0000 (11:50 +0200)]
ci_template: Remove duplicate key
Looks like this slipped past the review of !47
Nicolas Dufresne [Sun, 9 Dec 2018 23:19:06 +0000 (18:19 -0500)]
CI: Enable cerbero builds for all projects
Nicolas Dufresne [Sun, 9 Dec 2018 21:29:46 +0000 (16:29 -0500)]
CI: Place cerbero docker image: in the template
This avoids having to duplicate that path into cerbero/ project and will
ease later updates.
Nicolas Dufresne [Sun, 9 Dec 2018 20:11:35 +0000 (15:11 -0500)]
CI: Add cerbero docker SHA
No job activated yet.
Nicolas Dufresne [Sun, 9 Dec 2018 02:35:26 +0000 (21:35 -0500)]
gitlab: Limit cerbero ccache to 1.7G
Testing showed that we need 1.6G to store all the objects. This limit
will prevent the cache from growing over time. Compressing the cache
can take a lot of time.
Nicolas Dufresne [Sun, 9 Dec 2018 02:26:25 +0000 (21:26 -0500)]
gitlab: Use cache key for cerbero builds
The key is set to cerbero_${ARCH}. This should help maintain a smaller
cache size and will avoid other jobs from overriding our cerbero-sources
cache.
Nicolas Dufresne [Sat, 24 Nov 2018 03:52:59 +0000 (22:52 -0500)]
gitlab: Don't build gst-build in cerbero repository
Nicolas Dufresne [Thu, 22 Nov 2018 04:05:16 +0000 (23:05 -0500)]
gitlab: Add orc and cerbero to manifest
Nicolas Dufresne [Fri, 16 Nov 2018 02:47:34 +0000 (21:47 -0500)]
gitlab: Add cerbero build template and x86_64 build
Nicolas Dufresne [Wed, 14 Nov 2018 01:13:13 +0000 (20:13 -0500)]
docker: Create Cerbero Fedora Docker
Jordan Petridis [Sun, 9 Dec 2018 02:34:35 +0000 (04:34 +0200)]
ci_template: Use a cache key specific to each job
Thibault Saunier [Thu, 6 Dec 2018 13:30:42 +0000 (10:30 -0300)]
Revert "Revert me" and fix test_manifest image to be used
This reverts commit
4717e446a9d8b4dc0c2a02ddf0630d7c65d78a37.
Jordan Petridis [Tue, 4 Dec 2018 22:06:00 +0000 (00:06 +0200)]
CI: do not run local jobs for master branch
They are identical to the normal jobs
Thibault Saunier [Thu, 6 Dec 2018 10:23:20 +0000 (07:23 -0300)]
build_manifest: fetch remote refname before checking out right commit
Working around https://gitlab.freedesktop.org/freedesktop/freedesktop/issues/95
Thibault Saunier [Thu, 6 Dec 2018 03:00:21 +0000 (00:00 -0300)]
Revert me
Thibault Saunier [Thu, 6 Dec 2018 03:03:25 +0000 (00:03 -0300)]
Run test_manifest when the docker is changed
Thibault Saunier [Thu, 6 Dec 2018 01:23:47 +0000 (22:23 -0300)]
build_manifest: Include remote refname in the manifest
Thibault Saunier [Thu, 6 Dec 2018 01:03:53 +0000 (22:03 -0300)]
buildmanifest: Move away from the gitlab API and use plain git to retrieve branch names
Makes the code much simpler
Thibault Saunier [Thu, 6 Dec 2018 01:46:57 +0000 (22:46 -0300)]
Install git in the test_manifest docker as necessary now
Jan Alexander Steffens (heftig) [Wed, 5 Dec 2018 21:12:09 +0000 (22:12 +0100)]
ci_template: Use git diff --quiet for checking for changes
Checking the exit code of git diff --quiet is preferred over looking
whether git diff produces any output.
Jan Alexander Steffens (heftig) [Wed, 5 Dec 2018 21:08:49 +0000 (22:08 +0100)]
ci_template: Don't use command substitution with find
GNU find has operations like -exec and -delete that operate without the
brittleness of applying shell word splitting to its output.
In addition, it won't fail if no files were matched.
Jordan Petridis [Wed, 28 Nov 2018 10:09:28 +0000 (12:09 +0200)]
Run gst-indent through the files
This is required before we enabled an indent test in the CI.
https://gitlab.freedesktop.org/gstreamer/gstreamer-project/issues/33
Jordan Petridis [Tue, 13 Nov 2018 11:43:42 +0000 (13:43 +0200)]
ci_template: Add a gst-indent job
Nicolas Dufresne [Sat, 1 Dec 2018 16:33:44 +0000 (11:33 -0500)]
build_manifest: Increase the number of search results
This increase the number of search results when looking up user
branches to 100 items. This should be sufficient for all of our users.
Fixes #3
Jordan Petridis [Sat, 1 Dec 2018 13:20:38 +0000 (15:20 +0200)]
CI: Update image uris
Jordan Petridis [Sat, 1 Dec 2018 11:17:46 +0000 (13:17 +0200)]
Docker: fix a type in the test-manifest image
Jordan Petridis [Thu, 29 Nov 2018 10:43:55 +0000 (12:43 +0200)]
docker fedora: add extra deps
featuring:
- flite
- elfuitls
- gsl
- couple of mesa packages
- sdl2
- graphene
- aom
- neon
- sbc
Jordan Petridis [Fri, 30 Nov 2018 18:43:39 +0000 (20:43 +0200)]
docker: add an image to run the tests of the manifest
So in the futuere we can avoid installing pytest each time
Jordan Petridis [Fri, 30 Nov 2018 17:57:13 +0000 (19:57 +0200)]
docker: Add a new image for the gst-indent job
This is meant run GNU indent along with the gstreamer wrapper
through the codebase and error out for missconfigured code.
Part of https://gitlab.freedesktop.org/gstreamer/gstreamer-project/issues/33
Xavier Claessens [Wed, 28 Nov 2018 18:39:16 +0000 (13:39 -0500)]
Update docker images to latest
Jordan Petridis [Mon, 26 Nov 2018 14:23:58 +0000 (16:23 +0200)]
docker: Move android into a unified image
Jordan Petridis [Mon, 26 Nov 2018 13:43:59 +0000 (15:43 +0200)]
docker: move the alpine image to a different directory
Jordan Petridis [Sun, 25 Nov 2018 00:03:29 +0000 (02:03 +0200)]
docker: Add a unified image for fedora
This is meant to replace both the runtime and build images.
Spliting it in two increasing the maintainance required without
any big benefits.
Jordan Petridis [Sat, 24 Nov 2018 22:48:50 +0000 (00:48 +0200)]
Docker registry: only tag images for the upstream repository
The tags are only used to version the images that are meant
to be used in the gitlab/ci_template.yml file. Thus tags are
not needed when you hack on a patch from a forked repository.
Lets just keep a :latest tag.
Tim-Philipp Müller [Sun, 25 Nov 2018 23:26:20 +0000 (23:26 +0000)]
ci-template: build with --werror by default
Thibault Saunier [Sun, 25 Nov 2018 19:15:59 +0000 (16:15 -0300)]
Fix previous commit and do not install rsync
rsync is not needed in the end.
Thibault Saunier [Sun, 25 Nov 2018 16:25:37 +0000 (13:25 -0300)]
Add a script to import the GStreamer documentation inside the fdo server
Thibault Saunier [Sat, 24 Nov 2018 12:40:55 +0000 (09:40 -0300)]
docker:fedora: Add required package to build and upload the documentation
Jordan Petridis [Fri, 23 Nov 2018 16:45:31 +0000 (18:45 +0200)]
gitlab/ci_template.yml: rework the CI stages
Idea is that in order to not consume many resources for broken
builds, we will have a basic stage where just one simple set of
build and test jobs is run. If that passes we will continue with
the rest of the Pipeline suite.
Jordan Petridis [Fri, 23 Nov 2018 16:59:04 +0000 (18:59 +0200)]
gitlab/ci_template.yml: add dependencies block to the .build template
Jordan Petridis [Fri, 23 Nov 2018 16:48:11 +0000 (18:48 +0200)]
Revert "Avoid duplication between ci_template.yml and .gitlab-ci.yml"
This reverts commit
6bdd1ead99e7d17ba5f8cdbba2668cdebc3bdb43.
This does not actually avoid duplication... [1]
[1] https://gitlab.freedesktop.org/gstreamer/gst-ci/commit/
6bdd1ead99e7d17ba5f8cdbba2668cdebc3bdb43#note_81275
Xavier Claessens [Thu, 22 Nov 2018 21:47:35 +0000 (16:47 -0500)]
Avoid duplication between ci_template.yml and .gitlab-ci.yml
Xavier Claessens [Thu, 22 Nov 2018 19:21:20 +0000 (14:21 -0500)]
Add Android arm64 cross build
Xavier Claessens [Thu, 22 Nov 2018 18:45:10 +0000 (13:45 -0500)]
Add Android NDK toolchain in Ubuntu docker image
Xavier Claessens [Thu, 22 Nov 2018 18:24:26 +0000 (13:24 -0500)]
Build Ubuntu base image
Xavier Claessens [Thu, 22 Nov 2018 17:00:26 +0000 (12:00 -0500)]
Make a change in Dockerfile-ubuntu to force rebuild of docker image
Xavier Claessens [Thu, 22 Nov 2018 16:37:51 +0000 (11:37 -0500)]
Build ubuntu runtime docker
Jordan Petridis [Thu, 22 Nov 2018 11:03:23 +0000 (13:03 +0200)]
CI: remove duplicate entry
Jordan Petridis [Thu, 22 Nov 2018 11:01:48 +0000 (13:01 +0200)]
CI: only build the images that changed
previously when something in the docker/ direcotry was changed,
all of the images would be rebuilt.
Jordan Petridis [Wed, 21 Nov 2018 14:55:02 +0000 (16:55 +0200)]
CI: Test both the ci_template as well as local changes
Instead of just overwritting the template build jobs, test both
so we avoid regressions.
See [1] for more
[1] https://gitlab.freedesktop.org/gstreamer/gst-ci/commit/
1858a709e6d400716241c9b63dc50b28fa71c48a
Jordan Petridis [Wed, 21 Nov 2018 15:25:29 +0000 (17:25 +0200)]
gitlab/ci_template.yml: Use tagged docker image for the manifest job
Jordan Petridis [Wed, 21 Nov 2018 13:47:18 +0000 (15:47 +0200)]
gitlab/ci_template.yml: Use correct yaml syntax
single quotes in yaml don't escape special charters which
causes the env variable to never be resolved to its proper path.
Thibault Saunier [Thu, 22 Nov 2018 00:25:30 +0000 (21:25 -0300)]
gitlab: Update the docker image we use
so we have latest fix for gst-build git-update script
Thibault Saunier [Wed, 14 Nov 2018 13:20:16 +0000 (10:20 -0300)]
build_manifest: Add the "path" attribute to projects
When the local path and the name are different, both have to be
specified, it is now required since we add the '.git' to the name.
Thibault Saunier [Wed, 14 Nov 2018 13:20:16 +0000 (10:20 -0300)]
build_manifest: Add the to repo names to avoid spamming about redirections
Thibault Saunier [Wed, 14 Nov 2018 13:16:39 +0000 (10:16 -0300)]
build_manifest: Never use users 'master' branch for repos we are not explicitely building
People very often do not update them leading to random and weird failures
Thibault Saunier [Wed, 14 Nov 2018 02:34:20 +0000 (23:34 -0300)]
build_manifest: Make sure to respect GitLab currently built SHA
Thibault Saunier [Tue, 13 Nov 2018 17:13:23 +0000 (14:13 -0300)]
Revert "Revert me when merged"
This reverts commit
5cff46553e913e5ab13e63561edaa519a4ca904f.
Thibault Saunier [Sun, 11 Nov 2018 11:57:35 +0000 (08:57 -0300)]
Revert me when merged
Stopping the circular dependency.
Thibault Saunier [Sun, 11 Nov 2018 12:33:13 +0000 (09:33 -0300)]
gitlab: Handle checking out the right gst-ci branch to call build_manifest
Thibault Saunier [Sun, 11 Nov 2018 02:49:57 +0000 (23:49 -0300)]
Add a simple alpine based Dockerfile for images to build manifest
Thibault Saunier [Sun, 11 Nov 2018 12:22:42 +0000 (09:22 -0300)]
gitlab: ci: Run build_manifest tests only if the script changes
Jordan Petridis [Tue, 13 Nov 2018 10:52:17 +0000 (12:52 +0200)]
build_manifest.py: Use CI_PROJECT_NAMESPACE instead of GITLAB_USER
GITLAB_USER_* variables represent the user *that triggered* the job,
which might not match the user that owns the namespace of the fork.
This happens frequently with rebase, where the one who triggers the
rebase is the one that appears in the GITLAB_USER_* vars.
Instead use the CI_PROJECT_NAMESPACE variable to search the user's
projects. If CI_PROJECT_NAMESPACE has the value of a Group namespace
search_user_namespace returns 404.