gerrit: depends-on: use master when dependency changes are merged

When the change a lttng-tools change depends on is merged/abandoned use
master as the ref.

This is not ideal CI time wise since we do not reuse artifact
but this solve a tricky situation were we actually want to use master
instead of the change available on gerrit. Intermediary changes
present in master could have an impact on the change under test.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: liburcu: Add gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace: Add FreeBSD jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-ust: Add FreeBSD jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: liburcu: Add FreeBSD jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: fix unbounded PYTHON variable in print.sh

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Add env and os details printing to build jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Use the https protocol for checkouts on Github, it's faster

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: Update hosts

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Remove deprecated trigger-for-unreviewed-patches from gerrit jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: barectf: add stable-3.0 branch job

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-tools: Update HWE kernel versions for ubuntu jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Add hwe-5.8 kernel to ubuntu focal

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: increase inactivity timeout to 45 minutes

There is tests that take more than 10 minutes to complete without
output. Also sometime the output is buffered by jenkins leading to
inactivity threshold being reached while there is activity.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-analyses: Remove violations plugin integration

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace: Use dev-requirements.txt when available in pylint jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

barectf: remove poetry virtualenvs config modification

virtualenvs.create is defined as:

  Create a new virtual environment if one doesn't already exist.
  Defaults to true.

Tox provides a virtualenv for the CI execution.

Hence we can remove this statement and default to True for this setting.

[1] https://python-poetry.org/docs/configuration/#virtualenvscreate-boolean

Reported-by: Philippe Proulx <pproulx@efficios.com>
Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-ust: Add PKG_CONFIG_PATH env var

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: the 'libtool-bin' package provides the libtool binary

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: barectf: Modernize job, remove pylint

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add rootbuild gerrit jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add rootbuild jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: babeltrace not used on Windows

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

barectf: update build recipe for poetry and tox

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

lttng-tools: add master babeltrace axis for jgalar portbuild

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-scope: disable all jobs

This project is unmaintained, disable all jobs.

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: system-tests: remove baremetal benchmarks

We currently don't have the bandwidth to track those results and
investigate bugs in the benchmarks themselves. We could always revert
this commit if that changes.

Right now, these benchmarks are only wasting CI CPU time and power.

Signed-off-by: Francis Deslauriers <fdeslaur@gmail.com>

jjb: lltng-modules: fix ceiling for stable-2.10 vanilla jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: scan-build: Make sure the include dir exists

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

system-tests: vm_test trigger kernel version

2.10 is "unsupported".

5.4 is "long term"

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

system-test: add 5.4 to linux versions

5.4 is flagged as a longterm kernel by kernel.org .

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

system-tests: split supported test and unsupported for 

We still want to tests for  "unsupported" for system test since we still
tests lttng-tools "unsupported".

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Add email to vm_tests_k jobs

They are essentially the kernel tracing validation jobs, hence it is
important to get notified of a failure event if there is a lot of noise.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-modules: Add INSTALL_MOD_PATH to install target for v5.8

jjb: librseq: TAP tests were removed upstream

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: Add libmsgpack-dev to lttng-tools role

jjb: babeltrace: Release jobs script cleanup

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add TAP results to release jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace: Add release jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add release jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Cap stable-2.10 to < v5.7

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Don't abort concurrent gerrit jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Add urcu tls fallback config to ust and tools

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-ust: Add gerrit portbuild job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Enable agents on sles

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: liburcu: Clean version lists

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Add stable-2.12 to trigger job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace: Drop stable-1.3 jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Drop stable-2.9 except for sles

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Drop stable-2.8 except for sles

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: liburcu: Drop stable-0.8 jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: USe internal git mirror

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Drop sles12 stable-2.7 jobs

jjb: Update liburcu dependency to 0.12

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

Use latest (0.12) version for gerrit job

We might want to start a shell script with the tuple for each gerrit
branch (stable branch) and use the inject plugin to propagate the
information to the copy artifact step.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Use GERRIT_BRANCH to use the correct lttng-ust artifacts

The GERRIT_BRANCH matches between ust and tools afaik.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: ivc: export PKG_CONFIG_PATH for urcu dependency

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: liburcu: Add stable-0.12

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: fix '//' in s3 url

jjb: system-tests: remove LTTng stable-2.9 tests

This release is no longer supported.

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: lava: conditionally turn on `--enable-test-sdt-uprobe`

This flag is explicitly turned on so to fail if the feature dependencies
(`sdt.h` and `dtrace(1)`) are missing. This is to avoid the case where
the feature and its tests are silently turned off when these are
missing.

This flag is turned on when the LTTng version being tested is "master"
or "stable-2.11", and "stable-2.12" because only those versions have
this configure flag.

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: replace usage of `defaults` by `job-template`

This seems more appropriate and allows for usage of parameters such as
`lttngversion`. We will use `lttngversion` in a following commit.

This change also renames the canary jobs are renamed such as
`vm_tests_canary` -> `vm_tests_kcanary_lcanary`. I did that to
simply the templates.

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: clean-up: remove deactivated fuzzing job

This past commit turned off the triggering of the fuzzing job about a
year ago. We can remove this code and add it back later if we feel the
need:
  commit 22a5adc992ff324ca3cba81b4fdde5b87762362a
  Author: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>
  Date:   Wed May 1 16:46:01 2019 -0400

      Deactivate fuzzing on kvm_test for now

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

LAVA: install `systemtap-sdt-dev` package to run sdt-uprobe tests

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

Remove extra '/' in upload path

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Remove extra "/" in fetched url

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: Remove unsupported cygwin x86-32 jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

Add 2.11 and 2.12 to system tests overarching job

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Add 2.112 and 2.12 to vm tests jobs

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

lttng-tools gerrit: temporarily disable bash debug for pattern matching

The debug output for the depends-on script can lead to false positive
of the gcc warning publisher. Deactivate the debug mode for the pattern
evaluation.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-modules: Add RT blacklisted version

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: update ubuntu supported kernel versions

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: disable riscv64 config gen for ubuntu kernels

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Update discard strategy of the gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Update discard strategy of the gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: barectf: Update discard strategy of the gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-ust: Update discard strategy of the gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

Add babeltrace benchmark commit skip

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Add invalid commit skip for babeltrace benchmark

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Introduce Depends-on for lttng-tools gerrit job

The development of a lttng-tools feature can happen in parallel with a
lttng-ust feature. The need to build and test a lttng-tools gerrit
change against a gerrit lttng-ust change arises.

This patch introduce gerrit-based inter project dependency
testing for the lttng-tools project against lttng-ust.

The dependency can be expressed at the change's commit message level:

    Depends-on: lttng-ust: <lttng-ust-change-id>

e.g
    Fix: client_flush_outgoing_queue expect an active client

    Move validated and active assignation before the call to
    client_flush_outgoing_queue.

    Depends-on: lttng-ust: If8557b77f2a03b05b924cdc26ecf7618fff46289

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>
    Change-Id: I873b2fad567eb6d59a53a12cba02451afd1d9827

For now, only lttng-ust is supported but babeltrace and lttng-modules
could someday be prime candidate for "Depends-on".

Note that the "Depends-on" line is optional. If none is present, we
import lttng-ust from the lttng-ust base job as it is done today.

For building ust, we reuse the script "scripts/lttng-ust/build.sh".

Note that we override the "$build" variable to "std" for the dependency
since the build type for the lttng-ust dependency is irrelevant for the
current job.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-modules: Add gerrit build job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Add stable-2.12 jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

Mount the tmp drive correctly

Fix: jjb: system-tests: pass modules repo to build job

When passing a custom Git repository URL to a systems-test job, the
master job doesn't pass this URL to the kernel and modules building job.
This makes the job fail when it can't checkout the desired commit on the
default remote.

To fix this, pass the URL received in the job parameter to the kernel
and modules building job.

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: system-tests: print all tests results

In the vm_tests_* lava jobs, there are currently 2 sub-tests that we
care about: "1_kernel-tests" and "2_destructive-tests".

At the moment, we print from the first '<LAVA_SIGNAL_STARTTC run-tests>'
to the first '<LAVA_SIGNAL_ENDTC run-tests>' we encounter.

This is wrong because there are 2 sub-tests, we are currently only print
the result of the first one.

To fix this,  don't break from the loop and keep on reading the file in
case there are other test results.

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: lttng-modules: Add ubuntu focal job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Add gerrit job to lttng-ust

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: system-tests: replace remaining `yaml.load()` method

See follow commit for details:
  commit be7f51b658568ac8d4d83aaf55b6ee381a75e04f
  Author: Francis Deslauriers <francis.deslauriers@efficios.com>
  Date:   Thu Dec 19 23:35:39 2019 -0500

      jjb: system-tests: use `yaml.unsafe_load()` method

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: system-tests: use `yaml.unsafe_load()` method

Since PyYAML version 5.2 `load()` errors out when parsing such field:
  !!python/object/apply:collections.OrderedDict [...]

This is done to prevent vulnerabilities exploitable using the
`object/apply` construct. See this Github issue [1]:

I believe the real bug is that Lava produce a yaml file with such a
construct. I believe it's not on purpose because we can see a commit [2]
preventing the use of `object/apply` for another type.

For now, use `unsafe_load()` until lava does not produce `object/apply`
contructs.

[1] https://github.com/yaml/pyyaml/issues/364
[2] https://github.com/Linaro/lava/commit/14b347c51efb89e8d6c64d9aa74fb4190f03227c

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: add babeltrace master branch to jgalar staging jobs

For lttng-tools master and 2.11 only for now.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: proper pkgconfig setup on Solaris

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: remove stable-2.9

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace-benchmark: Don't use jgit

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Add PKG_CONFIG_PATH to coverity script

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Add PKG_CONFIG_PATH to scan-build script

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add PKG_CONFIG_PATH to build script

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

Cleanup: system-tests: format lava2-submit.py according to `black`

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: system-tests: add parameters for Tools and UST git repos

This is useful to launch custom jobs on a specific repo to test
something.

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: Fix more ppc64el linux build for modules