Fix: system-test: 3.18 does not recognize kvm_guest.config

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Use git:// for git-mirror

The http side is not scaled to usage.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Fix: system-tests: kvmconfig is deprecated

Starting in 5.11 with commit:

  commit 9bba03d4473df0b707224d4d2067b62d1e1e2a77
  Author: Masahiro Yamada <masahiroy@kernel.org>
  Date:   Wed Dec 23 15:35:42 2020 +0900

      kconfig: remove 'kvmconfig' and 'xenconfig' shorthands

      Linux 5.10 is out. Remove the 'kvmconfig' and 'xenconfig' shorthands
      as previously announced.

Signed-off-by: Masahiro Yamada <masahiroy@kernel.org>
Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

lava: pip install range not working

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

lava: pip21 drop support for python 3.5

Limit the pip version to 20.3.x. for now.

Ultimate solution here will be to upgrade the base image from Xenial to
latest LTS.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-www: only keep 5 builds

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-www: use jenkins credentials to populate known_hosts ssh

This ensure that we deploy to the good host.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Cleanup: whitespace

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: add job for lttng-www auto deploy

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: tools: mark build as aborted on timeout.

This can help identify the cause of the "failure" between test failure
and timeout abort. It also facilitate the classification of  post-build
action.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: tools: add post-build action to gather tap logs

Currently, if a build abort (timeout etc.) we do not gather the tap logs
and this can lead to difficulty in figuring out the causes of the
problem.

The action is performed only on Abort.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: Bump SLES12 to SP5

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Drop all Solaris jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: jdk is provided by the common role

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: remove scope role from all nodes

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: remove -Werror

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Fix kernel build failures

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Add upstream lts filtering

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Add mjeanson dev jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Update MacOS jobs for Big Sur and arm64

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

gerrit: depends-on: use master when dependency changes are merged

When the change a lttng-tools change depends on is merged/abandoned use
master as the ref.

This is not ideal CI time wise since we do not reuse artifact
but this solve a tricky situation were we actually want to use master
instead of the change available on gerrit. Intermediary changes
present in master could have an impact on the change under test.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: liburcu: Add gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace: Add FreeBSD jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-ust: Add FreeBSD jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: liburcu: Add FreeBSD jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: fix unbounded PYTHON variable in print.sh

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Add env and os details printing to build jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Use the https protocol for checkouts on Github, it's faster

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: Update hosts

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Remove deprecated trigger-for-unreviewed-patches from gerrit jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: barectf: add stable-3.0 branch job

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-tools: Update HWE kernel versions for ubuntu jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Add hwe-5.8 kernel to ubuntu focal

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: increase inactivity timeout to 45 minutes

There is tests that take more than 10 minutes to complete without
output. Also sometime the output is buffered by jenkins leading to
inactivity threshold being reached while there is activity.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-analyses: Remove violations plugin integration

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace: Use dev-requirements.txt when available in pylint jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

barectf: remove poetry virtualenvs config modification

virtualenvs.create is defined as:

  Create a new virtual environment if one doesn't already exist.
  Defaults to true.

Tox provides a virtualenv for the CI execution.

Hence we can remove this statement and default to True for this setting.

[1] https://python-poetry.org/docs/configuration/#virtualenvscreate-boolean

Reported-by: Philippe Proulx <pproulx@efficios.com>
Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-ust: Add PKG_CONFIG_PATH env var

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: the 'libtool-bin' package provides the libtool binary

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: barectf: Modernize job, remove pylint

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add rootbuild gerrit jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add rootbuild jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: babeltrace not used on Windows

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

barectf: update build recipe for poetry and tox

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

lttng-tools: add master babeltrace axis for jgalar portbuild

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-scope: disable all jobs

This project is unmaintained, disable all jobs.

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: system-tests: remove baremetal benchmarks

We currently don't have the bandwidth to track those results and
investigate bugs in the benchmarks themselves. We could always revert
this commit if that changes.

Right now, these benchmarks are only wasting CI CPU time and power.

Signed-off-by: Francis Deslauriers <fdeslaur@gmail.com>

jjb: lltng-modules: fix ceiling for stable-2.10 vanilla jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: scan-build: Make sure the include dir exists

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

system-tests: vm_test trigger kernel version

2.10 is "unsupported".

5.4 is "long term"

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

system-test: add 5.4 to linux versions

5.4 is flagged as a longterm kernel by kernel.org .

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

system-tests: split supported test and unsupported for 

We still want to tests for  "unsupported" for system test since we still
tests lttng-tools "unsupported".

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Add email to vm_tests_k jobs

They are essentially the kernel tracing validation jobs, hence it is
important to get notified of a failure event if there is a lot of noise.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-modules: Add INSTALL_MOD_PATH to install target for v5.8

jjb: librseq: TAP tests were removed upstream

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: Add libmsgpack-dev to lttng-tools role

jjb: babeltrace: Release jobs script cleanup

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add TAP results to release jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace: Add release jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Add release jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Cap stable-2.10 to < v5.7

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Don't abort concurrent gerrit jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Add urcu tls fallback config to ust and tools

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-ust: Add gerrit portbuild job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Enable agents on sles

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: liburcu: Clean version lists

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Add stable-2.12 to trigger job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace: Drop stable-1.3 jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Drop stable-2.9 except for sles

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Drop stable-2.8 except for sles

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: liburcu: Drop stable-0.8 jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: USe internal git mirror

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Drop sles12 stable-2.7 jobs

jjb: Update liburcu dependency to 0.12

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

Use latest (0.12) version for gerrit job

We might want to start a shell script with the tuple for each gerrit
branch (stable branch) and use the inject plugin to propagate the
information to the copy artifact step.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Use GERRIT_BRANCH to use the correct lttng-ust artifacts

The GERRIT_BRANCH matches between ust and tools afaik.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: ivc: export PKG_CONFIG_PATH for urcu dependency

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: liburcu: Add stable-0.12

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: fix '//' in s3 url

jjb: system-tests: remove LTTng stable-2.9 tests

This release is no longer supported.

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: lava: conditionally turn on `--enable-test-sdt-uprobe`

This flag is explicitly turned on so to fail if the feature dependencies
(`sdt.h` and `dtrace(1)`) are missing. This is to avoid the case where
the feature and its tests are silently turned off when these are
missing.

This flag is turned on when the LTTng version being tested is "master"
or "stable-2.11", and "stable-2.12" because only those versions have
this configure flag.

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: replace usage of `defaults` by `job-template`

This seems more appropriate and allows for usage of parameters such as
`lttngversion`. We will use `lttngversion` in a following commit.

This change also renames the canary jobs are renamed such as
`vm_tests_canary` -> `vm_tests_kcanary_lcanary`. I did that to
simply the templates.

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

jjb: clean-up: remove deactivated fuzzing job

This past commit turned off the triggering of the fuzzing job about a
year ago. We can remove this code and add it back later if we feel the
need:
  commit 22a5adc992ff324ca3cba81b4fdde5b87762362a
  Author: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>
  Date:   Wed May 1 16:46:01 2019 -0400

      Deactivate fuzzing on kvm_test for now

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

LAVA: install `systemtap-sdt-dev` package to run sdt-uprobe tests

Signed-off-by: Francis Deslauriers <francis.deslauriers@efficios.com>

Remove extra '/' in upload path

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Remove extra "/" in fetched url

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: Remove unsupported cygwin x86-32 jobs

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

Add 2.11 and 2.12 to system tests overarching job

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Add 2.112 and 2.12 to vm tests jobs

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

lttng-tools gerrit: temporarily disable bash debug for pattern matching

The debug output for the depends-on script can lead to false positive
of the gcc warning publisher. Deactivate the debug mode for the pattern
evaluation.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

jjb: lttng-modules: Add RT blacklisted version

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: update ubuntu supported kernel versions

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: disable riscv64 config gen for ubuntu kernels

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: Update discard strategy of the gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-modules: Update discard strategy of the gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: barectf: Update discard strategy of the gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-ust: Update discard strategy of the gerrit job

Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

Add babeltrace benchmark commit skip

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Add invalid commit skip for babeltrace benchmark

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>

Introduce Depends-on for lttng-tools gerrit job

The development of a lttng-tools feature can happen in parallel with a
lttng-ust feature. The need to build and test a lttng-tools gerrit
change against a gerrit lttng-ust change arises.

This patch introduce gerrit-based inter project dependency
testing for the lttng-tools project against lttng-ust.

The dependency can be expressed at the change's commit message level:

    Depends-on: lttng-ust: <lttng-ust-change-id>

e.g
    Fix: client_flush_outgoing_queue expect an active client

    Move validated and active assignation before the call to
    client_flush_outgoing_queue.

    Depends-on: lttng-ust: If8557b77f2a03b05b924cdc26ecf7618fff46289

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>
    Change-Id: I873b2fad567eb6d59a53a12cba02451afd1d9827

For now, only lttng-ust is supported but babeltrace and lttng-modules
could someday be prime candidate for "Depends-on".

Note that the "Depends-on" line is optional. If none is present, we
import lttng-ust from the lttng-ust base job as it is done today.

For building ust, we reuse the script "scripts/lttng-ust/build.sh".

Note that we override the "$build" variable to "std" for the dependency
since the build type for the lttng-ust dependency is irrelevant for the
current job.

Signed-off-by: Jonathan Rajotte <jonathan.rajotte-julien@efficios.com>