Commit | Line | Data |
---|---|---|
962ee225 FD |
1 | --- |
2 | ## Anchors | |
02126236 FD |
3 | - system_tests_parameters_defaults: &system_tests_parameters_defaults |
4 | name: 'system_tests_parameters_defaults' | |
962ee225 FD |
5 | parameters: |
6 | - string: | |
fdbdb52a | 7 | name: 'LTTNG_TOOLS_COMMIT_ID' |
962ee225 FD |
8 | default: '' |
9 | description: 'The lttng-tools commit id to build.' | |
10 | - string: | |
fdbdb52a | 11 | name: 'LTTNG_MODULES_COMMIT_ID' |
962ee225 FD |
12 | default: '' |
13 | description: 'The lttng-modules commit id to build.' | |
14 | - string: | |
fdbdb52a | 15 | name: 'LTTNG_UST_COMMIT_ID' |
962ee225 FD |
16 | default: '' |
17 | description: 'The lttng-ust commit id to build.' | |
18 | - string: | |
fdbdb52a | 19 | name: 'KERNEL_TAG_ID' |
962ee225 FD |
20 | default: '' |
21 | description: 'The linux kernel git tag to build against.' | |
22 | - string: | |
fdbdb52a | 23 | name: 'KERNEL_REPO' |
962ee225 FD |
24 | default: 'git://git-mirror.internal.efficios.com/kernel/stable/linux-stable.git' |
25 | description: 'Linux kernel git repo to checkout the kernel id' | |
26 | - string: | |
fdbdb52a | 27 | name: 'LTTNG_TOOLS_REPO' |
962ee225 FD |
28 | default: 'https://github.com/lttng/lttng-tools.git' |
29 | description: 'LTTng-Tools git repo to checkout the tools id' | |
30 | - string: | |
fdbdb52a | 31 | name: 'LTTNG_MODULES_REPO' |
962ee225 FD |
32 | default: 'https://github.com/lttng/lttng-modules.git' |
33 | description: 'LTTng-Modules git repo to checkout the Modules id' | |
34 | - string: | |
fdbdb52a | 35 | name: 'LTTNG_UST_REPO' |
962ee225 FD |
36 | default: 'https://github.com/lttng/lttng-ust.git' |
37 | description: 'LTTng-UST git repo to checkout the UST id' | |
38 | ||
f494aee6 FD |
39 | - publisher: |
40 | name: 'system_tests_email_ext_default' | |
962ee225 FD |
41 | publishers: |
42 | - email-ext: | |
5a754cf7 | 43 | recipients: 'ci-notification@lists.lttng.org, cc:francis.deslauriers@efficios.com' |
962ee225 FD |
44 | reply-to: ci-notification@lists.lttng.org |
45 | always: false | |
46 | unstable: false | |
47 | first-failure: true | |
48 | first-unstable: true | |
49 | not-built: false | |
50 | aborted: false | |
51 | regression: false | |
52 | failure: false | |
53 | second-failure: false | |
54 | improvement: false | |
55 | still-failing: false | |
56 | success: false | |
57 | fixed: false | |
58 | fixed-unhealthy: true | |
59 | still-unstable: false | |
60 | pre-build: false | |
61 | matrix-trigger: only-parent | |
62 | send-to: | |
63 | - recipients | |
962ee225 | 64 | |
c17a93f3 FD |
65 | ## Templates |
66 | - job-template: | |
67 | name: baremetal_benchmarks_k{kversion}_l{lttngversion} | |
95326029 | 68 | description: | |
962ee225 FD |
69 | Runs baremetal kernel benchmarks over different combination of kernel and lttng configurations. |
70 | project-type: freestyle | |
16844a6d | 71 | node: 'amd64' |
a2a6063c | 72 | |
02126236 | 73 | <<: *system_tests_parameters_defaults |
95326029 | 74 | |
95326029 | 75 | properties: |
d6d1423b MJ |
76 | - build-discarder: |
77 | num-to-keep: 10 | |
95326029 FD |
78 | - throttle: |
79 | max-total: 2 | |
80 | option: 'category' | |
81 | categories: | |
1ac7fa2c | 82 | - 'baremetal-tests' |
d6d1423b | 83 | |
95326029 FD |
84 | wrappers: |
85 | - workspace-cleanup | |
86 | - timestamps | |
87 | - ansicolor | |
88 | - credentials-binding: | |
89 | - text: | |
90 | credential-id: jenkins_lava_key | |
30003819 | 91 | variable: LAVA_JENKINS_TOKEN |
d02bd6c0 JR |
92 | - text: |
93 | credential-id: jenkins_lava2_key | |
94 | variable: LAVA2_JENKINS_TOKEN | |
cfceede2 | 95 | - file: |
fe4acd56 | 96 | credential-id: system_tests_storage_key |
cfceede2 | 97 | variable: identity_file |
95326029 FD |
98 | - inject: |
99 | properties-content: | | |
1ac7fa2c | 100 | BUILD_DEVICE=baremetal |
9356eef7 | 101 | LTTNG_VERSION={lttngversion} |
b33f21f4 FD |
102 | scm: |
103 | - git: | |
104 | url: https://github.com/lttng/lttng-ci | |
105 | basedir: src/lttng-ci/ | |
d6d1423b | 106 | |
962ee225 | 107 | builders: |
02126236 FD |
108 | - shell: !include-raw-escape: scripts/system-tests/generate-properties-master.sh |
109 | - shell: !include-raw-escape: scripts/system-tests/inject-ssh-commands.sh | |
962ee225 FD |
110 | - trigger-builds: |
111 | - project: "build_kernel_PARAM" | |
112 | property-file: 'properties.txt' | |
113 | block: true | |
114 | - inject: | |
115 | properties-file: properties.txt | |
02126236 FD |
116 | - shell: !include-raw-escape: scripts/system-tests/run-baremetal-benchmarks.sh |
117 | - shell: !include-raw-escape: scripts/system-tests/summarize-results.sh | |
962ee225 | 118 | |
95326029 | 119 | publishers: |
104ed94b FD |
120 | - archive: |
121 | artifacts: '*.png,*.csv' | |
122 | stable: true | |
123 | do-not-fingerprint: true | |
104ed94b FD |
124 | - image-gallery: |
125 | - gallery-type: archived-images-gallery | |
126 | title: Results | |
127 | includes: '*.png' | |
62c50903 | 128 | - workspace-cleanup |
d6d1423b | 129 | |
c17a93f3 FD |
130 | - job-template: |
131 | name: vm_tests_k{kversion}_l{lttngversion} | |
95326029 | 132 | description: | |
af8278b2 | 133 | Runs root_regression and root_destructive_tests on a virtual machine over different combinations of kernel and lttng configurations. |
1ac7fa2c | 134 | project-type: freestyle |
16844a6d | 135 | node: 'amd64' |
02126236 | 136 | <<: *system_tests_parameters_defaults |
d6d1423b | 137 | |
1ac7fa2c | 138 | properties: |
d6d1423b MJ |
139 | - build-discarder: |
140 | num-to-keep: 10 | |
1ac7fa2c | 141 | - throttle: |
e78c69f3 | 142 | max-total: 4 |
1ac7fa2c FD |
143 | option: 'category' |
144 | categories: | |
145 | - 'kvm-tests' | |
d6d1423b | 146 | |
1ac7fa2c FD |
147 | wrappers: |
148 | - workspace-cleanup | |
149 | - timestamps | |
150 | - ansicolor | |
151 | - credentials-binding: | |
152 | - text: | |
153 | credential-id: jenkins_lava_key | |
30003819 | 154 | variable: LAVA_JENKINS_TOKEN |
d02bd6c0 JR |
155 | - text: |
156 | credential-id: jenkins_lava2_key | |
157 | variable: LAVA2_JENKINS_TOKEN | |
1ac7fa2c FD |
158 | - inject: |
159 | properties-content: | | |
160 | BUILD_DEVICE=kvm | |
9356eef7 | 161 | LTTNG_VERSION={lttngversion} |
492954ee | 162 | |
b33f21f4 FD |
163 | scm: |
164 | - git: | |
165 | url: https://github.com/lttng/lttng-ci | |
166 | basedir: src/lttng-ci/ | |
167 | ||
1ac7fa2c | 168 | builders: |
02126236 | 169 | - shell: !include-raw-escape: scripts/system-tests/generate-properties-master.sh |
1ac7fa2c FD |
170 | - trigger-builds: |
171 | - project: "build_kernel_PARAM" | |
172 | property-file: 'properties.txt' | |
173 | block: true | |
174 | - inject: | |
175 | properties-file: properties.txt | |
02126236 | 176 | - shell: !include-raw-escape: scripts/system-tests/run-kvm-tests.sh |
1ac7fa2c | 177 | |
f494aee6 | 178 | publishers: |
f494aee6 | 179 | - workspace-cleanup |
d6d1423b | 180 | |
c17a93f3 FD |
181 | - job-template: |
182 | name: baremetal_tests_k{kversion}_l{lttngversion} | |
a2a6063c | 183 | description: | |
af8278b2 | 184 | Runs perf_regression tests on a baremetal machine over different combinations of kernel and lttng configurations. |
1ac7fa2c | 185 | project-type: freestyle |
16844a6d | 186 | node: 'amd64' |
d6d1423b | 187 | |
02126236 | 188 | <<: *system_tests_parameters_defaults |
962ee225 | 189 | |
dc9700c9 | 190 | properties: |
d6d1423b MJ |
191 | - build-discarder: |
192 | num-to-keep: 10 | |
dc9700c9 FD |
193 | - throttle: |
194 | max-total: 2 | |
195 | option: 'category' | |
196 | categories: | |
95326029 | 197 | - 'baremetal-tests' |
d6d1423b | 198 | |
a2a6063c FD |
199 | wrappers: |
200 | - workspace-cleanup | |
201 | - timestamps | |
202 | - ansicolor | |
203 | - credentials-binding: | |
204 | - text: | |
205 | credential-id: jenkins_lava_key | |
30003819 | 206 | variable: LAVA_JENKINS_TOKEN |
d02bd6c0 JR |
207 | - text: |
208 | credential-id: jenkins_lava2_key | |
209 | variable: LAVA2_JENKINS_TOKEN | |
a2a6063c FD |
210 | - inject: |
211 | properties-content: | | |
95326029 | 212 | BUILD_DEVICE=baremetal |
9356eef7 | 213 | LTTNG_VERSION={lttngversion} |
d6d1423b | 214 | |
b33f21f4 FD |
215 | scm: |
216 | - git: | |
217 | url: https://github.com/lttng/lttng-ci | |
218 | basedir: src/lttng-ci/ | |
219 | ||
a2a6063c | 220 | builders: |
02126236 | 221 | - shell: !include-raw-escape: scripts/system-tests/generate-properties-master.sh |
a2a6063c FD |
222 | - trigger-builds: |
223 | - project: "build_kernel_PARAM" | |
224 | property-file: 'properties.txt' | |
225 | block: true | |
226 | - inject: | |
227 | properties-file: properties.txt | |
02126236 | 228 | - shell: !include-raw-escape: scripts/system-tests/run-baremetal-tests.sh |
a2a6063c | 229 | |
f494aee6 | 230 | publishers: |
f494aee6 | 231 | - workspace-cleanup |
d6d1423b | 232 | |
a2a6063c | 233 | - job-template: |
a2a6063c FD |
234 | name: build_kernel_PARAM |
235 | description: | | |
236 | Builds a Linux Kernel and LTTng Modules if necessary | |
a2a6063c | 237 | concurrent: true |
16844a6d | 238 | node: 'amd64' |
a2a6063c | 239 | |
afd0d7f8 FD |
240 | parameters: |
241 | - string: | |
242 | name: 'LTTNG_MODULES_COMMIT_ID' | |
243 | description: 'The lttng-modules commmit to build.' | |
244 | - string: | |
245 | name: 'LTTNG_MODULES_REPO' | |
246 | description: 'The LTTng Modules git repo to fetch from' | |
247 | default: 'git://git-mirror.internal.efficios.com/lttng/lttng-modules.git' | |
248 | - string: | |
249 | name: 'KERNEL_COMMIT_ID' | |
250 | description: 'The kernel commit to build.' | |
251 | - string: | |
252 | name: 'KGITREPO' | |
253 | description: 'The kernel git repo to fetch from' | |
254 | - string: | |
255 | name: 'STORAGE_KERNEL_FOLDER' | |
256 | description: 'Path to store the Kernel image' | |
257 | - string: | |
258 | name: 'STORAGE_KERNEL_IMAGE' | |
259 | description: 'Path to store the Kernel IMAGE' | |
260 | - string: | |
261 | name: 'STORAGE_LINUX_MODULES' | |
262 | description: 'Path to store the Kernel Modules' | |
263 | - string: | |
264 | name: 'STORAGE_LTTNG_MODULES' | |
265 | description: 'Path to store the LTTng Modules' | |
266 | - string: | |
267 | name: 'BUILD_DEVICE' | |
268 | description: 'The target device. (kvm or baremetal)' | |
6252703b JR |
269 | - string: |
270 | name: 'S3_STORAGE_KERNEL_FOLDER' | |
271 | description: 'Path to store the Kernel image' | |
272 | - string: | |
273 | name: 'S3_STORAGE_KERNEL_IMAGE' | |
274 | description: 'Path to store the Kernel IMAGE' | |
275 | - string: | |
276 | name: 'S3_STORAGE_LINUX_MODULES' | |
277 | description: 'Path to store the Kernel Modules' | |
278 | - string: | |
279 | name: 'S3_STORAGE_LTTNG_MODULES' | |
280 | description: 'Path to store the LTTng Modules' | |
afd0d7f8 | 281 | |
d6d1423b MJ |
282 | properties: |
283 | - build-discarder: | |
284 | num-to-keep: 100 | |
285 | ||
a2a6063c FD |
286 | wrappers: |
287 | - workspace-cleanup | |
288 | - timestamps | |
289 | - ansicolor | |
290 | - credentials-binding: | |
291 | - file: | |
fe4acd56 | 292 | credential-id: system_tests_storage_key |
a2a6063c | 293 | variable: identity_file |
d6d1423b | 294 | |
b33f21f4 FD |
295 | scm: |
296 | - git: | |
297 | url: https://github.com/lttng/lttng-ci | |
298 | basedir: src/lttng-ci/ | |
b33f21f4 FD |
299 | - git: |
300 | url : $LTTNG_MODULES_REPO | |
301 | basedir: src/lttng-modules/ | |
302 | branches: | |
303 | - $LTTNG_MODULES_COMMIT_ID | |
304 | ||
a2a6063c | 305 | builders: |
02126236 | 306 | - shell: !include-raw-escape: scripts/system-tests/generate-properties-slave.sh |
a2a6063c FD |
307 | - inject: |
308 | properties-file: properties.txt | |
02126236 | 309 | - shell: !include-raw-escape: scripts/system-tests/check-build-needs.sh |
a2a6063c FD |
310 | - conditional-step: |
311 | condition-kind: not | |
312 | condition-operand: | |
313 | condition-kind: file-exists | |
314 | condition-filename: kernel-built.txt | |
315 | condition-basedir: workspace | |
316 | steps: | |
02126236 | 317 | - shell: !include-raw-escape: scripts/system-tests/build-kernel.sh |
a2a6063c FD |
318 | - conditional-step: |
319 | condition-kind: not | |
320 | condition-operand: | |
321 | condition-kind: file-exists | |
322 | condition-filename: modules-built.txt | |
323 | condition-basedir: workspace | |
324 | steps: | |
02126236 | 325 | - shell: !include-raw-escape: scripts/system-tests/build-modules.sh |
a2a6063c | 326 | |
62c50903 FD |
327 | publishers: |
328 | - workspace-cleanup | |
a2a6063c | 329 | |
962ee225 | 330 | - job-template: |
5a754cf7 | 331 | name: system_ALL_{test_type}_trigger |
962ee225 FD |
332 | description: | |
333 | This job will trigger the build of jobs when a new tag is push specific | |
334 | tracked Linux branches and new commits on LTTng tracked branches | |
335 | ||
336 | project-type: freestyle | |
337 | node: 'master' | |
e000d719 JR |
338 | parameters: |
339 | - bool: | |
340 | name: 'FORCE_JOB_RUN' | |
341 | default: false | |
342 | description: 'Force the child jobs to run' | |
75ecf045 JR |
343 | - bool: |
344 | name: 'FORCE_FAILED_JOB_RUN' | |
345 | default: false | |
346 | description: 'Force the failed child jobs to run' | |
962ee225 FD |
347 | |
348 | properties: | |
349 | - build-discarder: | |
350 | num-to-keep: 10 | |
351 | ||
352 | triggers: | |
d9d6e83c | 353 | - timed: "H 0 * * 1-5" |
962ee225 FD |
354 | |
355 | wrappers: | |
356 | - timestamps | |
357 | - ansicolor | |
358 | ||
359 | builders: | |
360 | - system-groovy: | |
361 | command: | |
02126236 | 362 | !include-raw-escape: scripts/system-tests/system-trigger.groovy |
962ee225 | 363 | |
f494aee6 FD |
364 | publishers: |
365 | - system_tests_email_ext_default | |
962ee225 | 366 | |
c17a93f3 | 367 | ## Project |
962ee225 | 368 | |
962ee225 FD |
369 | # Canary jobs are made to confirm that the whole Lava pipeline is working. |
370 | # They are scheduled once a day always on the same (LTTng, Kernel) code. If any | |
371 | # of those jobs fails, it means that there is an issue with the configuration | |
962ee225 | 372 | |
a2a6063c | 373 | - project: |
02126236 | 374 | name: system-tests |
a2a6063c | 375 | kversion: |
c17a93f3 | 376 | - canary |
962ee225 | 377 | - master |
3f0881e9 | 378 | - linux-4.4.y |
c71443a8 | 379 | - linux-4.9.y |
f764faa2 JR |
380 | - linux-4.14.y |
381 | - linux-4.19.y | |
2537aa57 JR |
382 | - linux-5.0.y |
383 | - linux-5.1.y | |
a2a6063c | 384 | lttngversion: |
c17a93f3 | 385 | - canary |
a2a6063c | 386 | - master |
767b9687 | 387 | - stable-2.10 |
b66a41c2 JR |
388 | - stable-2.11 |
389 | - stable-2.12 | |
a2a6063c | 390 | jobs: |
48ddcc03 | 391 | - 'vm_tests_k{kversion}_l{lttngversion}' |
a2a6063c | 392 | - 'baremetal_benchmarks_k{kversion}_l{lttngversion}' |
1ac7fa2c | 393 | - 'baremetal_tests_k{kversion}_l{lttngversion}' |
a28d0f54 JR |
394 | - project: |
395 | name: system-tests-vm-only | |
396 | kversion: | |
397 | - linux-3.18.y | |
398 | lttngversion: | |
399 | - master | |
a28d0f54 | 400 | - stable-2.10 |
b66a41c2 JR |
401 | - stable-2.11 |
402 | - stable-2.12 | |
a28d0f54 JR |
403 | jobs: |
404 | - 'vm_tests_k{kversion}_l{lttngversion}' | |
95326029 | 405 | |
962ee225 | 406 | - project: |
02126236 | 407 | name: system-general |
5a754cf7 FD |
408 | test_type: |
409 | - vm_tests | |
410 | - baremetal_tests | |
411 | - baremetal_benchmarks | |
95326029 | 412 | jobs: |
962ee225 | 413 | - 'build_kernel_PARAM' |
5a754cf7 | 414 | - 'system_ALL_{test_type}_trigger' |