lp:~canonical-kernel-team/+git/autotest-client-tests

Author: Po-Hsu Lin
Author Date: 2023-10-17 07:58:57 UTC

UBUNTU: SAUCE: ubuntu_ltp_stable: set timeout multiplier to 5 for hugefork02

BugLink: https://bugs.launchpad.net/bugs/2026543

Tests show this hugefork02 test in hugetlb will take about 90 seconds to
run on ARM64 node wright. If the test did not finish successfully, it
will cause hugemmap05, hugemmap05_1, hugemmap10 and hugeshmctl02 to fail
as well.

Set the timeout multiplier to 5, so it will have 5*30 seconds to finish
the test.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Thibf
Author Date: 2023-10-13 08:49:10 UTC

UBUNTU: SAUCE: ubuntu_zfs_stress: retry destroying the pool

Can fail to be removed, retry multiple times before dropping it.

Signed-off-by: Thibault Ferrante <thibault.ferrante@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-09-15 11:35:53 UTC

UBUNTU: SAUCE: ubuntu_lttng_smoke_test: bump timeout to 30 mins

BugLink: https://bugs.launchpad.net/bugs/2036194

The whole process of the test (install packages, build DKMS module,
test, remove DKMS) will take about 20 minutes to run on AWS a1.medium.

Bump the timeout to 30 minutes to give it a chance to finish.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-09-14 02:24:55 UTC

UBUNTU: SAUCE: ubuntu_kernel_selftests: cleanup ftrace related code

ftrace test has been moved into ubuntu_kselftests_ftrace, related code
can be removed now.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-05-02 09:36:37 UTC

UBUNTU: SAUCE: build tests only

Just install dependencies and build tests, do not actually
run them.

This is meant for manual debugging.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2022-07-04 03:41:12 UTC

DEV: ubuntu_ltp*: use tip-testing branch

Use tip-testing branch for testing upstream code.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-09-06 04:57:15 UTC

UBUNTU: SAUCE: ubuntu_kernel_selftests: remove package requirement constraint for libnuma-dev and libfuse-dev

BugLink: https://bugs.launchpad.net/bugs/2033520

The build for net tests on X-hwe-s390x will fail with:
  reuseport_bpf_numa.c:24:18: fatal error: numa.h: No such file or directory

Also reuseport_bpf_numa, reuseport_dualstack and reuseaddr_conflict tests
will fail to start because ther are not executable.

Add libnuma-dev and libfuse-dev directly to pkgs, we used to limit these
two for non T/X-s390x as they were not built for s390x back then.

These two packages are available for s390x now, and since we don't run
ubuntu_kernel_selftests on Trusty the if statement can be removed.

$ rmadison -a s390x libfuse-dev
 libfuse-dev | 2.9.4-1ubuntu3 | xenial | s390x
 libfuse-dev | 2.9.4-1ubuntu3.1 | xenial-updates | s390x
$ rmadison -a s390x libnuma-dev
 libnuma-dev | 2.0.11-1ubuntu1.1 | xenial-security | s390x
 libnuma-dev | 2.0.11-1ubuntu1.1 | xenial-updates | s390x

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-08-30 10:28:45 UTC

UBUTNU: SAUCE: ubuntu_overlayfs_smoke_test: bump timeout to 10 minutes

BugLink: https://bugs.launchpad.net/bugs/2033516

The ubuntu_overlayfs_smoke_test.sh will take about 6 minutes to run
with Focal RISCV 5.15 instance.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-08-30 08:55:25 UTC

UBUNTU: SAUCE: rmaptest: bump timeout to 25m

BugLink: https://bugs.launchpad.net/bugs/2033498

Test shows it can take up to 18.5 minutes to run on some openstack instance.
Bump the timeout threshold to 25 minutes to give it a chance to finish.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-08-28 03:25:22 UTC

UBUNTU: SAUCE: ubuntu_ltp_syscalls: skip fanotify07 and setsockopt09 for 3.13

BugLink: https://bugs.launchpad.net/bugs/2033018

The fanotify07 and setsockopt09 cannot finish properly on Trusty 3.13
Mark them as failed directly to keep it going.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-08-25 04:24:05 UTC

UBUNTU: SAUCE: remove submodule

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Magali Lemes do Sacramento
Author Date: 2023-08-23 16:57:15 UTC

UBUNTU: SAUCE: ubuntu_bpf: build headers after installing required packages

BugLink: https://bugs.launchpad.net/bugs/2032807

ubuntu_bpf test fails during setup because the command 'make' isn't
available yet. Therefore, only build the headers after the required
packages are installed and after ensuring that the 'linux' repo is
accessible.

Signed-off-by: Magali Lemes <magali.lemes@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-08-23 10:48:09 UTC

UBUNTU: SAUCE: ubuntu_overlayfs_smoke_test: run just ubuntu_overlayfs_smoke_test.sh on release < Focal

BugLink: https://bugs.launchpad.net/bugs/2032779

We have decided to run just the old ubuntu_overlayfs_smoke_test.sh test
on older release (< Focal). As the purpose of the new overlayfs/shift
tests is to have a better understanding of the custom features that we
bring as SAUCE patches and to make sure that newer kernels don't regress.

This would require changes in the overlay-shiftfs-tests repo as well.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Magali Lemes do Sacramento
Author Date: 2023-08-22 14:20:51 UTC

UBUNTU: SAUCE: ubuntu_zfs_xfs_generic: reset xfstests-dev to working version

BugLink: https://bugs.launchpad.net/bugs/2029500

Ever since commit 3e7529af ("fstests: add AFS support") was introduced
to xfstests-dev, the "0001-xfstests-add-minimal-support-for-zfs.patch"
patch fails to be applied and the tests are not run. Therefore, rely on
the previous version that makes the patch apply cleanly by resetting to
the corresponding tag.

Signed-off-by: Magali Lemes <magali.lemes@canonical.com>

Author: Portia Stephens
Author Date: 2023-08-04 16:13:50 UTC

UBUNTU: SAUCE: ubuntu_xilinx: Fix snap dependency for Focal

xlnx-config must be installed from xlnx-config 1.0 track, the install of
xlnx-config in setup() was causing the Focal regression test to fail. For Focal
xlnx-config is installed in the _install_deps but Jammy it is installed
in the test setup(). This updates run-test so that both Jammy and Focal
install xlnx-config in the same place.

This also adds support for the KR260 board which is new for Jammy.

Signed-off-by: Portia Stephens <portia.stephens@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-07-12 04:26:13 UTC

UBUNTU: SAUCE: ubuntu_ltp_controllers: fail cpuset_hotplug on X-aws-4.4 VM directly

BugLink: https://bugs.launchpad.net/bugs/2026722

cpuset_hotplug will hang on X-aws-4.4 VMs (those with CPU <=2). This
issue can be reproduced all the way back to X-aws-1128, with current
and previous LTP fork.

When this happens, it will cause failure to cpuset_memory as well and
eventually leads to an incomplete test report. Let's fail this test
directly on this kernel to get the test going.

This issue didn't emerge until we begin to run ubuntu_ltp_controllers on
Xenial in recent cycle.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-07-06 07:03:33 UTC

UBUNTU: SAUCE: ubuntu_ltp_stable: set LTP_TIMEOUT_MUL=10 for hugemmap15

BugLink: https://bugs.launchpad.net/bugs/2026248

hugemmap15 will take about 161 seconds to run on J-generic-64k,
set LTP_TIMEOUT_MUL=10 (300 seconds) to give it a chance to finish.

Change where we print the information for LTP_TIMEOUT_MUL change.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-07-06 07:03:33 UTC

UBUNTU: SAUCE: ubuntu_ltp_stable: set LTP_TIMEOUT_MUL=10 for hugemmap15

BugLink: https://bugs.launchpad.net/bugs/2026248

hugemmap15 will take about 161 seconds to run on J-generic-64k,
set LTP_TIMEOUT_MUL=10 (300 seconds) to give it a chance to finish.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-06-21 02:45:44 UTC

UBUNTU: SAUCE: ubuntu_kernel_selftests: remove ftrace test

We have ftrace test splitted to ubuntu_ftrace_smoke_test, and it has
been tested for one SRU cycle. I think we can remove ftrace from
ubuntu_kernel_selftests now.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-06-16 10:51:45 UTC

UBUNTU: SAUCE: ubuntu_bpf: bump test build timeout threshold

BugLink: https://bugs.launchpad.net/bugs/2023550

The test build will timeout on some instance with the current 30m
setting.

With test results gathered from all 4 clouds, the longest run took
1h45m on AWS a1.medium. Therefore 2 hours timeout should be OK.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-06-12 14:44:59 UTC

UBUNTU: SAUCE: ubuntu_bpf: add libssl-dev to pkg list

BugLink: https://bugs.launchpad.net/bugs/2023549

On Lunar, ubuntu_bpf test will need libssl-dev to build.
Instead of adding another if statement for checking the series,
I decided to add it to the pkg list as this package is available
in the archive since Xenial.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-05-19 11:12:58 UTC

UBUNTU: SAUCE: ubuntu_kselftests_ftrace: clone ftrace out from ubuntu_kernel_selftests

ftrace test sometimes will hang and make ubuntu_kernel_selftests ended
up in an incomplete state.

Split it out to improve the test granularity and flexibility and thus
make it easier to debug.

The ftrace test in ubuntu_kernel_selftests is not removed in this
commit, it will be removed after everything is in place and we have
test results coming out from this newly added ubuntu_kselftests_ftrace
test.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-04-14 11:40:04 UTC

UBUNTU: SAUCE: ubuntu_kernel_selftests: run powerpc test before net test

BugLink: https://bugs.launchpad.net/bugs/2015745

The net:udpgro_frglist.sh test will trigger a soft lockup on K-5.19 P9
(LP: #2015843) and thus tainting the kernel. The mitigation-patching.sh
test in powerpc/security after the net tests will fail directly due to
the kernel is already tainted.

A quick solution is to run powerpc test before net tests.

This has been tested with K-5.19 P9 and works as expected.

We will probably catch new failures in older kernels like b-hwe-5.4,
in which the net:reuseport_bpf_cpu will crash the SUT (LP: #1927076).

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Cory Todd
Author Date: 2023-04-07 15:22:19 UTC

UBUNTU: SAUCE: update lingering print statement

Use print function instead of statement. Also use .format since that is
valid for py2.7. Move futures print to top of file for maximum
compatibility.

Signed-off-by: Cory Todd <cory.todd@canonical.com>

Author: Sean Feole
Author Date: 2023-03-27 17:13:22 UTC

[ubuntu_kvm_smoke_test] Add blacklist for cloud.arch

Add the blacklist for cloud.arch
- https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/2009100

Signed-off-by: Sean Feole <sean.feole@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-03-14 04:33:56 UTC

UBUNTU: SAUCE: Use a more flexible way to get SHA1

We are going to skip rsyncing .git directory for qa-regression-testing
repo, by doing so it can save us about 15 minutes.

To cope with this change, we will need to generate SHA1 information on
our server and copy it to SUT.

Since this information is only helpful when debugging a test issue,
there's no need to block the test if this information is not available.

Make this change into all the other git related tests to make them
consistent.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-03-09 07:04:08 UTC

UBUNTU: SAUCE: ubuntu_qrt_kernel_security: fix build issue for J-OEM-6.1

BugLink: https://bugs.launchpad.net/bugs/2009782

To build test_072_strict_devmem and test_120_smep_works on J-OEM-6.1,
we will need gcc-12 otherwise it fail with:
  warning: the compiler differs from the one used to build the kernel
  The kernel was built by: x86_64-linux-gnu-gcc-12 (Ubuntu 12.1.0-2ubuntu1~22.04) 12.1.0
  You are using:
  ....
  /bin/sh: 1: gcc-12: not found" -s

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Sean Feole
Author Date: 2023-03-06 14:16:54 UTC

ubuntu_docker_smoke && ubuntu_fan test: Proxy

BugLink: https://bugs.launchpad.net/bugs/2009351

- Append HTTPS_PROXY and NO_PROXY variables to docker http-proxy.conf
These values are required to allow communication with
registry-1.docker.io/v2/ when in the Openstack Cloud

- In the ubuntu fan test, remove the wget attempt for index.docker.io
The URI was invalid and returned a http 404 error, in this case
triggering the `else` and unsetting the http_proxy.

The check itself was not valid, due to Canonicals internal firewall
rules, index-docker and registry-docker are 2 separate acls and each
need to be configured for the network under test.

Signed-off-by: Sean Feole <sean.feole@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-02-08 07:43:58 UTC

UBUNTU: SAUCE: ubuntu_kernel_selftests: bump timeout for fcnal-test.sh test

BugLink: https://bugs.launchpad.net/bugs/2006499

fcnal-test.sh would require about 51 minutes to run on node kili,
bump the timeout threshold to 75 minutes for this test.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Cory Todd
Author Date: 2023-02-06 18:58:04 UTC

UBUNTU: SAUCE: ubuntu_leap_seconds: clear time state

BugLink: https://bugs.launchpad.net/bugs/2006355

Clear time state on test timeout to ensure system timestamps are
accurate. The timestamp captured in the log file are not important but
the final time span calculate is used for test execution time tracking
so we would like that to be correct.

Signed-off-by: Cory Todd <cory.todd@canonical.com>

Author: Francis Ginther
Author Date: 2023-01-27 15:42:07 UTC

python2to3: Use python3 for executing qrt tests

Use python3 when executing the qrt tests for anything newer than focal.
Continue to use python2 for focal and older.

Signed-off-by: Francis Ginther <francis.ginther@canonical.com>

Author: Portia Stephens
Author Date: 2022-10-06 02:10:58 UTC

UBUNTU SAUCE: ubuntu_cve_kernel: skip CVE-2021-2736X without iscsi_tcp

Skip CVE-2021-2736X if CONFIG_SCSI_ISCSI_ATTRS and CONFIG_ISCSI_TCP are
not enabled in the kernel.

Signed-off-by: Portia Stephens <portia.stephens@canonical.com>

Author: Portia Stephens
Author Date: 2022-09-14 13:56:34 UTC

UBUNTU: SAUCE: ubuntu_xilinx: Initial commit of Xilinx test suite

This contains the initial code for ubuntu_xilinx tests. It contains one
test xlnx-config which checks that the board detected from the device
tree matches the board that is read through the EEPROM.

Signed-off-by: Portia Stephens <portia.stephens@canonical.com>

Author: Cory Todd
Author Date: 2022-09-27 19:57:29 UTC

Revert "UBUNTU: SAUCE: ubuntu_lxc: use impish branch for jammy"

This reverts commit e6a022918c1051b5552ceb7548ccec124437be30.

The dbm-jammy branch was added by upstream commit
cd1eb08 ("Import lxc_5.0.0~git2209-g5a7b9ce67.orig.tar.gz")

Signed-off-by: Cory Todd <cory.todd@canonical.com>

Author: Cory Todd
Author Date: 2022-09-27 19:44:25 UTC

Revert "UBUNTU: SAUCE: ubuntu_lxc: use source code from the archive"

This reverts commit 1d85c48bb9f6406313b32bcdc76d31efc5461995.

LP: #1960094 was introduced to work around an ABI mismatch between lxc
and the lxc-pkg-ubuntu test source. Now that the archives are serving
4.0.12 we should fallback to using the latest source. This will have the
added benefit of fixing LP: #1943441 which currently has 116 hints
against it.

Signed-off-by: Cory Todd <cory.todd@canonical.com>

Author: Dimitri John Ledkov
Author Date: 2022-07-19 15:57:43 UTC

UBUNTU: SAUCE: ubuntu_kernel_selftests: scale riscv64 tests by 2x

Scale riscv64 tests by 2x. From time to time, various test cases
simply timeout, whilst progressing fine. Scale all timeouts by 2x to
hopefully improve riscv64 test stability.

Signed-off-by: Dimitri John Ledkov <dimitri.ledkov@canonical.com>

Author: Po-Hsu Lin
Author Date: 2021-12-28 06:39:12 UTC

UBUNTU: SAUCE: ubuntu_k8s_unit_tests: improve test granularity

Improve test granularity by running tests one-by-one.

As the test case name is actually the path of the go file, we will
need to replace the '/' with '--' to avoid possible name collision
for directories created by the autotest framework. One good example
is these two tests executed one-by-one:
  * pkg/kubelet/prober
  * pkg/kubelet/prober/results

We also need one extra script, test-list-generator.sh, to help us to
determine what should be tested or skipped. It's actually the code
snippet of function kube::test::find_dirs() extracted from the
following script of the kubernetes repository:
  * hack/test-go.sh (release-1.3)
  * hack/make-rules/test.sh (>= release-1.12)

Patch tested with Bionic / Jammy. the downside of this is that it will
increase the time cost.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2022-04-28 04:57:59 UTC

UBUNTU: SAUCE: Don't cleanup ZFS on system with ZFS filesystem in use

BugLink: https://bugs.launchpad.net/bugs/1970600/

The post-test-zfs-cleanup add for zfs-related tests will break system
that runs on ZFS. Check if the SUT is using it with "df -t zfs" before
trying to do the cleanup.

Patch tested on s390x LPAR with ubuntu_zfs_smoke_test test (not a
zfs-based system though).

Fixes: 4c9ac393e457 ("UBUNTU: SAUCE: Remove zfs-related packages after test")
Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>