lp:~alexmurray/qa-regression-testing

Author: Alex Murray
Author Date: 2025-03-19 05:22:45 UTC

scripts/test-libphp-adodb.py: skip test on noble due to LP: #2065876

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2025-03-18 02:59:44 UTC

tests/spread/task.yaml: log to both stdout and task.log

This way we get the best of both worlds.

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2025-03-05 22:57:56 UTC

scripts/test-kernel-security.py: skip lockdown if no secure boot

If Secure Boot is not enabled, the kernel lockdown feature is not enforced so
skip this test in that case to avoid false positives (LP: #2100635).

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2025-02-28 00:43:08 UTC

Merge branch 'add-kernel-security-lockdown-runtime-test'

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2025-01-21 03:27:33 UTC

many: rename lpcraft related bits to lpci

The name lpcraft is long dead so we should stop using it to avoid confusion and
use lpci instead.

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2025-01-21 01:47:50 UTC

scripts/test-kernel-security.py: add runtime test for kernel lockdown

We currently test that lockdown is enabled in the kernel config but we should
also test that it is enabled at runtime as well to avoid any issues like
https://bugzilla.redhat.com/show_bug.cgi?id=2333706

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2024-10-17 12:11:13 UTC

test-amd64-microcode.py: add basic test script to check expected microcode revision

This uses the amd_ucode_info.py script from AMD to parse out
revisions etc from the microcode files. I have successfully
tested this against both LXD VMs and real hardware via
testflinger.

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2024-08-08 02:08:39 UTC

scripts/test-krb5.py: use python3-pexpect instead of python-pexpect

The latter is not available on jammy or newer releases so use python3-pexpect
since it is available on all since at at least trusty.

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2024-06-20 05:14:11 UTC

.launchpad.yaml: add tiff to lpci test matrix

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2024-05-02 23:44:41 UTC

scripts/test-samba.py: skip more tests in lpci that use mount

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2024-05-29 07:22:38 UTC

scripts/test-apparmor.py: ensure sysctls are set for regression tests

When using LXD VMs as a test bed, apparmor is not installed by default and so
when it does get installed during the test setup the sysctls are not enabled -
as such the regression test for userns fails. So make sure the regression test
case always resets these during setup.

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2024-05-29 03:54:13 UTC

scripts/testlib.py: mark _skipped() as deprecated

Instead we should be calling the skipTest() method directly since then we get a
nice count of the number of skipped tests at the end of the test execution, so
modify this method to call that when it is available, but leave it and the old
implementation here for now to support compatibility with Python < 3.1.

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2024-05-06 12:57:37 UTC

README.testing: prioritise arm64 rather than armhf

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2023-11-04 20:59:19 UTC

scripts/test-apparmor.py: skip userns profile test if < kinetic

Fixes LP: #2036955

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2023-11-03 02:11:43 UTC

scripts/test-kernel-security: support zstd compressed modules for LP: #2031377

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2023-03-24 02:35:52 UTC

.launchpad.yaml: add xenial to test matrix

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2023-02-22 06:01:05 UTC

.launchpad.yaml: Try testing sudo instead of glibc-security

glibc-security looks unmaintained so lets try using the sudo test script instead
to exercise a test for QRT scripts that have testlib.require_sudo() instead.

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2023-02-22 01:34:21 UTC

scripts/gcc-security/missing-mode.c: Remove unnecessary change

The change to silence a compile-time warning is not actually required - the
tests still pass even if this is present so leave it unchanged.

Signed-off-by: Alex Murray <alex.murray@canonical.com>

Author: Alex Murray
Author Date: 2022-03-09 05:18:21 UTC

scripts/test-apparmor.py: Specify that test requires no lockdown

Since the apparmor regression tests wants to use ioperm / iopl but this is
disabled when the kernel is locked down, fail early in this case.

Signed-off-by: Alex Murray <alex.murray@canonical.com>