QA Regression Testing

Merge ~alexmurray/qa-regression-testing:lpcraft-ci into qa-regression-testing:master

  1. Git
  2. lp:~alexmurray/qa-regression-testing
  3. lpcraft-ci
  4. Merge into master
Proposed by Alex Murray
Status: Merged
Merged at revision: 88598b71c9c937897eb45cab3a30c0699cc8064a
Proposed branch: ~alexmurray/qa-regression-testing:lpcraft-ci
Merge into: qa-regression-testing:master
Diff against target: 139 lines (+104/-3)
3 files modified
.launchpad.yaml (+57/-0)
lpcraft-runner (+44/-0)
scripts/test-gnupg.py (+3/-3)
Reviewer Review Type Date Requested Status
Ubuntu Security Team Pending
Review via email: mp+437474@code.staging.launchpad.net

Description of the change

So I am not sure if this is the best way to shoehorn lpcraft for CI of QRT but it is an initial stab at least. I wanted to try and make sure each script on each series gets enumerated as a separate job with the least amount of copy-pasta in the .launchpad.yaml - there may be a better way bit this appears to work for now.

Currently the gcc-security tests fail but should pass once https://code.launchpad.net/~alexmurray/qa-regression-testing/+git/qa-regression-testing/+merge/437462 is merged.

To post a comment you must log in.
Revision history for this message
Alex Murray (alexmurray) wrote :

Note the duplicate test runs and hence job entries seen in the test output is a known bug in Launchpad - https://bugs.launchpad.net/launchpad/+bug/1999591 (ie there should only be one coverage:0 etc - but say for gcc-security we expect there to be 3 instances - gcc-security:0, gcc-security:1 etc for each bionic, focal and jammy - but there should not be multiple gcc-security:0 which is due to the aforementioned bug)

Revision history for this message
Alex Murray (alexmurray) wrote :

Ok, I feel like this PoC is ready for review now - tests pass for both sudo and gnupg and once gcc-security changes get merged that should pass too.

Then we can look at extending this to cover other test scripts in QRT.

Can someone please take a look?

There was an error fetching revisions from git servers. Please try again in a few minutes. If the problem persists, contact Launchpad support.

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
The diff is not available at this time. You can reload the page or download it.

Subscribers

People subscribed via source and target branches