Merge lp://staging/~canonical-platform-qa/britney/tests into lp://staging/~ubuntu-release/britney/britney2-ubuntu

Proposed by Martin Pitt
Status: Merged
Approved by: Colin Watson
Approved revision: 408
Merged at revision: 397
Proposed branch: lp://staging/~canonical-platform-qa/britney/tests
Merge into: lp://staging/~ubuntu-release/britney/britney2-ubuntu
Diff against target: 451 lines (+446/-0)
1 file modified
tests/autopkgtest.py (+446/-0)
To merge this branch: bzr merge lp://staging/~canonical-platform-qa/britney/tests
Reviewer Review Type Date Requested Status
Colin Watson (community) Approve
Review via email: mp+207982@code.staging.launchpad.net

Description of the change

Add tests and reproduce some important bugs

This reproduces two bugs which we've recently encountered, and an additional
one which came up when writing the tests:

 * If a new source builds an existing binary, britney ignores all autopkgtests.
   This is what caused the "break trusty" disaster when uploading gccgo-4.9
   which built an empty/broken libgcc1.

 * Britney requests autopkgtest runs for uninstallable packages, causing
   needless test failures and manual intervention to re-try packages once they
   become installable again.

 * Britney does not cross-check the version number that a test was run with,
   and just applies the test result to the currently pending version. This
   hasn't demonstrably caused any ill effect in practice as adt-britney should
   already ensure that the requested version was tested. It might be a good
   idea to verify this anyway though, for robustness.

Simply run the tests with "tests/autopkgtest.py" after checking out the tree,
building lib, and creating the britneymodule.so -> lib/britneymodule.so link.

To post a comment you must log in.
399. By Martin Pitt

use symbolic constants instead of True/False for considered status

400. By Martin Pitt

some more tests

401. By Martin Pitt

add --debug option mock adt-britney

402. By Martin Pitt

run britney in verbose mode

403. By Martin Pitt

merge with trunk

404. By Martin Pitt

merge trunk

405. By Martin Pitt

add test for uninstallable binary built from new source package

406. By Martin Pitt

fix source package name in cause of new_source tests

Revision history for this message
Martin Pitt (pitti) wrote :

> * If a new source builds an existing binary, britney ignores all autopkgtests.
> This is what caused the "break trusty" disaster when uploading gccgo-4.9
> which built an empty/broken libgcc1.

While the actual bug is still there somewhere (it did happen, after all), these tests don't reproduce that unfortunately. Turned out the failures were due to a copy&paste error, fixed in r406. They pass now.

407. By Jean-Baptiste Lallement

merged trunk

408. By Martin Pitt

Mark test_result_from_older_version as XFAIL

Revision history for this message
Colin Watson (cjwatson) :
review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
The diff is not available at this time. You can reload the page or download it.

Subscribers

People subscribed via source and target branches