Merge into trunk : stubbox-outcome : Code : Checkbox

Status:	Work in progress
Proposed branch:	lp://staging/~zyga/checkbox/stubbox-outcome
Merge into:	lp://staging/checkbox
Diff against target:	59 lines (+44/-0) 2 files modified plainbox/plainbox/impl/providers/stubbox/units/jobs/categories.pxu (+4/-0) plainbox/plainbox/impl/providers/stubbox/units/jobs/outcome.pxu (+40/-0)
To merge this branch:	bzr merge lp://staging/~zyga/checkbox/stubbox-outcome
Related bugs:	Link a bug report

Reviewer	Review Type	Date Requested	Status
Sylvain Pineau (community)		2014-12-05	Approve on 2014-12-09
Review via email: mp+243809@code.staging.launchpad.net

Description of the change

efb8847 plainbox:providers:stubbox: add outcome-representative category
a0658bf plainbox:providers:stubbox: add outcome/* family of jobs

I'll add a note that this won't work before https://code.launchpad.net/~zkrynicki/checkbox/flexible-resources/+merge/243801 lands (for the outcome/skip case) and it doesn't have all the possible states just yet. I'll probably update this as we go and I have ideas on how to trigger other states :)

Revision history for this message

Sylvain Pineau (sylvain-pineau) wrote on 2014-12-09:

#

+1, just waiting the review of the prerequisite branch

review: Approve

Reply

Revision history for this message

Zygmunt Krynicki (zyga) wrote on 2015-01-22:

#

I'll land it anyway now. It still waits on flexible resources but won't be broken by not having it in any way.

Reply

Revision history for this message

Daniel Manrique (roadmr) wrote on 2015-01-22:

#

Download full text (11.4 KiB)

The attempt to merge lp:~zkrynicki/checkbox/stubbox-outcome into lp:checkbox failed. Below is the output from the failed tests.

[precise] starting container
[precise] (timing) 0.06user 0.00system 0:04.19elapsed 1%CPU (0avgtext+0avgdata 7868maxresident)k
[precise] (timing) 0inputs+32outputs (0major+5777minor)pagefaults 0swaps
[precise] provisioning container
[precise] (timing) 41.11user 10.90system 1:23.10elapsed 62%CPU (0avgtext+0avgdata 51688maxresident)k
[precise] (timing) 0inputs+16424outputs (0major+4468032minor)pagefaults 0swaps
[precise-testing] Starting tests...
Found a test script: ./checkbox-gui/requirements/container-tests-checkbox-gui-build
[precise-testing] container-tests-checkbox-gui-build: [32;1mPASS[39;0m
[precise-testing] (timing) 32.24user 2.34system 0:35.51elapsed 97%CPU (0avgtext+0avgdata 116152maxresident)k
[precise-testing] (timing) 0inputs+4216outputs (0major+477948minor)pagefaults 0swaps
Found a test script: ./checkbox-ng/requirements/container-tests-checkbox-ng-unit
[precise-testing] container-tests-checkbox-ng-unit: [32;1mPASS[39;0m
[precise-testing] (timing) 0.53user 0.16system 0:00.72elapsed 96%CPU (0avgtext+0avgdata 39880maxresident)k
[precise-testing] (timing) 0inputs+3456outputs (0major+20651minor)pagefaults 0swaps
Found a test script: ./checkbox-support/requirements/container-tests-checkbox-support
[precise-testing] container-tests-checkbox-support: [32;1mPASS[39;0m
[precise-testing] (timing) 17.20user 0.17system 0:17.50elapsed 99%CPU (0avgtext+0avgdata 82796maxresident)k
[precise-testing] (timing) 0inputs+1032outputs (0major+31438minor)pagefaults 0swaps
Found a test script: ./checkbox-touch/requirements/container-tests-touch-unit-tests
[precise-testing] container-tests-touch-unit-tests: [32;1mPASS[39;0m
[precise-testing] (timing) 0.00user 0.01system 0:00.02elapsed 46%CPU (0avgtext+0avgdata 2016maxresident)k
[precise-testing] (timing) 0inputs+8outputs (0major+2344minor)pagefaults 0swaps
Found a test script: ./plainbox/plainbox/impl/providers/categories/requirements/container-tests-provider-categories
[precise-testing] container-tests-provider-categories: [32;1mPASS[39;0m
[precise-testing] (timing) 0.15user 0.04system 0:00.21elapsed 93%CPU (0avgtext+0avgdata 13500maxresident)k
[precise-testing] (timing) 0inputs+176outputs (0major+5872minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/001-container-tests-plainbox-egg-info
[precise-testing] 001-container-tests-plainbox-egg-info: [32;1mPASS[39;0m
[precise-testing] (timing) 0.15user 0.04system 0:00.21elapsed 93%CPU (0avgtext+0avgdata 10508maxresident)k
[precise-testing] (timing) 0inputs+88outputs (0major+4980minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/container-tests-plainbox
[precise-testing] container-tests-plainbox: [31;1mFAIL[39;0m
[precise-testing] stdout: http://paste.ubuntu.com/9817163/
[precise-testing] stderr: http://paste.ubuntu.com/9817164/
[precise-testing] (timing) Command exited with non-zero status 1
[precise-testing] (timing) 6.26user 0.32system 0:06.72elapsed 97%CPU (0avgtext+0avgdata 67528maxresident)k
[precise-testing] (timing) 0inputs+2808outputs (0major+53912minor)pagefaults 0swaps
Found ...

The attempt to merge lp:~zkrynicki/checkbox/stubbox-outcome into lp:checkbox failed. Below is the output from the failed tests.

[precise] starting container
[precise] (timing) 0.06user 0.00system 0:04.19elapsed 1%CPU (0avgtext+0avgdata 7868maxresident)k
[precise] (timing) 0inputs+32outputs (0major+5777minor)pagefaults 0swaps
[precise] provisioning container
[precise] (timing) 41.11user 10.90system 1:23.10elapsed 62%CPU (0avgtext+0avgdata 51688maxresident)k
[precise] (timing) 0inputs+16424outputs (0major+4468032minor)pagefaults 0swaps
[precise-testing] Starting tests...
Found a test script: ./checkbox-gui/requirements/container-tests-checkbox-gui-build
[precise-testing] container-tests-checkbox-gui-build: [32;1mPASS[39;0m
[precise-testing] (timing) 32.24user 2.34system 0:35.51elapsed 97%CPU (0avgtext+0avgdata 116152maxresident)k
[precise-testing] (timing) 0inputs+4216outputs (0major+477948minor)pagefaults 0swaps
Found a test script: ./checkbox-ng/requirements/container-tests-checkbox-ng-unit
[precise-testing] container-tests-checkbox-ng-unit: [32;1mPASS[39;0m
[precise-testing] (timing) 0.53user 0.16system 0:00.72elapsed 96%CPU (0avgtext+0avgdata 39880maxresident)k
[precise-testing] (timing) 0inputs+3456outputs (0major+20651minor)pagefaults 0swaps
Found a test script: ./checkbox-support/requirements/container-tests-checkbox-support
[precise-testing] container-tests-checkbox-support: [32;1mPASS[39;0m
[precise-testing] (timing) 17.20user 0.17system 0:17.50elapsed 99%CPU (0avgtext+0avgdata 82796maxresident)k
[precise-testing] (timing) 0inputs+1032outputs (0major+31438minor)pagefaults 0swaps
Found a test script: ./checkbox-touch/requirements/container-tests-touch-unit-tests
[precise-testing] container-tests-touch-unit-tests: [32;1mPASS[39;0m
[precise-testing] (timing) 0.00user 0.01system 0:00.02elapsed 46%CPU (0avgtext+0avgdata 2016maxresident)k
[precise-testing] (timing) 0inputs+8outputs (0major+2344minor)pagefaults 0swaps
Found a test script: ./plainbox/plainbox/impl/providers/categories/requirements/container-tests-provider-categories
[precise-testing] container-tests-provider-categories: [32;1mPASS[39;0m
[precise-testing] (timing) 0.15user 0.04system 0:00.21elapsed 93%CPU (0avgtext+0avgdata 13500maxresident)k
[precise-testing] (timing) 0inputs+176outputs (0major+5872minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/001-container-tests-plainbox-egg-info
[precise-testing] 001-container-tests-plainbox-egg-info: [32;1mPASS[39;0m
[precise-testing] (timing) 0.15user 0.04system 0:00.21elapsed 93%CPU (0avgtext+0avgdata 10508maxresident)k
[precise-testing] (timing) 0inputs+88outputs (0major+4980minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/container-tests-plainbox
[precise-testing] container-tests-plainbox: [31;1mFAIL[39;0m
[precise-testing] stdout: http://paste.ubuntu.com/9817163/
[precise-testing] stderr: http://paste.ubuntu.com/9817164/
[precise-testing] (timing) Command exited with non-zero status 1
[precise-testing] (timing) 6.26user 0.32system 0:06.72elapsed 97%CPU (0avgtext+0avgdata 67528maxresident)k
[precise-testing] (timing) 0inputs+2808outputs (0major+53912minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/container-tests-plainbox-documentation
[precise-testing] container-tests-plainbox-documentation: [32;1mPASS[39;0m
[precise-testing] (timing) 23.20user 0.46system 0:24.24elapsed 97%CPU (0avgtext+0avgdata 93512maxresident)k
[precise-testing] (timing) 0inputs+29632outputs (0major+35634minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/container-tests-plainbox-integration
[precise-testing] container-tests-plainbox-integration: [31;1mFAIL[39;0m
[precise-testing] stdout: 
[precise-testing] stderr: http://paste.ubuntu.com/9817166/
[precise-testing] (timing) Command exited with non-zero status 1
[precise-testing] (timing) 0.32user 0.08system 0:00.42elapsed 94%CPU (0avgtext+0avgdata 22140maxresident)k
[precise-testing] (timing) 0inputs+16outputs (0major+15481minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-certification-client/requirements/container-tests-provider-certification-client
[precise-testing] container-tests-provider-certification-client: [32;1mPASS[39;0m
[precise-testing] (timing) 0.40user 0.04system 0:00.45elapsed 96%CPU (0avgtext+0avgdata 14892maxresident)k
[precise-testing] (timing) 0inputs+8outputs (0major+6207minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-certification-server/requirements/container-tests-provider-certification-server
[precise-testing] container-tests-provider-certification-server: [32;1mPASS[39;0m
[precise-testing] (timing) 0.17user 0.03system 0:00.22elapsed 93%CPU (0avgtext+0avgdata 13496maxresident)k
[precise-testing] (timing) 0inputs+8outputs (0major+5858minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-checkbox/requirements/container-tests-provider-checkbox
[precise-testing] container-tests-provider-checkbox: [32;1mPASS[39;0m
[precise-testing] (timing) 0.66user 0.05system 0:00.73elapsed 97%CPU (0avgtext+0avgdata 20276maxresident)k
[precise-testing] (timing) 0inputs+8outputs (0major+7656minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-resource-generic/requirements/container-tests-provider-resource-generic
[precise-testing] container-tests-provider-resource-generic: [32;1mPASS[39;0m
[precise-testing] (timing) 0.19user 0.02system 0:00.23elapsed 93%CPU (0avgtext+0avgdata 14832maxresident)k
[precise-testing] (timing) 0inputs+8outputs (0major+6205minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-ubuntu-touch/requirements/container-tests-provider-certification-touch
[precise-testing] container-tests-provider-certification-touch: [32;1mPASS[39;0m
[precise-testing] (timing) 0.48user 0.06system 0:00.55elapsed 97%CPU (0avgtext+0avgdata 17292maxresident)k
[precise-testing] (timing) 0inputs+8outputs (0major+6866minor)pagefaults 0swaps
[precise-testing] Destroying container
[trusty] starting container
[trusty] (timing) 0.07user 0.01system 0:05.23elapsed 1%CPU (0avgtext+0avgdata 7868maxresident)k
[trusty] (timing) 0inputs+32outputs (0major+6102minor)pagefaults 0swaps
[trusty] provisioning container
[trusty] (timing) 52.08user 13.00system 1:29.73elapsed 72%CPU (0avgtext+0avgdata 52416maxresident)k
[trusty] (timing) 0inputs+480outputs (0major+5007851minor)pagefaults 0swaps
[trusty-testing] Starting tests...
Found a test script: ./checkbox-gui/requirements/container-tests-checkbox-gui-build
[trusty-testing] container-tests-checkbox-gui-build: [32;1mPASS[39;0m
[trusty-testing] (timing) 40.19user 2.60system 0:43.31elapsed 98%CPU (0avgtext+0avgdata 127752maxresident)k
[trusty-testing] (timing) 0inputs+5176outputs (0major+503509minor)pagefaults 0swaps
Found a test script: ./checkbox-ng/requirements/container-tests-checkbox-ng-unit
[trusty-testing] container-tests-checkbox-ng-unit: [32;1mPASS[39;0m
[trusty-testing] (timing) 0.65user 0.09system 0:00.76elapsed 98%CPU (0avgtext+0avgdata 25724maxresident)k
[trusty-testing] (timing) 0inputs+2768outputs (0major+19134minor)pagefaults 0swaps
Found a test script: ./checkbox-support/requirements/container-tests-checkbox-support
[trusty-testing] container-tests-checkbox-support: [32;1mPASS[39;0m
[trusty-testing] (timing) 19.38user 0.15system 0:19.62elapsed 99%CPU (0avgtext+0avgdata 62504maxresident)k
[trusty-testing] (timing) 0inputs+864outputs (0major+24385minor)pagefaults 0swaps
Found a test script: ./checkbox-touch/requirements/container-tests-touch-unit-tests
[trusty-testing] container-tests-touch-unit-tests: [32;1mPASS[39;0m
[trusty-testing] (timing) 0.44user 0.09system 0:00.65elapsed 82%CPU (0avgtext+0avgdata 27772maxresident)k
[trusty-testing] (timing) 0inputs+8outputs (0major+19090minor)pagefaults 0swaps
Found a test script: ./plainbox/plainbox/impl/providers/categories/requirements/container-tests-provider-categories
[trusty-testing] container-tests-provider-categories: [32;1mPASS[39;0m
[trusty-testing] (timing) 0.20user 0.03system 0:00.24elapsed 95%CPU (0avgtext+0avgdata 10852maxresident)k
[trusty-testing] (timing) 0inputs+136outputs (0major+5325minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/001-container-tests-plainbox-egg-info
[trusty-testing] 001-container-tests-plainbox-egg-info: [32;1mPASS[39;0m
[trusty-testing] (timing) 0.30user 0.02system 0:00.33elapsed 96%CPU (0avgtext+0avgdata 12084maxresident)k
[trusty-testing] (timing) 0inputs+88outputs (0major+7741minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/container-tests-plainbox
[trusty-testing] container-tests-plainbox: [32;1mPASS[39;0m
[trusty-testing] (timing) 13.06user 0.36system 0:15.66elapsed 85%CPU (0avgtext+0avgdata 36736maxresident)k
[trusty-testing] (timing) 0inputs+2248outputs (0major+61428minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/container-tests-plainbox-documentation
[trusty-testing] container-tests-plainbox-documentation: [32;1mPASS[39;0m
[trusty-testing] (timing) 19.03user 0.28system 0:20.23elapsed 95%CPU (0avgtext+0avgdata 56064maxresident)k
[trusty-testing] (timing) 0inputs+27016outputs (0major+21758minor)pagefaults 0swaps
Found a test script: ./plainbox/requirements/container-tests-plainbox-integration
[trusty-testing] container-tests-plainbox-integration: [32;1mPASS[39;0m
[trusty-testing] (timing) 0.51user 0.09system 0:00.64elapsed 93%CPU (0avgtext+0avgdata 17260maxresident)k
[trusty-testing] (timing) 0inputs+8outputs (0major+16194minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-certification-client/requirements/container-tests-provider-certification-client
[trusty-testing] container-tests-provider-certification-client: [32;1mPASS[39;0m
[trusty-testing] (timing) 0.52user 0.02system 0:00.57elapsed 97%CPU (0avgtext+0avgdata 11676maxresident)k
[trusty-testing] (timing) 0inputs+8outputs (0major+5395minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-certification-server/requirements/container-tests-provider-certification-server
[trusty-testing] container-tests-provider-certification-server: [32;1mPASS[39;0m
[trusty-testing] (timing) 0.24user 0.03system 0:00.29elapsed 93%CPU (0avgtext+0avgdata 10880maxresident)k
[trusty-testing] (timing) 0inputs+8outputs (0major+5211minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-checkbox/requirements/container-tests-provider-checkbox
[trusty-testing] container-tests-provider-checkbox: [32;1mPASS[39;0m
[trusty-testing] (timing) 1.00user 0.04system 0:01.07elapsed 98%CPU (0avgtext+0avgdata 13784maxresident)k
[trusty-testing] (timing) 0inputs+8outputs (0major+5968minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-resource-generic/requirements/container-tests-provider-resource-generic
[trusty-testing] container-tests-provider-resource-generic: [32;1mPASS[39;0m
[trusty-testing] (timing) 0.23user 0.02system 0:00.27elapsed 94%CPU (0avgtext+0avgdata 11716maxresident)k
[trusty-testing] (timing) 0inputs+8outputs (0major+5370minor)pagefaults 0swaps
Found a test script: ./providers/plainbox-provider-ubuntu-touch/requirements/container-tests-provider-certification-touch
[trusty-testing] container-tests-provider-certification-touch: [32;1mPASS[39;0m
[trusty-testing] (timing) 0.79user 0.04system 0:00.85elapsed 98%CPU (0avgtext+0avgdata 12600maxresident)k
[trusty-testing] (timing) 0inputs+8outputs (0major+5610minor)pagefaults 0swaps
[trusty-testing] Destroying container

You are trying to send an empty document, exiting.
precise-testing doesn't exist
trusty-testing doesn't exist

Reply

Revision history for this message

Zygmunt Krynicki (zyga) wrote on 2015-01-22:

#

Ah, apparently not that soon. Well, ok.

On Thu, Jan 22, 2015 at 11:14 AM, Daniel Manrique
<email address hidden> wrote:
> The proposal to merge lp:~zkrynicki/checkbox/stubbox-outcome into lp:checkbox has been updated.
>
> Status: Approved => Needs review
>
> For more details, see:
> https://code.launchpad.net/~zkrynicki/checkbox/stubbox-outcome/+merge/243809
> --
> You are the owner of lp:~zkrynicki/checkbox/stubbox-outcome.

Reply

Unmerged revisions

3479. By Zygmunt Krynicki on 2014-12-05

plainbox:providers:stubbox: add outcome/* family of jobs

This patch adds a number of new stubbox jobs, one for each possible
test outcome. They can be easily started together to see how plainbox,
or another application, handles various outcome values.

Signed-off-by: Zygmunt Krynicki <email address hidden>

3478. By Zygmunt Krynicki on 2014-12-05

plainbox:providers:stubbox: add outcome-representative category

This patch adds a new stubbox category for test that are representative
for each possible test outcome.

Signed-off-by: Zygmunt Krynicki <email address hidden>

Checkbox

Merge lp://staging/~zyga/checkbox/stubbox-outcome into lp://staging/checkbox

Commit message

Description of the change

Unmerged revisions

Preview Diff

Subscribers