Ubuntu Autopilot Tests

Merge lp://staging/~dpniel/ubuntu-autopilot-tests/test-runner into lp://staging/ubuntu-autopilot-tests

test-runner
Merge into trunk

Proposed by Dan Chapman  on 2014-02-15

Status:	Merged
Approved by:	Dan Chapman  on 2014-03-11
Approved revision:	70
Merged at revision:	64
Proposed branch:	lp://staging/~dpniel/ubuntu-autopilot-tests/test-runner
Merge into:	lp://staging/ubuntu-autopilot-tests
Diff against target:	1054 lines (+995/-0) 9 files modified README.md (+113/-0) desktop-autopilot-runner/config/testrunner.cfg (+35/-0) desktop-autopilot-runner/custom-installation/hooks/casper-bottom.sh (+30/-0) desktop-autopilot-runner/custom-installation/iso-override/etc/rsyslog.d/50-default.conf (+69/-0) desktop-autopilot-runner/custom-installation/iso-override/etc/xdg/autostart/autopilot.desktop (+9/-0) desktop-autopilot-runner/custom-installation/iso-override/etc/xdg/lxsession/Lubuntu/autostart (+1/-0) desktop-autopilot-runner/custom-installation/iso-override/usr/local/bin/run-autopilot.sh (+332/-0) desktop-autopilot-runner/run-autopilot-test (+392/-0) desktop-autopilot-runner/splitlogs.awk (+14/-0)
To merge this branch:	bzr merge lp://staging/~dpniel/ubuntu-autopilot-tests/test-runner
Related bugs:	Link a bug report

Reviewer	Review Type	Date Requested	Status
Nicholas Skaggs (community)		2014-02-15	Approve on 2014-03-10
Review via email: mp+206581@code.staging.launchpad.net

Description of the change

This MP adds a test runner to run the autopilot tests in a pristine environment. See the enclosed README for info on usage.

It work pretty much the same as the ubiquity runner and is just a modified copy of that runner

Revision history for this message

Nicholas Skaggs (nskaggs) wrote on 2014-02-18:

With this runner, we should be able to provide an easier workflow for running these tests in a similar environment as jenkins. This should help in reproducing issues. I suppose this could also be helpful in verifying tests work when run in a pristine environment; probably useful to verify before final merge.

Revision history for this message

Nicholas Skaggs (nskaggs) wrote on 2014-02-25:

I'm curious about desktop-autopilot-runner/custom-installation/iso-override/etc/apt/sources.list

deb http://archive.ubuntu.com/ubuntu/ trusty main restricted universe multiverse

We're pushing trusty in there; is there a more generic way to specify what we want? Going forward trusty isn't going to be it, and I don't want to push updates for something so trivial.

Revision history for this message

Nicholas Skaggs (nskaggs) wrote on 2014-02-25:

Looks good. I know jibel likes to push things into /tmp, so I suppose I'm ok with using /tmp to store the results. I personally don't like putting longterm things in there.

Overall, I approve, just have the one question above.

review: Needs Information

Revision history for this message

Dan Chapman  (dpniel) wrote on 2014-02-26:

It's easy enough to either re-write/update the sources.list file. I'll get that updated.

Where would you rather the artefacts ended up? as I want it to be more of a general purpose tool for running any autopilot test than the ubiquity runner currently is.

Revision history for this message

Nicholas Skaggs (nskaggs) wrote on 2014-02-27:

I would rather the results ended up in /home.. /home/autopilot-testrunner?

Revision history for this message

Dan Chapman  (dpniel) wrote on 2014-02-27:

Sounds good to me. I'll change that

Revision history for this message

Adam Smith (adam-disc0tech) wrote on 2014-03-02:

It would be great to be able run files from a local path instead of LP.

lp://staging/~dpniel/ubuntu-autopilot-tests/test-runner updated on 2014-03-04

67. By Dan Chapman  on 2014-03-04

Removed apt/sources.list and just add-apt-repo universe & multiverse instead

Artifacts are now stored in $HOME/ubuntu_autopilot.tests instead of /tmp

Updated README

Revision history for this message

Dan Chapman  (dpniel) wrote on 2014-03-04:

Ok so changes made.

1) Removed the hardcoded sources.list and now just enable repositories using add-apt-repository
2) Artefacts now stored in $HOME/ubuntu_autopilot.tests rather than temp directory
3) Updated README

@Adam From an MP review / Jenkins point of view pulling from bzr branches is ideal, so I don't want to make any changes in this branch. But i agree the ability to use local directories for developing tests would be a nice feature. Once this is merged if you could file a bug for a new feature that would be great :-)

lp://staging/~dpniel/ubuntu-autopilot-tests/test-runner updated on 2014-03-04

68. By Dan Chapman  on 2014-03-04: added retrieval of upstart logs for test artefacts
69. By Dan Chapman  on 2014-03-04: added partner repository
70. By Dan Chapman  on 2014-03-04: remove partner repo as it's archive.canonical.com and not archive.ubuntu.com