launchpad-buildd

Merge lp://staging/~twom/launchpad-buildd/initial-docker-build-support into lp://staging/launchpad-buildd

initial-docker-build-support
Merge into trunk

Proposed by Tom Wardill on 2019-07-05

Status:	Merged
Merged at revision:	413
Proposed branch:	lp://staging/~twom/launchpad-buildd/initial-docker-build-support
Merge into:	lp://staging/launchpad-buildd
Diff against target:	1478 lines (+1200/-54) 14 files modified debian/changelog (+10/-4) lpbuildd/buildd-slave.tac (+2/-0) lpbuildd/oci.py (+222/-0) lpbuildd/snap.py (+32/-29) lpbuildd/target/build_oci.py (+126/-0) lpbuildd/target/build_snap.py (+7/-15) lpbuildd/target/cli.py (+2/-0) lpbuildd/target/lxd.py (+6/-2) lpbuildd/target/snapbuildproxy.py (+41/-0) lpbuildd/target/tests/test_build_oci.py (+407/-0) lpbuildd/target/tests/test_build_snap.py (+1/-1) lpbuildd/target/tests/test_lxd.py (+4/-3) lpbuildd/tests/oci_tarball.py (+60/-0) lpbuildd/tests/test_oci.py (+280/-0)
To merge this branch:	bzr merge lp://staging/~twom/launchpad-buildd/initial-docker-build-support
Related bugs:	Link a bug report

Reviewer	Date Requested	Status
Tom Wardill (community)		Approve on 2020-03-18
Colin Watson (community)	2019-07-05	Approve on 2020-02-26
Review via email: mp+369775@code.staging.launchpad.net

Commit message

Add initial docker build support

Description of the change

Add a builder for docker, creating an image following a supplied Dockerfile.
Save the image, extract it and then tar each component layer individually for returning/caching in launchpad.

Revision history for this message

Colin Watson (cjwatson) on 2019-07-09:

review: Needs Fixing

lp://staging/~twom/launchpad-buildd/initial-docker-build-support updated on 2020-01-30

393. By Tom Wardill on 2019-07-11: Use shell_escape, compress output images
394. By Tom Wardill on 2019-07-11: Collect .tar.gz
395. By Tom Wardill on 2019-07-12: Use a python script to save docker image to layers
396. By Tom Wardill on 2019-07-15: Move image extraction to gatherResults
397. By Tom Wardill on 2019-07-16: Refactor joint proxy handling
398. By Tom Wardill on 2019-07-16: Fix changelog diff noise
399. By Tom Wardill on 2019-07-24: Do more preprocessing, create digests file
400. By Tom Wardill on 2019-08-06: Include all diffs in digests and waiting files
401. By Tom Wardill on 2019-08-08: Add layer_id to digests now we're using every layer
402. By <email address hidden> on 2020-01-29: Use docker from apt, rather than from snap
403. By <email address hidden> on 2020-01-29: Rename Docker to OCI
404. By <email address hidden> on 2020-01-30: Merge upstream

Revision history for this message

Colin Watson (cjwatson) on 2020-02-03:

review: Approve

lp://staging/~twom/launchpad-buildd/initial-docker-build-support updated on 2020-02-06

405. By <email address hidden> on 2020-01-30: Remove conflict marker
406. By <email address hidden> on 2020-02-05: Use proxy, extract sha from right location
407. By <email address hidden> on 2020-02-05: Refactor proxy handling into better named mixin
408. By <email address hidden> on 2020-02-05: Refactor out adding docker proxy
409. By <email address hidden> on 2020-02-06: Include snap build proxy code
410. By <email address hidden> on 2020-02-06: Move to an on-the-fly tarball creation