lp:~dbungert/curtin

Author: Dan Bungert
Author Date: 2023-10-05 23:51:04 UTC

install: do not log merged config

Author: Dan Bungert
Author Date: 2023-09-26 21:01:34 UTC

Revert "vmtests: add mantic after jammy"

This reverts commit abebab1e1e30a16d4be891a051060e81254ff0c5.

Author: Dan Bungert
Author Date: 2023-09-20 20:57:46 UTC

thoughts on devsync

Author: Dan Bungert
Author Date: 2023-09-19 19:01:20 UTC

vmtests: make loading error verbose

Author: Dan Bungert
Author Date: 2023-09-13 23:08:44 UTC

extract: log source information

If you try hard enough and follow mount commands backwards you can
surely get this same information, but when analyzing what the extract is
actually doing it's nice to just be able to see what the image stack is.

Author: Dan Bungert
Author Date: 2023-09-13 01:12:32 UTC

storage_config: handle partitions on 4k disk

In LP: #2035034, a user reported that the layout of existing
partitions was showing as 1/8th the correct size. Update storage_config
to no longer hard-code a 512 byte sector and read the value instead.

Author: Dan Bungert
Author Date: 2023-08-30 22:37:35 UTC

swap: add logging

The suggested swap size code just sort of returns 0 sometimes and
figuring out why is a complicated analysis of several variables.

Provide diagnostic info on those values, and the reason for the
decision.

Author: Dan Bungert
Author Date: 2023-08-30 22:37:35 UTC

swap: add logging

The suggested swap size code just sort of returns 0 sometimes and
figuring out why is a complicated analysis of several variables.

Provide diagnostic info on those values, and the reason for the
decision.

Author: Dan Bungert
Author Date: 2023-08-25 18:53:16 UTC

docs: link to sources.list manpage for apt deb822

Author: Dan Bungert
Author Date: 2023-08-24 17:41:02 UTC

zpool: allow selective default property override

zpool fs or pool properties may now use underlying fs defaults with
key: null.

Author: Dan Bungert
Author Date: 2023-08-23 20:45:50 UTC

zfs: only use default props if none are supplied

Author: Dan Bungert
Author Date: 2023-08-03 01:39:12 UTC

several: drop python3-mock

Author: Dan Bungert
Author Date: 2023-08-03 00:10:39 UTC

vmtest-system-setup: update for latest mantic

-pep8, not available
+parameterized, in use by tests

Author: Dan Bungert
Author Date: 2023-07-25 16:33:24 UTC

swap: support avail parameter

Add an avail parameter to allow swap size projections based on expected
available space. Add unit tests for existing and new (avail) usage.
Add docstring to `suggested_swapsize()`.

Author: Dan Bungert
Author Date: 2023-07-25 16:33:24 UTC

swap: support avail parameter

Add an avail parameter to allow swap size projections based on expected
available space. Add unit tests for existing and new (avail) usage.
Add docstring to `suggested_swapsize()`.

Author: Dan Bungert
Author Date: 2023-06-05 21:42:38 UTC

env hacks

Author: Dan Bungert
Author Date: 2023-05-25 20:23:30 UTC

several: fix lints

Author: Alexsander de Souza
Author Date: 2023-05-25 19:48:55 UTC

add python3-attr as dependency

(cherry picked from commit 1019040c497bdbf96613d7eb0dc682f92275d5b0)

Author: Alexsander de Souza
Author Date: 2023-05-25 19:48:55 UTC

add python3-attr as dependency

(cherry picked from commit 1019040c497bdbf96613d7eb0dc682f92275d5b0)

Author: Dan Bungert
Author Date: 2023-05-23 21:01:34 UTC

block: move ENXIO workaround up a level

Author: Dan Bungert
Author Date: 2023-05-19 18:53:00 UTC

block: only use no-tell-kernel if sfdisk supports

Author: Dan Bungert
Author Date: 2023-05-17 00:23:39 UTC

block: retry loop post dd image

On Bionic, I observed that the volume group present in the test image
would often not show up. This retry loop helps.

Author: Dan Bungert
Author Date: 2023-05-17 18:51:50 UTC

integration: fix tests with empty ptable

Older sfdisk seems to not like a completely empty ptable while setting
these attributes. Adding an unused partition is enough to allow
focusing on the task at hand.

Author: Dan Bungert
Author Date: 2023-05-17 18:51:50 UTC

integration: fix tests with empty ptable

Older sfdisk seems to not like a completely empty ptable while setting
these attributes. Adding an unused partition is enough to allow
focusing on the task at hand.

Author: Dan Bungert
Author Date: 2023-05-15 23:52:36 UTC

requirements: add missing content

Author: Dan Bungert
Author Date: 2023-05-19 18:53:00 UTC

block: only use no-tell-kernel if sfdisk supports

Author: Dan Bungert
Author Date: 2023-05-17 17:53:37 UTC

unittest: fix tests that scan log results

Author: Dan Bungert
Author Date: 2023-05-19 21:17:33 UTC

several: support older attrs version

Author: Dan Bungert
Author Date: 2023-04-18 14:31:48 UTC

block: ntfsresize with force options

To match Ubiquity behavior, we should run ntfsresize with the force
options and sending 'y\n' on input.

(cherry picked from commit 6caa799551b19dc85cb1e901e013b12be326aff1)

Author: Dan Bungert
Author Date: 2023-04-18 14:31:48 UTC

block: ntfsresize with force options

To match Ubiquity behavior, we should run ntfsresize with the force
options and sending 'y\n' on input.

Author: Dan Bungert
Author Date: 2023-02-07 17:56:37 UTC

.

Author: Dan Bungert
Author Date: 2023-02-07 01:40:09 UTC

integration: compare against sysfs results

Ignoring size on extended partitions, sysfs seems to match what sfdisk
is providing.

Author: Dan Bungert
Author Date: 2023-02-06 20:06:04 UTC

swap: clarify debug message

This log message is shown, among other scenarios, if a swap partition is
used, which is very confusing.
Clarify that we're talking about swap file.

Author: Dan Bungert
Author Date: 2023-01-28 00:36:24 UTC

dm_crypt preserve open

Author: Dan Bungert
Author Date: 2023-01-24 18:24:26 UTC

vmtests: drop python3-attr dep

Author: Dan Bungert
Author Date: 2023-01-24 17:07:35 UTC

block: remove fstrings

Author: Dan Bungert
Author Date: 2023-01-18 18:10:25 UTC

test

Author: Dan Bungert
Author Date: 2022-11-04 20:05:55 UTC

apt: clarify lineage of key file name

Author: Dan Bungert
Author Date: 2022-10-27 23:51:40 UTC

tests/apt: use tmpdir as target

This refactor helps make way for discontinuing usage of apt-key.
When trying to do it all at once, there were problems with the file path
that needed to be used for the key file.

The major change is that these tests are run with a tmpdir as the
target, instead of '/'. This is also independently a nice improvement,
since misbehaved tests or code would really try to write to the host
system.

The tests were written assuming apt key files would have full paths, but
the examples (and presumably most real-world usage) were based on
filenames, so move the tests to use file names.

Add back a full path test, since that is supported behavior today.

Also removes the unused _myjoin function.

Author: Dan Bungert
Author Date: 2022-10-14 19:02:28 UTC

kernel: expand flash_kernel env to cover all flows

While Subiquity should always be providing a metapackage name, expand
the environment adjustment for flash_kernel to handle the fallback
cases.

Author: Dan Bungert
Author Date: 2022-10-03 16:22:30 UTC

block/v2: fix wipe check for extended

As the comment in _wipe_for_action notes, we never want to wipe the
extended, so do that check first.

Author: Dan Bungert
Author Date: 2022-09-30 18:04:53 UTC

doc: clarify size units

Author: Dan Bungert
Author Date: 2022-09-28 22:43:13 UTC

many: fix several instances of whitespace lint

`tox -e tip-pycodestyle` reported several instances of:
  E275 missing whitespace after keyword

Author: Dan Bungert
Author Date: 2022-09-23 15:43:34 UTC

vmtests: +python3-attr

Author: Dan Bungert
Author Date: 2022-09-06 17:46:57 UTC

block: install cryptsetup if dm_crypt

Co-authored-by: J-P Nurmi <jp.nurmi@canonical.com>

Author: Dan Bungert
Author Date: 2022-08-30 16:55:17 UTC

curthooks: narrow the chzdev_export error skip

Author: Dan Bungert
Author Date: 2022-08-22 22:50:27 UTC

nicer terminology for non-API items

Author: Dan Bungert
Author Date: 2022-08-22 22:50:27 UTC

nicer terminology for non-API items

Author: Dan Bungert
Author Date: 2022-07-29 21:09:48 UTC

block: genericize kname generation

Author: Dan Bungert
Author Date: 2022-07-27 16:43:51 UTC

block_meta: fix for pmem kname lookup

Author: Dan Bungert
Author Date: 2022-07-12 17:34:15 UTC

block/v2: preserve last-lba,table-length

Author: Dan Bungert
Author Date: 2022-06-27 22:26:32 UTC

changelog: 22.1-0ubuntu1

Author: Dan Bungert
Author Date: 2022-06-22 22:40:06 UTC

version to 22.1

Author: Dan Bungert
Author Date: 2022-05-20 19:44:52 UTC

deb: fix dependencies

Required for bionic build, also more correct anyhow.

Author: Dan Bungert
Author Date: 2022-05-09 17:23:07 UTC

tox: drop xenial-py3 from default env list

Running xenial-era python packages against modern python is not likely
to be successful! If this is an interesting test then we should support
that all the way - with a matching python version and other
dependencies, or not at all.

Author: Olivier Gayot
Author Date: 2022-04-27 16:55:18 UTC

Make sure curthooks do not discard supplied proxy settings

Just like we witnessed for the APT preferences, the proxy settings are
not honored when Subiquity installs packages from the "packages"
autoinstall section. This also applies for unattended-upgrades.

This happened because the installation of packages and execution of
unattended-upgrades occur after running curthooks.
Curtooks call handle_apt with an almost empty configuration.

Therefore, we would discard the proxy settings by removing the
etc/apt/apt.conf.d/90curtin-aptproxy file.

Fixed by not removing etc/apt/preferences.d/90curtin.pref when the
configuration does not contain APT preferences.

Signed-off-by: Olivier Gayot <olivier.gayot@canonical.com>

Author: Dan Bungert
Author Date: 2022-05-03 13:57:32 UTC

test commit - CI should fail

Author: Dan Bungert
Author Date: 2022-04-29 23:00:48 UTC

block/v2: preserve disk label id

Windows will report a boot failure if the disk label ID changes and
nothing else.

Author: Dan Bungert
Author Date: 2022-04-27 20:48:58 UTC

block/v2: allow setting raw partition_type value

To preserve partition types that do not map to known flag values, we
must be able to capture that original type information and carry it
around in the storage config until used.

If we do not do this, preserved partitions get their type normalized to
another value (usually the equivalent of flags 'linux' or 'boot').

Author: Dan Bungert
Author Date: 2022-04-25 16:52:04 UTC

block/v2: resize-friendly ordering of wipe

Author: Dan Bungert
Author Date: 2022-04-26 17:36:35 UTC

change md path?

Author: Dan Bungert
Author Date: 2022-04-21 20:07:43 UTC

block/v2: combine needs and prepare resize

Author: Dan Bungert
Author Date: 2022-04-20 00:25:00 UTC

block/v2: resize of ntfs

Author: Dan Bungert
Author Date: 2022-04-26 15:08:33 UTC

vmtests: remove out of date skip

Author: Dan Bungert
Author Date: 2022-04-14 21:19:42 UTC

block: provide get_resize_fstypes

So callers can know which fs types we can and can't resize.

Author: Dan Bungert
Author Date: 2022-04-14 21:03:27 UTC

block-meta: remove extension of extended part size

In v1 action mode, the size of the extended partition is currently
extended by 1MiB to counter for the 1MiB gap in between logical
partiton. Remove that. Callers are expected to provide appropriate
sizing.

Author: Dan Bungert
Author Date: 2022-04-12 17:41:11 UTC

block-meta: resize and preserve correctness

Author: William Wilson
Author Date: 2022-03-14 22:49:52 UTC

Add riscv64 to supported UEFI architectures

As we prepare a RISC-V installer image, we need to add 'riscv64' to the
supported UEFI architectures. This commit does so by setting values
for grub_name and grub_target.

Author: Dan Bungert
Author Date: 2022-01-05 20:09:41 UTC

build-deb: change default to signed files

Author: Dan Bungert
Author Date: 2022-01-05 00:56:11 UTC

vmtests uefi: relax the uefi check

The addition of extra members of the efi dir is not a failure.
Relax this check to just a basic check that the efi dir is there.

Author: Dan Bungert
Author Date: 2022-01-04 20:47:35 UTC

distro: add rocklinux to distro list

While RockyLinux is not expected to be particularly better supported
than other headgear variants, adding it this way should resolve lookup
of the correct EFI directory.

Author: Dan Bungert
Author Date: 2021-12-08 00:11:04 UTC

block: output partition device path

Author: Dan Bungert
Author Date: 2021-12-06 21:35:03 UTC

version to 21.3

Author: Dan Bungert
Author Date: 2021-12-04 00:16:16 UTC

system-upgrade: lookup os family

`curtin system-upgrade` needs an osfamily lookup, as the command itself
neither takes an argument of the osfamily nor attempts to provide it.

Author: Dan Bungert
Author Date: 2021-12-01 20:11:32 UTC

distro: test for ID_LIKE

Author: Dan Bungert
Author Date: 2021-11-17 18:15:18 UTC

lsblk: adjust output to match old format

The version of lsblk in Jammy, utils-linux 2.37.2,
has a modified output format from what curtin is expecting.
Normalize that format to the older style.
This appears to be the root cause for install failures of u-d-i
as reported in
https://github.com/canonical/ubuntu-desktop-installer/issues/513

Author: Dan Bungert
Author Date: 2021-04-30 03:10:14 UTC

meta_simple: handle multiple disks in storage config with dd-image

When scanning storage config for the target device to use with dd-image
install stop after finding a disk matching serial and grub_device true.

(Thanks to Ryan Harper and Lee Trager for good discussions and fix
 proposals)

LP: #1925722

Author: Dan Bungert
Author Date: 2021-09-22 16:46:51 UTC

commands/apt: suites&components light refactoring

Author: Dan Bungert
Author Date: 2021-09-20 19:58:54 UTC

commands/apt: uri update simplification

Author: Dan Bungert
Author Date: 2021-09-08 22:55:55 UTC

tox: noproxy + sitepackages working

Adding sitepackages means that lookup of commands gets weird, but using
{envpython} -m foo solves that.
So we need two {envpythons}, one for noproxy, one for nose.

We could stuff that into the noproxy script but that would be unexpected
for a script that only adjusts the environment then execs the real
command.

Author: Dan Bungert
Author Date: 2021-09-03 22:20:26 UTC

vmtest-system-setup: fix python-apt selection

Author: Dan Bungert
Author Date: 2021-08-26 20:26:40 UTC

noproxy: remove

noproxy was used with tox to not pass in proxy values, but the way tox
works those variables aren't coming thru anyhow, and the presence of
noproxy is complicating other efforts. With noproxy not used in the
tox.ini, it's now redundant, so remove the script outright.

Author: Dan Bungert
Author Date: 2021-08-25 01:30:12 UTC

tox: drop py2, drop noproxy, python-apt from site

Author: Dan Bungert
Author Date: 2021-08-10 15:30:01 UTC

vmtests: disable those nvme ones on focal+

The nvme tests just added back fail on focal and newer.
This would be good to investigate as we start to look at the failing
curtin tests.

Author: Dan Bungert
Author Date: 2021-08-09 20:29:54 UTC

bin/curtin: update generator for recent changes

bin/curtin is a generated file, but has been edited directly recently.
Update the generator tools to match recent changes.

Author: Dan Bungert
Author Date: 2021-08-06 23:16:19 UTC

Refuse to remove the 'main' component

Author: Dan Bungert
Author Date: 2021-07-21 21:12:08 UTC

Extend the 'format' schema for unknown fstypes

Permit arbitrary fstype values if preserve == true
Goal here is to enumerate more filesystem formats, ones that blkid
recognizes, but not claim in any way that we can create them.
This is useful for presenting existing filesystem partitions to users
in an installer, as otherwise they just get unhelpfully marked as
'unknown'.

Author: Dan Bungert
Author Date: 2021-07-13 19:33:55 UTC

Allow PYTHON to be used to locate python

Author: Dan Bungert
Author Date: 2021-05-11 23:38:24 UTC

Ignore no-member false positive from pylint

pylint is, about 15% of the time, reporting a no-member error on users
of DISTROS. So we can disable that error in that case and get more
predictable behavior, but why is the error on 15% of the time?

Author: Dan Bungert
Author Date: 2021-04-29 23:37:52 UTC

Remove unused mock function

Author: Dan Bungert
Author Date: 2021-04-01 18:20:01 UTC

Updated policy: use /proc/filesystems to decide passno

The 'nodev' is intended to indicate
"whether the file system is mounted on a block device"
https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/4/html/reference_guide/s2-proc-filesystems

Use this info to set nodev items to passno 0, and default to 1 for
non-nodev or if the filesystem isn't present there.
Except that /proc/filesystems doesn't list 'swap' or 'none', so special
case those to passno 0.

Author: Dan Bungert
Author Date: 2021-03-17 21:24:03 UTC

Update schema for mount for passno/freq

Author: Paride Legovini
Author Date: 2021-01-27 20:47:05 UTC

releasing curtin version 21.2-0ubuntu1~16.04.1

Author: Paride Legovini
Author Date: 2021-01-27 20:39:57 UTC

releasing curtin version 21.2-0ubuntu1~18.04.1

Author: Paride Legovini
Author Date: 2021-01-27 20:26:44 UTC

releasing curtin version 21.2-0ubuntu1~20.04.1

Author: Paride Legovini
Author Date: 2020-09-25 20:46:55 UTC

releasing curtin version 20.2-0ubuntu1

Author: Ryan Harper
Author Date: 2020-02-14 15:44:17 UTC

releasing curtin version 19.3-26-g82f23e3d-0ubuntu1~19.10.1

Author: Dan Watkins
Author Date: 2019-09-10 21:57:21 UTC

Revert "d/control: update Depends for new probert package names"

This reverts commit 43c0a1474c4d32cebf0e940e555a7ac6851dbe9c.

(I incorrectly didn't fix the Depends during the preceding merge, but
its existence is still sufficient for this revert to not cause merge
conflicts into master.)

Author: Ryan Harper
Author Date: 2019-06-12 20:55:08 UTC

update changelog

Author: Dan Watkins
Author Date: 2019-05-21 21:03:54 UTC

release 19.1