tests: disable `build-base: devel` spread tests
Metadata
Current evaluation
Merged PR (commit 8aa87427a) temporarily disabling `build-base: devel` spread tests to unblock CI while 24.04/24.10 systemd-resolved failures were debugged; fixes #4910, re-enabled later by #5297.
Resolution: closed resolved
Reason: PR #4922 was merged (commit 8aa87427a, CRAFT-3105) and closed issue #4910 by commenting out the `build-base: devel` spread tests pending investigation of #4921's 24.10 buildd/systemd-resolved failures. The tests were re-enabled later by merged PR #5297 (commit 65a6004f5), which closed #4921.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] Have you successfully run `tox run -m lint`?
- [x] Have you successfully run `tox run -e test-py310`? (supported versions: `py39`, `py310`, `py311`, `py312`)
-----
Disable `build-base: devel` spread tests until we have the resources to debug the underlying issue with 24.10 buildd images and `systemd-resolved` (#4921).
We should be able to address this issue in 2024-Nov.
Fixes #4910
(CRAFT-3105)
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR (commit 8aa87427a) temporarily disabling `build-base: devel` spread tests to unblock CI while 24.04/24.10 systemd-resolved failures were debugged; fixes #4910, re-enabled later by #5297. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged #4922, temporarily disabling devel spread tests due to 24.10/systemd-resolved failures; it fixed #4910, and #5297 later re-enabled the tests and closed #4921. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged a change to temporarily disable build-base: devel spread tests, bypassing failures caused by 24.10 buildd images and systemd-resolved. The fix addresses issue #4910 and will be revisited once debugging resources are available. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged PR disabling build-base: devel spread tests to bypass failures caused by 24.10 buildd image and systemd-resolved issues. Resolves #4910. Tests will be re-enabled once debugging resources are available. |
Update history
No update history recorded yet.
Related work
-
Superseded By:
canonical/snapcraft#5297
(confidence 95%)
Commit 65a6004f5 re-enabled and simplified the devel spread tests once the underlying issue was addressed.
-
Duplicate Of:
canonical/snapcraft#4921
(confidence 85%)
Underlying 24.10 buildd/systemd-resolved spread test failure the temporary disablement was working around; closed by #5297.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #4910 Disable `build-base: devel` and `build-base: ubuntu@24.10` tests until 2024-Nov-04 | snapcraft | closed | Oracular devel build-base tests were disabled by merged PR #4922 (8aa87427a) to bypass systemd-resolved CI failures; they were later re-enabled by #5297. | |
| #826 test(spread): re-enable devel base tests | rockcraft | merged | Merged PR #826 as commit cfccef4d, re-enabling devel build-base spread tests after the udev problem was fixed in Ubuntu 25.04. | |
| #729 Re-enable devel tests | craft-providers | closed | Re-enabled devel-base tests in commit b6fa577 after upstream systemd-resolved issues were resolved; linked to PR #5297. | |
| #5297 test: re-enable devel spread tests | snapcraft | merged | Merged in #5297 (commit 65a6004f5), re-enabling and simplifying devel spread tests, adding a second test, and resolving #4921. | |
| #1197 ci: temporarily disable externally broken spread tests | charmcraft | merged | Merged PR #1197 as commit 4b34df89, temporarily disabling spread tests broken by third-party dependency issues; re-enablement is tracked in #1193. | |
| #4921 `build-base: devel` fails due to `systemd-resolved` issue in Ubuntu 24.10 | snapcraft | closed | Corrected Ubuntu images restored build-base: devel; PR #5297 (65a6004f5) re-enabled devel spread tests and resolved the regression. | |
| #249 fix(test): build on devel, which can be any base | imagecraft | merged | Merged PR #249 in commit 9cb4ff8, switching test builds from Ubuntu 24.04 to devel so the base check is skipped and any base can be tested. | |
| #599 tests: disable 24.10 integration tests | craft-providers | merged | PR #599 was merged, disabling Ubuntu 24.10 integration tests due to #598 and fixing #593 with reusable fixturing for long-term failures. | |
| #1502 test(spread): disable centos spread test | charmcraft | merged | Merged PR #1502 as 5c33304d, disabling the CentOS Spread test; the identical change also landed in #1503 via ae4ee446. | |
| #4750 tests: drop `grade: devel` from core24 spread tests | snapcraft | merged | Merged in commit 500872360 via #4750, removing grade: devel from unrelated core24 spread tests while adding dedicated grade coverage. |