test(spread): test building base and snapd snaps
Metadata
Current evaluation
Merged spread tests for building base and snapd snaps. Despite initial CI failures linked to snapcraft issue #5843, the changes were approved and integrated to maintain build compatibility with mainline snapcraft.
Suggested action: —
No scores available.
Issue body
This adds spread tests that build the current base snaps and the snapd snap, ensuring that these snaps continue building with mainline snapcraft.
The tests are currently failing due to https://github.com/canonical/snapcraft/issues/5843, which has its own fix in the works, but enabling this is a distinct workset.
- [x] Have you followed the [guidelines for contributing](https://github.com/canonical/snapcraft/blob/main/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] Have you successfully run `make lint`?
- [x] Have you successfully run `make test`?
---
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged spread tests for building base and snapd snaps. Despite initial CI failures linked to snapcraft issue #5843, the changes were approved and integrated to maintain build compatibility with mainline snapcraft. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. Introduces spread tests for building base and snapd snaps. Tests are enabled despite initial failures from snapcraft issue #5843, creating a distinct workset for continuous validation. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. Adds spread tests to verify building base and snapd snaps with mainline snapcraft. Tests initially failed due to snapcraft issue #5843 but were integrated as a distinct workset. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1272 tests: initial setup for the snapcraft snap tests with spread | snapcraft | merged | Merged to master following single reviewer approval. Introduced initial spread test infrastructure for snapcraft across four files (+39 lines). Code coverage remained stable at 95.33%. | |
| #5389 test(spread): trace logs in spread tests | snapcraft | merged | Merged after approval. Added trace logging to spread tests. Despite CI failures from extra snapcraft output, the change was approved and merged following a related feature branch integration to prevent conflicts. | |
| #2793 tests: enable SNAPCRAFT_BUILD_INFO for spread | snapcraft | merged | Merged following approval and passing CI. Enabled SNAPCRAFT_BUILD_INFO for spread tests to cover manifest changes. Included a fix for the nil-basic spread test. Minimal diff across three files. | |
| #521 test(spread): add an improved snap inspector test | fetch-service | merged | Merged an improved snap inspector test that emulates system setup by stopping snapd, clearing device files, setting a global proxy, and restarting snapd to uncover network requests. Approved by two reviewers, passed all CI checks, and merged. | |
| #943 test(spread): test on more bases | craft-application | merged | Merged after passing CI checks and approvals. Updates spread tests to run across multiple Ubuntu bases using an external Python runtime snap, enabling early detection of base-specific bugs and serving as a prerequisite for ROCKCRAFT-255. | |
| #2987 spread tests: set appropriate default base in snapcraft.yamls | snapcraft | merged | Merged PR updating spread tests to automatically set appropriate default bases in snapcraft.yaml files. Adds a clear_base() helper for legacy tests and populates missing grade and confinement fields, enabling easy local test builds without manual edits. | |
| #3806 spread: add build packages to package repository tests | snapcraft | merged | Merged pull request adding spread tests to verify build packages install via snapcraft.yaml package repositories in destructive and build instance modes. Approved and merged with no coverage impact. | |
| #1038 ci(spread): switch from manually running spread to using snapcraft test | craft-application | open | CI config change to run spread tests via `snapcraft test` instead of manually. 165 days old, 0 reviews, CI failing on all craft-test jobs. Target file spread.yaml since deprecated in favor of <app-name>-test.yaml (#1168). | |
| #4755 tests: fix devel base snap test | snapcraft | merged | Merged a fix for the devel base snap test. The update ensures snapcraft correctly creates and utilizes the devel base. Approved by two reviewers, passed CI checks, and applied with a minimal one-file change. | |
| #1084 tests: check for submodules before running spread | charmcraft | merged | Merged changes verifying the snapd-testing-tools submodule before running Spread tests. Adds a clear error if missing. Approved by a reviewer, passed CI, and merged with minimal modifications. |