test(spread): test on more bases
Metadata
Current evaluation
Merged PR #943: added an external Python runtime for testcraft and expanded Spread tests across multiple snap bases to detect base-specific bugs earlier.
Resolution: closed resolved
Reason: PR #943 was merged after approval by two reviewers, with all reported CI checks passing. It fixed the runtime base dependency and enabled multi-base Spread testing.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you followed the guidelines for contributing?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] Have you successfully run `make lint && make test`?
- [x] Have you added an entry to the changelog (`docs/reference/changelog.rst`)?
---
This uses an (external) Python runtime snap I built for the testcraft snap, fixing the base
dependency we had and allowing us to run the spread tests on multiple bases. This should help us find any base-specific bugs as early as possible.
Prerequisite for ROCKCRAFT-255
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #943: added an external Python runtime for testcraft and expanded Spread tests across multiple snap bases to detect base-specific bugs earlier. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged #943 (commit cda97cd2), expanding spread tests across multiple Ubuntu bases with an external Python runtime snap to catch base-specific failures earlier. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged after passing CI checks and approvals. Updates spread tests to run across multiple Ubuntu bases using an external Python runtime snap, enabling early detection of base-specific bugs and serving as a prerequisite for ROCKCRAFT-255. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #5845 test(spread): test building base and snapd snaps | snapcraft | merged | Merged as fb8c81e8f, adding manual Spread coverage that builds current base snaps and the snapd snap against mainline Snapcraft. | |
| #1272 tests: initial setup for the snapcraft snap tests with spread | snapcraft | merged | Merged PR #1272 as commit 545344442, adding initial Spread-based test infrastructure for the snapcraft snap. | |
| #3212 tests: expand spread coverage for stage-snaps | snapcraft | closed | Spread-test PR was closed unmerged in favor of snapcraft#3211, merged as 0870f1738 to fix stage-snaps handling for v2 plugins. | |
| #386 tests: update testing to use craft-test | fetch-service | merged | Merged #386 as commit 323b0e1, replacing direct Spread calls with snapcraft test and updating the test base to core24. | |
| #2212 tests: add spread suite for ruby plugin | snapcraft | merged | Merged PR snapcore/snapcraft#2212 (commit b7729970a) adds a Spread suite for the Ruby plugin, replacing the Python/snapd integration test; closes LP #1783840. | |
| #13 test(spread): add more spread tests | snapcraft-rocks | merged | Merged PR #13 added Spread tests for architectures, Chisel slices, craftctl, package repositories, and patchelf (+206/-5 across 15 files). | |
| #1325 test(spread): consolidate basic init/build tests | charmcraft | merged | Merged PR #1325 as commit 90e25caf, consolidating basic Spread init/build tests for CRAFT-2127 and reducing duplicated setup across four files. | |
| #16 tests: add spread support | rockcraft | merged | Merged PR #16 added Spread support for CRAFT-865 via commit 3aeba2b3 (merge commit 5bf2680a). | |
| #944 test(spread): speed up the skip-retest spread test | craft-application | closed | PR #944 was closed unmerged and superseded by craft-application#964, which carried the spread-test speedup changes forward and merged the adjusted repack-test setup. | |
| #1304 test(spread): fix cross-test contamination | rockcraft | merged | Merged PR #1304: spread variants shared the python-from-chisel-bare dir, causing cross-test contamination; each test now copies a clean rockcraft.yaml template in first (+6 lines, 2 files). |