test(spread): test on more bases
Metadata
Current evaluation
Merged after passing CI checks and approvals. Updates spread tests to run across multiple Ubuntu bases using an external Python runtime snap, enabling early detection of base-specific bugs and serving as a prerequisite for ROCKCRAFT-255.
Suggested action: —
No scores available.
Issue body
- [x] Have you followed the guidelines for contributing?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] Have you successfully run `make lint && make test`?
- [x] Have you added an entry to the changelog (`docs/reference/changelog.rst`)?
---
This uses an (external) Python runtime snap I built for the testcraft snap, fixing the base
dependency we had and allowing us to run the spread tests on multiple bases. This should help us find any base-specific bugs as early as possible.
Prerequisite for ROCKCRAFT-255
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged after passing CI checks and approvals. Updates spread tests to run across multiple Ubuntu bases using an external Python runtime snap, enabling early detection of base-specific bugs and serving as a prerequisite for ROCKCRAFT-255. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. Integrated an external Python runtime snap to resolve a base dependency, enabling spread tests to run across multiple bases. This change facilitates early detection of base-specific bugs and fulfills a prerequisite for ROCKCRAFT-255. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #5845 test(spread): test building base and snapd snaps | snapcraft | merged | Merged spread tests for building base and snapd snaps. Despite initial CI failures linked to snapcraft issue #5843, the changes were approved and integrated to maintain build compatibility with mainline snapcraft. | |
| #2525 test(spread): enable Ubuntu 25.10 and 26.04 spread runners | charmcraft | merged | Merged after two approvals. Enables Ubuntu 25.10 and 26.04 spread runners, fixing issue #2480. Updates one file (+10/-9 lines). CI passed for relevant targets; legacy test failures and type-check warnings were non-blocking. | |
| #3020 spread tests: default base for local plugin tests | snapcraft | merged | Merged updates to spread tests establishing a default base for local plugin tests. The change follows a prior commit pattern, adding two lines across two files. Approved by one reviewer and passed CI checks. | |
| #1304 test(spread): fix cross-test contamination | rockcraft | merged | Merged fix for spread test cross-contamination. Resolved by copying a clean rockcraft.yaml template at test start to isolate variants. Approved by two reviewers and passed CI checks. | |
| #519 spread: reorganize spread tests | rockcraft | merged | Merged via squash-merge. Reorganizes spread tests to optimize CI resource usage by consolidating most tests into a jammy-based rockcraft suite and adding a foreign suite for cross-system testing. Changes affect 73 files. | |
| #109 tests: spread tests fail intermittently | rockcraft | open | Rockcraft spread tests intermittently fail because the docker snap daemon never starts in test VMs, and the retry loop is insufficient. Feb 2026 triage confirmed the same pattern is still in spread.yaml; a fix (diagnostics on failure) is suggested but no PR proposed. | |
| #5389 test(spread): trace logs in spread tests | snapcraft | merged | Merged after approval. Added trace logging to spread tests. Despite CI failures from extra snapcraft output, the change was approved and merged following a related feature branch integration to prevent conflicts. | |
| #100 tests: print rockcraft log files on spread failure | rockcraft | merged | Merged: adds 11 lines to print rockcraft log files during spread test failures, improving debugging visibility. Approved by one reviewer and passed CI checks. | |
| #6202 test(spread): create core26 spread test suite | snapcraft | merged | Merged the core26 spread test suite, adding CI jobs and generalizing tests for core22, 24, and 26 across 419 files. Approved by two reviewers and passed most CI checks prior to integration. | |
| #826 test(spread): re-enable devel base tests | rockcraft | merged | Merged after two approvals and passing CI. Re-enabled build-base devel spread tests following a udev fix in 25.04. Updated test configuration in two files to restore automated testing. |