spread: reorganize spread tests
Metadata
Current evaluation
Merged via squash-merge. Reorganizes spread tests to optimize CI resource usage by consolidating most tests into a jammy-based rockcraft suite and adding a foreign suite for cross-system testing. Changes affect 73 files.
Suggested action: —
No scores available.
Issue body
Reorganize the spread tests to make better use of CI resources (Google VMs). The majority of the tests work the same regardless of host system, so it's a waste to run them on jammy _and_ focal _and_ fedora. Instead, bump the number of jammy machines and have them run the majority of the tests (renamed from `general` to `rockcraft`), and add a new suite `foreign` where we can add tests that are explicitly designed to test cross-system support.
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged via squash-merge. Reorganizes spread tests to optimize CI resource usage by consolidating most tests into a jammy-based rockcraft suite and adding a foreign suite for cross-system testing. Changes affect 73 files. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Squash-merged after reorganizing spread tests to optimize CI resources. Most tests moved to jammy (renamed to rockcraft), with a new foreign suite added for cross-system testing. Merge requested to bypass unrelated 24.04 archive failures. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged via squash-merge to fix 24.04 archive CI failures. Reorganizes spread tests to optimize CI by consolidating general tests on jammy (renamed to rockcraft) and adding a foreign suite for cross-system validation. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #6408 Re-organize spread tests | snapcraft | open | Enhancement to reorganize spread test directories, deduplicate tests, and remove unnecessary spread tests for faster CI. Triaged by maintainer, 8 days old. | |
| #1325 test(spread): consolidate basic init/build tests | charmcraft | merged | Merged after approval by two reviewers. Consolidates basic init and build spread tests across four files, reducing 80 lines and adding 28. Resolves CRAFT-2127. | |
| #13 test(spread): add more spread tests | snapcraft-rocks | merged | Successfully merged spread tests covering architectures, chisel slices, craftctl, package-repositories, and patchelf. Approved by two reviewers across 15 files (+206/-5 lines). | |
| #1304 test(spread): fix cross-test contamination | rockcraft | merged | Merged fix for spread test cross-contamination. Resolved by copying a clean rockcraft.yaml template at test start to isolate variants. Approved by two reviewers and passed CI checks. | |
| #100 tests: print rockcraft log files on spread failure | rockcraft | merged | Merged: adds 11 lines to print rockcraft log files during spread test failures, improving debugging visibility. Approved by one reviewer and passed CI checks. | |
| #62 spread: add a "big" spread test | rockcraft | merged | Merged a reusable spread test framework to house multiple checks without repeated setup. The initial test validates bug #44 regarding directory permissions. Approved by one reviewer and passed CI checks. | |
| #1464 ci: split spread tests by system | charmcraft | closed | Merged after approval to split spread tests by system, reducing repetition and failure rates. The change modified two files with a minimal diff. | |
| #2276 spread: move legacy wiki tests to spread | snapcraft | merged | Merged following reviewer approval and passing CI. Relocated legacy wiki tests from integration tests to spread, updating 12 files with a net reduction of 42 lines. Addresses LP: #1792717. | |
| #2301 ci: split spread tests by system | charmcraft | merged | Merged after two approvals. The update splits spread test jobs by system, auto-generating system lists to reduce flaky test re-runs. Three files changed with 34 additions and 5 deletions. | |
| #3662 tests: update spread url | snapcraft | merged | Merged update to spread tarball URLs in test files. Approved by a reviewer, passed CI checks, modified two files with minimal changes, and maintained existing code coverage. |