spread: reorganize spread tests
Metadata
Current evaluation
Merged PR #519 as commit 90d85343, consolidating most spread tests in the renamed rockcraft suite on Jammy VMs and adding a foreign suite for cross-system tests.
Resolution: closed resolved
Reason: The test reorganization was approved and squash-merged as commit 90d85343.
Evaluated by: mr-cal-bot
No scores available.
Issue body
Reorganize the spread tests to make better use of CI resources (Google VMs). The majority of the tests work the same regardless of host system, so it's a waste to run them on jammy _and_ focal _and_ fedora. Instead, bump the number of jammy machines and have them run the majority of the tests (renamed from `general` to `rockcraft`), and add a new suite `foreign` where we can add tests that are explicitly designed to test cross-system support.
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #519 as commit 90d85343, consolidating most spread tests in the renamed rockcraft suite on Jammy VMs and adding a foreign suite for cross-system tests. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged #519 as 90d85343: most spread tests now run in the renamed rockcraft suite on additional Jammy VMs, while a new foreign suite covers cross-system testing. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged via squash-merge. Reorganizes spread tests to optimize CI resource usage by consolidating most tests into a jammy-based rockcraft suite and adding a foreign suite for cross-system testing. Changes affect 73 files. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Squash-merged after reorganizing spread tests to optimize CI resources. Most tests moved to jammy (renamed to rockcraft), with a new foreign suite added for cross-system testing. Merge requested to bypass unrelated 24.04 archive failures. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1304 test(spread): fix cross-test contamination | rockcraft | merged | Merged PR #1304: spread variants shared the python-from-chisel-bare dir, causing cross-test contamination; each test now copies a clean rockcraft.yaml template in first (+6 lines, 2 files). | |
| #13 test(spread): add more spread tests | snapcraft-rocks | merged | Merged PR #13 added Spread tests for architectures, Chisel slices, craftctl, package repositories, and patchelf (+206/-5 across 15 files). | |
| #514 feat: increase spread workers | rockcraft | closed | PR to bump spread workers was closed unmerged by the author in favour of PR #519 ("spread: reorganize spread tests"), which merged as commit 90d85343 and distributed spread tests across Jammy VMs instead. | |
| #1325 test(spread): consolidate basic init/build tests | charmcraft | merged | Merged PR #1325 as commit 90e25caf, consolidating basic Spread init/build tests for CRAFT-2127 and reducing duplicated setup across four files. | |
| #2276 spread: move legacy wiki tests to spread | snapcraft | merged | Merged PR #2276 as commit 806b0b0db, moving all non-fake-server legacy wiki tests from the general integration suite to Spread. | |
| #1293 test: update 25.10 spread tests with --ignore=unmaintained | rockcraft | merged | Merged PR kept 25.10 coverage rather than deleting scenarios: added --ignore=unmaintained to run_rockcraft pack across spread tests (5577a19) and moved test_project_service_devel_bases base to ubuntu@26.04 (9e7f8c2). | |
| #100 tests: print rockcraft log files on spread failure | rockcraft | merged | Merged in commit 3a19387b: Spread failures now print the latest Rockcraft log for improved diagnostics. | |
| #291 Refactor spread testing to use spread extensions | fetch-service | closed | Fixed by merged PR #299 (commit 44d9906), which refactored spread tests to generate spread.yaml and use the new spread extension framework. | |
| #6202 test(spread): create core26 spread test suite | snapcraft | merged | Merged PR #6202 as a9a5b4750, adding core26 Spread tests and CI coverage while generalizing common tests for core22, core24, and core26. | |
| #3662 tests: update spread url | snapcraft | merged | Merged PR #3662 updated Spread tarball URLs in two test files via commit 507959d70. |