Re-organize spread tests
Metadata
Current evaluation
Enhancement to reorganize spread test directories, deduplicate tests, and remove unnecessary spread tests for faster CI. Triaged by maintainer, 8 days old.
Suggested action: keep open
Reason: This is a triaged enhancement from a maintainer (mr-cal) requesting spread test reorganization. The sibling project rockcraft completed a similar reorganization in PR #519 (merged), providing a reference implementation. The issue is fresh (8 days old) and clearly scoped with specific goals: faster CI, less duplication, fewer flaky failures, and better filetree navigation.
Impact:
65
Quick Win:
29.25
Staleness:
10
Complexity:
55
Confidence:
75
Support Request:
0
Issue body
### Check existing issues
- [x] I've verified that this request isn't described by any existing issues.
### Request
Reorganize the spread test directories, deduplicate redundant tests, and remove tests that aren't worth running a full spread test for.
### The problem it solves
- Quicker CI runs
- Less duplicated tests that run the same thing on different bases
- Less chance of flaky failures
- A filetree that's easier to navigate
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen3.6-35b-a3b-mtp-q6 |
Impact:
65
Quick Win:
29.25
Staleness:
10
Complexity:
55
Confidence:
75
Support Request:
0
|
keep open | Enhancement to reorganize spread test directories, deduplicate tests, and remove unnecessary spread tests for faster CI. Triaged by maintainer, 8 days old. | |
| qwen/qwen3.8-27b |
Impact:
35
Quick Win:
15.75
Staleness:
5
Complexity:
55
Confidence:
80
Support Request:
0
|
keep open | Enhancement to reorganize snapcraft's spread test directories, deduplicate redundant tests, and drop low-value tests to speed up CI and reduce flakiness. Freshly filed by a maintainer, triaged, and tracked in internal ticket SNAPCRAFT-1377. |
Update history
| Date | Change |
|---|---|
| created |
Related work
-
Likely Fixed By:
rockcraft#519
(confidence 70%)
Rockcraft merged a similar spread test reorganization that consolidated tests and optimized CI. The snapcraft team may want to follow a similar approach or adapt rockcraft's changes.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #519 spread: reorganize spread tests | rockcraft | merged | Merged via squash-merge. Reorganizes spread tests to optimize CI resource usage by consolidating most tests into a jammy-based rockcraft suite and adding a foreign suite for cross-system testing. Changes affect 73 files. | |
| #3432 spread tests: remove legacy plugin tests | snapcraft | merged | Merged removal of legacy plugin tests from the spread test suite. Deleted 665 lines across 29 files. Approved by reviewer, passed CI, and maintained coverage. Unrelated test failures were addressed in a separate PR. | |
| #127 Fix spread tests | imagecraft | merged | Merged after receiving approval from two reviewers and passing all CI checks. The changes fix spread tests across 11 files (+49/-38 lines). | |
| #1287 tests: minor cleanups on the spread tests | snapcraft | merged | Merged minor spread test cleanups into master. Modified four files with 16 additions and 6 deletions. Approved by one reviewer with zero unresolved comments, maintaining 95.27% coverage upon integration. | |
| #2785 test(spread): fix different-dir task assertions | charmcraft | open | Fixes spread test assertions for different-dir tasks to match --project-dir artifact output locations. Small change (+6/-5, 2 files), CI passing, authored by maintainer, no review activity. | |
| #3662 tests: update spread url | snapcraft | merged | Merged update to spread tarball URLs in test files. Approved by a reviewer, passed CI checks, modified two files with minimal changes, and maintained existing code coverage. | |
| #13 test(spread): add more spread tests | snapcraft-rocks | merged | Successfully merged spread tests covering architectures, chisel slices, craftctl, package-repositories, and patchelf. Approved by two reviewers across 15 files (+206/-5 lines). | |
| #1325 test(spread): consolidate basic init/build tests | charmcraft | merged | Merged after approval by two reviewers. Consolidates basic init and build spread tests across four files, reducing 80 lines and adding 28. Resolves CRAFT-2127. | |
| #430 Improve integration tests | craft-providers | open | Enhancement proposal to restructure integration tests, either by migrating to spread or reorganizing existing tests to address disk space exhaustion on GitHub runners. | |
| #1290 test(spread): clean up store tests | charmcraft | merged | Merged cleanup of spread store tests, removing 28 lines across four files. The underlying library test failure is fixed in PR #1292. Approved by two reviewers. |