← Back to issue list

Re-organize spread tests

View original Github issue

Metadata

Project
snapcraft
Number
#6408
Type
issue
State
open
Author
mr-cal
Labels
Status: Triaged Type: Enhancement
Created
Updated
Closed
—

Current evaluation

Maintainer-filed, triaged enhancement to reorganize/dedupe Snapcraft's spread tests and drop low-value ones for faster, less flaky CI; no implementation plan or PR yet, tracked as SNAPCRAFT-1377.

Suggested action: keep open

Reason: Filed by maintainer mr-cal with labels 'Status: Triaged' and 'Type: Enhancement', plus a Jira ticket (SNAPCRAFT-1377) from syncronize-issues-to-jira, so it is a valid accepted work item that should stay open. However, the only description is a high-level goal ('Reorganize the spread test directories, deduplicate redundant tests, and remove tests that aren't worth running a full spread test for') with no concrete list of directories/tests or target layout, and history of tests/spread shows no reorganizing commit yet — so it needs an implementation plan before it can be acted on.

Evaluated by: mr-cal-bot

Impact: 45 Quick Win: 6 Complexity: 70 Confidence: 80 Actionability: 45

Issue body

### Check existing issues - [x] I've verified that this request isn't described by any existing issues. ### Request Reorganize the spread test directories, deduplicate redundant tests, and remove tests that aren't worth running a full spread test for. ### The problem it solves - Quicker CI runs - Less duplicated tests that run the same thing on different bases - Less chance of flaky failures - A filetree that's easier to navigate

Evaluation history

Date Model Scores Action Summary
stealth/space-bunny-alpha
Impact: 45
Quick Win: 6
Complexity: 70
Confidence: 80
Actionability: 45
keep open Maintainer-filed, triaged enhancement to reorganize/dedupe Snapcraft's spread tests and drop low-value ones for faster, less flaky CI; no implementation plan or PR yet, tracked as SNAPCRAFT-1377.
stealth/space-bunny-alpha
Impact: 42
Quick Win: 10
Complexity: 64
Confidence: 79
Actionability: 68
keep open Maintainer-triaged enhancement to reorganize and deduplicate Snapcraft spread tests, potentially removing low-value cases to shorten CI runs and reduce flaky failures. No implementation discussion yet.
qwen3.6-35b-a3b-mtp-q6
Impact: 65
Quick Win: 29
Staleness: 10
Complexity: 55
Confidence: 75
Support Request: 0
keep open Enhancement to reorganize spread test directories, deduplicate tests, and remove unnecessary spread tests for faster CI. Triaged by maintainer, 8 days old.
qwen/qwen3.8-27b
Impact: 35
Quick Win: 16
Staleness: 5
Complexity: 55
Confidence: 80
Support Request: 0
keep open Enhancement to reorganize snapcraft's spread test directories, deduplicate redundant tests, and drop low-value tests to speed up CI and reduce flakiness. Freshly filed by a maintainer, triaged, and tracked in internal ticket SNAPCRAFT-1377.

Update history

Date Change
created

Related work

  • Related To: rockcraft#519 (confidence 70%)

    Merged rockcraft PR titled 'spread: reorganize spread tests' (suite renamed plus new foreign suite) is the same effort done in a sibling craft project and serves as a direct precedent/template for how this Snapcraft issue could be implemented.

Related issues

Issue Project State Summary Similarity
#806 Use `snapcraft test` for spread tests craft-application open Maintainer dogfooding task: switch CI from invoking spread directly to `snapcraft test`. Triaged but unimplemented — .github/workflows/spread.yaml still calls `spread ${{ matrix.spread }}`; open PR #1038 attempts it with failing CI.
74%
#6009 test: remove core20 spread tests snapcraft merged Squash-merged PR #6009 as commit d0f1b4394, deleting core20 spread tests and migrating applicable ones to core22/core24 (+20 net tests). Unblocked core20 lifecycle removal for Snapcraft 9 (#5675).
73%
#1038 ci(spread): switch from manually running spread to using snapcraft test craft-application open Migrates dogfooding Spread runs to snapcraft test; after 197 days it remains unreviewed with seven CI failures, including all craft-test jobs and snap-tests.
73%
#2614 [WIP] travis-ci: split spread tests to reduce job times snapcraft closed Closed unmerged in favor of snapcraft#2615, which increased Spread worker parallelism and merged as commit 5c91f9681 to reduce job times.
72%
#6510 Spread tests should run review-tools on snaps snapcraft open Enhancement to run review-tools on all spread tests that build snaps, not just manifest tests. Triaged with a contributor interested in implementing.
72%
#202 Add snapcraft tests fetch-service open Snap package integration tests were added and CI now runs the Spread suite through snapcraft test, although the tracking issue remains open.
72%
#4937 [DRAFT] publish test snap for spread tests snapcraft closed Closed unmerged after its staging fixture was provisioned; mr-cal confirmed two revisions of test-snapcraft-assertions were created and released for spread tests.
72%
#1325 test(spread): consolidate basic init/build tests charmcraft merged Merged PR #1325 as commit 90e25caf, consolidating basic Spread init/build tests for CRAFT-2127 and reducing duplicated setup across four files.
71%
#3212 tests: expand spread coverage for stage-snaps snapcraft closed Spread-test PR was closed unmerged in favor of snapcraft#3211, merged as 0870f1738 to fix stage-snaps handling for v2 plugins.
71%
#5845 test(spread): test building base and snapd snaps snapcraft merged Merged as fb8c81e8f, adding manual Spread coverage that builds current base snaps and the snapd snap against mainline Snapcraft.
71%