ci: split spread tests by system
Metadata
Current evaluation
Spread test splitting from #1464 was later delivered by merged #2301 (eec7648d), adding per-system matrix jobs to reduce reruns of flaky tests.
Resolution: closed superseded
Reason: The original closed PR was replaced by #2301, which merged the same CI improvement. Commit eec7648d split Spread tests into jobs by system.
Evaluated by: mr-cal-bot
No scores available.
Issue body
Spread tests will fail sometimes due to things out of our control. Unfortunately, we can't re-run just the relevant spread tests. However, splitting by system will reduce the repetition in the tests.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed superseded | Spread test splitting from #1464 was later delivered by merged #2301 (eec7648d), adding per-system matrix jobs to reduce reruns of flaky tests. | |
| stealth/space-bunny-alpha | — | closed superseded | Closed unmerged; the per-system Spread-test split was later merged in #2301 as eec7648d, superseding this PR. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged in canonical/charmcraft#2301 as eec7648d, splitting spread-test jobs by system to reduce repeated runs of flaky tests. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged after approval to split spread tests by system, reducing repetition and failure rates. The change modified two files with a minimal diff. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Closed. The change to split spread tests by system to reduce repetition and mitigate flaky failures was abandoned. No merge or rejection details were provided. |
Update history
No update history recorded yet.
Related work
-
Superseded By:
charmcraft#2301
(confidence 99%)
Merged replacement implementation, committed as eec7648d, introduced per-system Spread test matrix jobs.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1513 ci: split spread tests | charmcraft | closed | PR #1513 was closed unmerged; equivalent Spread-test splitting landed later in #2301 via commit eec7648d, adding per-system matrix jobs. | |
| #2301 ci: split spread tests by system | charmcraft | merged | Merged in charmcraft#2301 (commit eec7648d), splitting Spread tests into per-system matrix jobs and automatically deriving systems from the Spread configuration. | |
| #495 ci(spread): run spread on all systems | imagecraft | merged | Merged PR #495 as commit 4c5701d, replacing per-system spread matrix limits with backend-wide runs controlled by spread.yaml. | |
| #1169 ci: run snap spread tests in one job per system | craft-application | open | Splits the snap-tests CI job into a per-system spread matrix (new spread-select job runs `spread -list openstack:`) and scopes Ubuntu Pro to 24.04. Small workflow-only diff; zizmor fails and all snap-tests jobs are still pending. | |
| #490 ci(spread): run spread on all systems | imagecraft | closed | PR #490 was superseded by PR #495 (commit 4c5701d), which merged the same change to run spread tests on all systems per backend. |