ci: split spread tests by system
Metadata
Current evaluation
Merged in charmcraft#2301 (commit eec7648d), splitting Spread tests into per-system matrix jobs and automatically deriving systems from the Spread configuration.
Resolution: closed resolved
Reason: PR #2301 was merged after approval, resolving the CI improvement in commit eec7648d.
Evaluated by: mr-cal-bot
No scores available.
Issue body
This sets up the spread test jobs to split the tests by system. It automatically generates the list of systems based on the spread file in order to reduce re-runs for flaky tests.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged in charmcraft#2301 (commit eec7648d), splitting Spread tests into per-system matrix jobs and automatically deriving systems from the Spread configuration. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #2301 split spread-test CI into an automatically generated per-system matrix, reducing reruns of flaky tests. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged in canonical/charmcraft#2301 as commit eec7648d, automatically splitting spread-test jobs by system to reduce reruns of flaky tests. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR canonical/charmcraft#2301 splits spread tests by system, auto-generating job lists from the spread file to reduce reruns caused by flaky tests. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged after two approvals. The update splits spread test jobs by system, auto-generating system lists to reduce flaky test re-runs. Three files changed with 34 additions and 5 deletions. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged CI changes that split spread test jobs by system. The update auto-generates the system list from the spread configuration to reduce flaky test re-runs. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1464 ci: split spread tests by system | charmcraft | closed | Spread test splitting from #1464 was later delivered by merged #2301 (eec7648d), adding per-system matrix jobs to reduce reruns of flaky tests. | |
| #1513 ci: split spread tests | charmcraft | closed | PR #1513 was closed unmerged; equivalent Spread-test splitting landed later in #2301 via commit eec7648d, adding per-system matrix jobs. | |
| #495 ci(spread): run spread on all systems | imagecraft | merged | Merged PR #495 as commit 4c5701d, replacing per-system spread matrix limits with backend-wide runs controlled by spread.yaml. | |
| #519 spread: reorganize spread tests | rockcraft | merged | Merged PR #519 as commit 90d85343, consolidating most spread tests in the renamed rockcraft suite on Jammy VMs and adding a foreign suite for cross-system tests. |