ci: split spread tests by system
Metadata
Current evaluation
Merged after two approvals. The update splits spread test jobs by system, auto-generating system lists to reduce flaky test re-runs. Three files changed with 34 additions and 5 deletions.
Suggested action: —
No scores available.
Issue body
This sets up the spread test jobs to split the tests by system. It automatically generates the list of systems based on the spread file in order to reduce re-runs for flaky tests.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged after two approvals. The update splits spread test jobs by system, auto-generating system lists to reduce flaky test re-runs. Three files changed with 34 additions and 5 deletions. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged CI changes that split spread test jobs by system. The update auto-generates the system list from the spread configuration to reduce flaky test re-runs. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged changes splitting spread test jobs by system. The update automatically generates the system list from the spread file to reduce re-runs for flaky tests. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1464 ci: split spread tests by system | charmcraft | closed | Merged after approval to split spread tests by system, reducing repetition and failure rates. The change modified two files with a minimal diff. | |
| #1513 ci: split spread tests | charmcraft | closed | Closed after splitting spread tests into smaller groups to enable targeted CI re-runs on failure. | |
| #519 spread: reorganize spread tests | rockcraft | merged | Merged via squash-merge. Reorganizes spread tests to optimize CI resource usage by consolidating most tests into a jammy-based rockcraft suite and adding a foreign suite for cross-system testing. Changes affect 73 files. | |
| #1287 tests: minor cleanups on the spread tests | snapcraft | merged | Merged minor spread test cleanups into master. Modified four files with 16 additions and 6 deletions. Approved by one reviewer with zero unresolved comments, maintaining 95.27% coverage upon integration. | |
| #1366 tests(spread): make release test less flaky | charmcraft | merged | Merged changes that reduce flakiness in the spread release test, resolving issue #1362. Approved by two reviewers, the update modifies one file (+17/-7) after addressing feedback. | |
| #926 test: address a couple of non-flaky spread failures | rockcraft | merged | Merged after two approvals and passing all CI checks. Resolves non-flaky spread test failures by updating test configurations across three files, eliminating consistent failures. | |
| #573 ci: run spread tests on 'spread-installed' runners | rockcraft | merged | Merged a two-file, four-line CI configuration change to run spread tests on spread-installed runners. Approved by three reviewers and integrated. | |
| #6202 test(spread): create core26 spread test suite | snapcraft | merged | Merged the core26 spread test suite, adding CI jobs and generalizing tests for core22, 24, and 26 across 419 files. Approved by two reviewers and passed most CI checks prior to integration. | |
| #4529 Spread update | snapcraft | merged | Merged after approval by two reviewers and passing CI checks. The update modifies spread configuration across three files, adding 36 and removing 40 lines. Code coverage tests passed. | |
| #127 Fix spread tests | imagecraft | merged | Merged after receiving approval from two reviewers and passing all CI checks. The changes fix spread tests across 11 files (+49/-38 lines). |