← Back to issue list

ci: split spread tests by system

View original Github issue

Metadata

Project
charmcraft
Number
#1464
Type
pull request
State
closed
Author
lengau
Labels
Created
Updated
Closed

Current evaluation

Merged after approval to split spread tests by system, reducing repetition and failure rates. The change modified two files with a minimal diff.

Suggested action:

No scores available.

Issue body

Spread tests will fail sometimes due to things out of our control. Unfortunately, we can't re-run just the relevant spread tests. However, splitting by system will reduce the repetition in the tests.

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.6-35b-a3b Merged after approval to split spread tests by system, reducing repetition and failure rates. The change modified two files with a minimal diff.
qwen3.6-35b-a3b-mtp-q6 Closed. The change to split spread tests by system to reduce repetition and mitigate flaky failures was abandoned. No merge or rejection details were provided.
qwen3.6-35b-a3b-mtp-q6 Closed without merging. The proposal to split spread tests by system to reduce CI repetition was abandoned.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#2301 ci: split spread tests by system charmcraft merged Merged after two approvals. The update splits spread test jobs by system, auto-generating system lists to reduce flaky test re-runs. Three files changed with 34 additions and 5 deletions.
92%
#1513 ci: split spread tests charmcraft closed Closed after splitting spread tests into smaller groups to enable targeted CI re-runs on failure.
77%
#2379 test(spread): per-base destructive mode tests charmcraft merged Merged following approval by two reviewers. Added per-base destructive mode tests for spread and removed a redundant uv test. Changes were integrated despite mixed CI results.
74%
#1366 tests(spread): make release test less flaky charmcraft merged Merged changes that reduce flakiness in the spread release test, resolving issue #1362. Approved by two reviewers, the update modifies one file (+17/-7) after addressing feedback.
74%
#1287 tests: minor cleanups on the spread tests snapcraft merged Merged minor spread test cleanups into master. Modified four files with 16 additions and 6 deletions. Approved by one reviewer with zero unresolved comments, maintaining 95.27% coverage upon integration.
74%
#519 spread: reorganize spread tests rockcraft merged Merged via squash-merge. Reorganizes spread tests to optimize CI resource usage by consolidating most tests into a jammy-based rockcraft suite and adding a foreign suite for cross-system testing. Changes affect 73 files.
74%
#2401 ci: reduce spread system declarations snapcraft merged Merged a maintainer change that removed 35 lines from one CI configuration file to reduce spread system declarations. The update passed checks and was accepted without review comments.
74%
#127 Fix spread tests imagecraft merged Merged after receiving approval from two reviewers and passing all CI checks. The changes fix spread tests across 11 files (+49/-38 lines).
73%
#1503 test(spread): disable centos spread test charmcraft merged Merged to disable the CentOS spread test. Approved by two reviewers, the change modifies one file with three lines added and is now part of the main branch.
72%
#1502 test(spread): disable centos spread test charmcraft merged Merged a change disabling the CentOS spread test. The update modifies one file with three added lines, received approval from two reviewers, and was integrated without CI checks or comments.
72%