tests(spread): make release test less flaky
Metadata
Current evaluation
Merged #1366 at commit 05b18a03, reducing flakiness in the Spread release test and resolving #1362.
Resolution: closed resolved
Reason: PR #1366 was approved and merged as commit 05b18a03. Its change made the charm upload/release Spread test less timing-sensitive and explicitly targeted #1362.
Evaluated by: mr-cal-bot
No scores available.
Issue body
Fixes #1362
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged #1366 at commit 05b18a03, reducing flakiness in the Spread release test and resolving #1362. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged #1366 (commit 05b18a03) reduced spread release-test flakiness and fixed charmcraft#1362. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged changes that reduce flakiness in the spread release test, resolving issue #1362. Approved by two reviewers, the update modifies one file (+17/-7) after addressing feedback. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to stabilize flaky release tests in the spread suite, resolving issue #1362. The maintainer applied reviewer feedback to eliminate intermittent test failures. |
Update history
No update history recorded yet.
Related work
-
Related To:
canonical/charmcraft#1362
(confidence 100%)
The flakiness report directly addressed by this PR.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1460 fix(tests): make store spread tests less flaky | charmcraft | merged | Merged PR #1460 as fd5bd6ba, making store spread tests less timing-sensitive and fixing flaky upload/release checks in #1429. | |
| #1287 tests: minor cleanups on the spread tests | snapcraft | merged | Merged into master as commit 1cf0f8c9f "tests: minor cleanups on the spread tests (#1287)" — a test-only tidy-up touching 4 spread test files (+16/-6), reviewed and approved by fgimenez, with coverage unchanged at 95.27%. | |
| #1600 test(spread): move flaky parallel-build test to weeklies | charmcraft | merged | Merged in commit a1d285c7, moving the flaky parallel-build Spread test from regular CI to weeklies as a workaround for #1332. | |
| #534 test(spread): workaround for flaky test | fetch-service | merged | Merged PR #534 (commit 4f89bb7) worked around #533 by skipping the flaky snap names-query assertion while retaining the other spread-test checks. | |
| #1290 test(spread): clean up store tests | charmcraft | merged | Merged in commit 34ab4bdd, cleaning up store spread tests by deleting 28 lines across four files; the remaining library-test failure was fixed separately in #1292. | |
| #4433 tests(spread): add remote-build spread test | snapcraft | merged | Merged #4433 (commit 4a0a91117), adding weekly spread coverage for new and legacy remote-build implementations and resolving #4398. | |
| #2763 fix(tests/spread): fix reactive spread tests | charmcraft | merged | Merged #2763 as 6e775f4a: split reactive spread coverage by legacy/Resolute, enabled binary wheels, and removed obsolete build flags. | |
| #1325 test(spread): consolidate basic init/build tests | charmcraft | merged | Merged PR #1325 as commit 90e25caf, consolidating basic Spread init/build tests for CRAFT-2127 and reducing duplicated setup across four files. | |
| #3662 tests: update spread url | snapcraft | merged | Merged PR #3662 updated Spread tarball URLs in two test files via commit 507959d70. | |
| #926 test: address a couple of non-flaky spread failures | rockcraft | merged | Merged PR #926 updated three spread-test configuration files to address persistent failures; all CI checks passed and two reviewers approved. |