fix(tests): make store spread tests less flaky
Metadata
Current evaluation
Merged PR #1460 as fd5bd6ba, making store spread tests less timing-sensitive and fixing flaky upload/release checks in #1429.
Resolution: closed resolved
Reason: PR #1460 was approved and merged as commit fd5bd6ba. Its changes to two spread-test files reduced timing sensitivity when store processing was slow, resolving #1429.
Evaluated by: mr-cal-bot
No scores available.
Issue body
Fixes #1429
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #1460 as fd5bd6ba, making store spread tests less timing-sensitive and fixing flaky upload/release checks in #1429. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged charmcraft#1460 as fd5bd6ba, updating two store spread-test files (+7/-4) to reduce flaky upload/release failures and fix #1429. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged following approval by two reviewers and successful CI checks. The change resolves issue #1429 by adjusting two files to reduce flakiness in store spread tests, with a net diff of +7/-4 lines. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to resolve issue #1429 by stabilizing flaky store spread tests. The update adjusts test assertions and timing to prevent intermittent failures, ensuring consistent CI execution. |
Update history
No update history recorded yet.
Related work
-
Related To:
charmcraft#1429
(confidence 100%)
The flaky store upload and release test issue explicitly fixed by PR #1460.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #5954 tests: fix store tests | snapcraft | merged | PR #5954 merged as commit 0be1e384d: store spread tests switched to new staging credentials/key test-staging-key-2 and to wheel-based automated tests (as in #5885). | |
| #1366 tests(spread): make release test less flaky | charmcraft | merged | Merged #1366 at commit 05b18a03, reducing flakiness in the Spread release test and resolving #1362. | |
| #1429 spread: charm upload and release store test is flaky when the store is busy | charmcraft | closed | Fixed in merged PR #1460 (commit fd5bd6ba), which reduced timing sensitivity in store upload and release Spread tests. | |
| #1290 test(spread): clean up store tests | charmcraft | merged | Merged in commit 34ab4bdd, cleaning up store spread tests by deleting 28 lines across four files; the remaining library-test failure was fixed separately in #1292. | |
| #1223 tests: fix resource spread test | charmcraft | merged | Merged #1223 (commit 35993996), fixing the flaky store-resources spread test and advancing #1193; related store fixes landed in #1226 and #1234. | |
| #3089 ci: move staging store tests to spread | snapcraft | closed | Superseded by merged PR #3090, which moved staging store tests to Spread in commit 3a037fb11. | |
| #1095 Race condition in store spread tests | charmcraft | closed | Store spread-test race flakiness was fixed by commit af7f9b23; PR #1460 later reduced store-test timing sensitivity further in fd5bd6ba. | |
| #6350 test: fix spread tests | snapcraft | merged | Merged PR #6350 as a18c7f485, fixing all non-store Spread tests and OSV scanning, including pinning Black 26.3.1 to avoid patchelf failures. | |
| #1218 tests: store resources spread test is flaky | charmcraft | closed | Flaky store resources spread test was fixed by merged PR canonical/charmcraft#1223 in commit 35993996. | |
| #534 test(spread): workaround for flaky test | fetch-service | merged | Merged PR #534 (commit 4f89bb7) worked around #533 by skipping the flaky snap names-query assertion while retaining the other spread-test checks. |