test(spread): workaround for flaky test
Metadata
Current evaluation
Merged PR #534 (commit 4f89bb7) worked around #533 by skipping the flaky snap names-query assertion while retaining the other spread-test checks.
Resolution: closed resolved
Reason: PR #534 was approved and merged as commit 4f89bb7, applying the documented workaround for flakiness reported in issue #533.
Evaluated by: mr-cal-bot
No scores available.
Issue body
This is a workaround for https://github.com/canonical/fetch-service/issues/533
We don't yet know why the test is flaky, but while the check for the name query is a no-op, we can do the rest of these checks.
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #534 (commit 4f89bb7) worked around #533 by skipping the flaky snap names-query assertion while retaining the other spread-test checks. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #534 (commit 4f89bb7) worked around fetch-service#533 by removing the unreliable snap names-query assertion from the spread test. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged a workaround for a flaky spread test (issue #533). The change adjusts one file (+2/-1 lines) to skip a no-op name query check while retaining other validations. Approved by two reviewers and passed all CI checks. |
Update history
| Date | Change |
|---|---|
| created |
Related work
-
Related To:
canonical/fetch-service#533
(confidence 100%)
This PR explicitly works around the snap inspector spread-test flakiness reported there.
-
Related To:
canonical/fetch-service#583
(confidence 90%)
Later merged PR #583 (47d8d04) removed the names-query verification and explicitly fixed #533.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #521 test(spread): add an improved snap inspector test | fetch-service | merged | Merged in PR #521 (commit 06cd210), adding a more realistic snapd setup to the spread snap inspector test and exposing additional snapd network requests. | |
| #1366 tests(spread): make release test less flaky | charmcraft | merged | Merged #1366 at commit 05b18a03, reducing flakiness in the Spread release test and resolving #1362. | |
| #926 test: address a couple of non-flaky spread failures | rockcraft | merged | Merged PR #926 updated three spread-test configuration files to address persistent failures; all CI checks passed and two reviewers approved. | |
| #533 Snap inspector spread test is flaky | fetch-service | closed | Flakiness was worked around in merged PR #534 (4f89bb7); PR #583 (47d8d04) then removed the names-query verification and explicitly fixed #533. | |
| #1600 test(spread): move flaky parallel-build test to weeklies | charmcraft | merged | Merged in commit a1d285c7, moving the flaky parallel-build Spread test from regular CI to weeklies as a workaround for #1332. | |
| #1272 tests: initial setup for the snapcraft snap tests with spread | snapcraft | merged | Merged PR #1272 as commit 545344442, adding initial Spread-based test infrastructure for the snapcraft snap. | |
| #240 tests: check for submodules before running spread | rockcraft | merged | Merged PR #240 as commit 3d940f71, adding a preflight check so spread tests report a clear error when the snapd-testing-tools submodule is missing. | |
| #3212 tests: expand spread coverage for stage-snaps | snapcraft | closed | Spread-test PR was closed unmerged in favor of snapcraft#3211, merged as 0870f1738 to fix stage-snaps handling for v2 plugins. | |
| #2937 spread tests: do not attempt to remove snapd snap | snapcraft | merged | Merged in commit b9290bb32; spread tests now skip removing the protected snapd snap, fixing LXD test failures. | |
| #432 ci: speed up spread testing workflow | fetch-service | merged | Merged PR #432 (commit 9eec284), removing snap-test's dependency on snap-build so spread tests start sooner while snap-build still produces downloadable artifacts. |