← Back to issue list

Snap inspector spread test is flaky

View original Github issue

Metadata

Project
fetch-service
Number
#533
Type
issue
State
closed
Author
lengau
Labels
Type: Bug Status: Triaged
Created
Updated
Closed

Current evaluation

Flakiness was worked around in merged PR #534 (4f89bb7); PR #583 (47d8d04) then removed the names-query verification and explicitly fixed #533.

Resolution: closed resolved

Reason: PR #534 merged commit 4f89bb7 to work around the flaky assertion. PR #583 later merged as 47d8d04, removing the unreliable names API verification and fixing #533.

Evaluated by: mr-cal-bot

No scores available.

Issue body

### Bug Description The [spread test for the snap inspector](https://github.com/canonical/fetch-service/blob/main/spread/inspectors/snap/task.yaml) is flaky, failing more often than not. The specific command that fails is: ``` jq -e -r '(.artifacts[] | select(.downloads[].url=="[https://api.snapcraft.io:443/api/v1/snaps/names?confinement=strict%2Cclassic](https://api.snapcraft.io/api/v1/snaps/names?confinement=strict%2Cclassic)")).metadata' session_report.json ``` ### To Reproduce `spread craft:ubuntu-24.04:spread/inspectors/snap` See: - https://github.com/canonical/fetch-service/actions/runs/19637058711/job/56235942873?pr=529 - ### Relevant log output ```shell https://pastebin.canonical.com/p/WRXt6wpyRM/ ```

Evaluation history

Date Model Scores Action Summary
stealth/space-bunny-alpha — closed resolved Flakiness was worked around in merged PR #534 (4f89bb7); PR #583 (47d8d04) then removed the names-query verification and explicitly fixed #533.
stealth/space-bunny-alpha — closed resolved Flakiness was addressed by merged PR #534 (commit 4f89bb7), which removed the unreliable no-op snap names-query assertion from the spread test.
qwen/qwen3.6-35b-a3b — — Closed without a documented fix. The flaky snap inspector spread test was reported but no resolution or merge was implemented. The issue appears abandoned or tracked internally via Jira.

Update history

Date Change
created

Related work

  • Likely Fixed By: canonical/fetch-service#583 (confidence 100%)

    Merged commit 47d8d04 removed the names API verification and explicitly fixed #533.

  • Likely Fixed By: canonical/fetch-service#534 (confidence 95%)

    Merged commit 4f89bb7 worked around the flaky Snap inspector spread test.

Related issues

Issue Project State Summary Similarity
#534 test(spread): workaround for flaky test fetch-service merged Merged PR #534 (commit 4f89bb7) worked around #533 by skipping the flaky snap names-query assertion while retaining the other spread-test checks.
78%