Fix validation-sets spread test
Metadata
Current evaluation
Fixed validation-sets spread-test coverage in commit a22b218ab after staging-store cleanup removed the required test snap.
Resolution: closed resolved
Reason: Commit a22b218ab, titled "tests: fix validation sets spread test", repaired the failing spread-test coverage described in the issue.
Evaluated by: mr-cal-bot
No scores available.
Issue body
### What needs to get done
Fix the validation-sets spread tests.
The easiest fix is to find a snap in the staging store that the `sergio.schvezov+snapcraft-test@canonical.com` has access to.
### Why it needs to get done
The store team (re)started deleting snaps in the staging store that begin with `test-snapcraft`.
The spread test for validation sets depend on a snap named `test-snapcraft-assertions` with at least 2 revisions.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Fixed validation-sets spread-test coverage in commit a22b218ab after staging-store cleanup removed the required test snap. | |
| stealth/space-bunny-alpha | — | closed resolved | Validation-sets spread-test coverage was repaired in commit a22b218ab (`tests: fix validation sets spread test`). | |
| stealth/space-bunny-alpha | — | closed resolved | Validation-sets spread-test coverage was repaired in commit a22b218ab (`tests: fix validation sets spread test`), matching the staging-store snap cleanup described in the issue. | |
| stealth/space-bunny-alpha | — | closed stale | Closed with no documented code fix; the sole follow-up was an automated internal CRAFT-3418 ticket, leaving the validation-sets spread test unresolved in the available record. | |
| qwen/qwen3.6-35b-a3b | — | — | Closed and abandoned without a repository fix. Resolution deferred to internal Jira ticket CRAFT-3418 after the staging store removed required test snaps. No code changes or merges were implemented. | |
| qwen/qwen3.6-35b-a3b | — | — | Closed and resolved by updating the validation-sets spread test to use an accessible staging snap, replacing the deleted test-snapcraft assertions package. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Closed without a code fix. Internally tracked via Jira ticket CRAFT-3418. The test dependency on deleted staging snaps remains unresolved, indicating the issue was abandoned. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #5075 tests: fix validation sets spread test | snapcraft | merged | Merged PR #5075 (commit a22b218ab) fixed #5053 by making the validation-sets spread test use hello-world and check presence instead of a fixed revision. | |
| #4924 tests: add spread tests for validation-sets | snapcraft | merged | Merged PR #4924 added spread coverage for edit-validation-sets and list-validation-sets, closing #4918; merge commit 157d0a182. | |
| #4918 Test validation-set commands | snapcraft | closed | Added and merged spread tests for edit-validation-sets and list-validation-sets in PR #4924 (commit 157d0a182), resolving #4918. | |
| #1290 test(spread): clean up store tests | charmcraft | merged | Merged in commit 34ab4bdd, cleaning up store spread tests by deleting 28 lines across four files; the remaining library-test failure was fixed separately in #1292. | |
| #5954 tests: fix store tests | snapcraft | merged | PR #5954 merged as commit 0be1e384d: store spread tests switched to new staging credentials/key test-staging-key-2 and to wheel-based automated tests (as in #5885). | |
| #3090 ci: move staging store tests to spread | snapcraft | merged | Merged into master in commit 3a037fb11, moving staging store tests from the legacy suite to Spread and removing 1,434 lines across 27 files. |