Store spread tests failing
Metadata
Current evaluation
The store spread-test authentication failure was confirmed fixed by maintainer @mr-cal on 7 May 2024; no resolving PR or commit was referenced.
Resolution: closed resolved
Reason: The issue was closed after maintainer @mr-cal confirmed on 2024-05-07 that it had been fixed. The issue history provides no linked code change or resolving PR.
Evaluated by: mr-cal-bot
No scores available.
Issue body
### Bug Description
The `candid` variant of the store spread test appears to be failing fairly reliably, possibly due to an expired token.
### To Reproduce
Run spread tests in CI. Example: https://github.com/snapcore/snapcraft/actions/runs/6576891941/job/17867595317?pr=4405
### Environment
GitHub CI
### snapcraft.yaml
```shell
N/A
```
### Relevant log output
```shell
2023-10-19 15:41:47 Error executing google:ubuntu-22.04-64:tests/spread/general/store:candid (oct191539-526036) :
-----
+ cd ../snaps/dump-hello
++ ls ./test-snapcraft-364352327_1.0_amd64.snap
+ snap_file=./test-snapcraft-364352327_1.0_amd64.snap
++ sed -e 's/name: \(.*$\)/\1/'
++ grep 'name: ' snap/snapcraft.yaml
+ snap_name=test-snapcraft-364352327
+ export SNAPCRAFT_STORE_AUTH=candid
+ SNAPCRAFT_STORE_AUTH=candid
+ snapcraft whoami
2023-10-19 15:41:46.414 Starting Snapcraft 7.5.3.post121+git320b5c6c
2023-10-19 15:41:46.414 Logging execution to '/root/.local/state/snapcraft/log/snapcraft-20231019-154146.413227.log'
2023-10-19 15:41:46.415 Storing credentials for 'snapcraft' on 'dashboard.staging.snapcraft.io' in keyring 'auth MemoryKeyring'.
2023-10-19 15:41:46.416 Retrieving credentials for 'snapcraft' on 'dashboard.staging.snapcraft.io' from keyring 'auth MemoryKeyring'.
2023-10-19 15:41:46.416 HTTP 'GET' for 'https://dashboard.staging.snapcraft.io/api/v2/tokens/whoami' with params None and headers ***'Authorization': '<macaroon>', 'User-Agent': 'snapcraft/7.5.3.post121+git320b5c6c ubuntu/22.04 (x86_64)'***
2023-10-19 15:41:47.011 craft-store error: Store operation failed:
- macaroon-authorization-required: Invalid or missing macaroon authentication
2023-10-19 15:41:47.011 Full execution log: '/root/.local/state/snapcraft/log/snapcraft-20231019-154146.413227.log'
-----
.
2023-10-19 15:41:47 Restoring google:ubuntu-22.04-64:tests/spread/general/store:candid (oct191539-526036)...
```
### Additional context
_No response_
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | The store spread-test authentication failure was confirmed fixed by maintainer @mr-cal on 7 May 2024; no resolving PR or commit was referenced. | |
| stealth/space-bunny-alpha | — | closed resolved | Candid store spread-test failures were confirmed fixed by maintainer @mr-cal on 7 May 2024; no resolving PR or commit was cited. | |
| stealth/space-bunny-alpha | — | closed resolved | Candid store spread-test authentication failures were confirmed fixed by @mr-cal on 7 May 2024; no resolving PR or commit was cited. | |
| stealth/space-bunny-alpha | — | closed resolved | Candid store spread-test failures were confirmed fixed by @mr-cal on 7 May 2024; no resolving PR or commit was cited. | |
| qwen/qwen3.6-35b-a3b | — | — | Store spread tests failed due to an expired macaroon authentication token. The issue was fixed and closed after a maintainer confirmed the resolution on May 7, 2024. | |
| qwen/qwen3.6-35b-a3b | — | — | Store spread tests failed due to an invalid macaroon authentication token. The issue was resolved and closed after a maintainer confirmed the authentication fix was applied on May 7, 2024. | |
| qwen/qwen3.6-35b-a3b | — | — | Store spread tests failed due to invalid macaroon authentication. The issue was closed after maintainer mr-cal confirmed the authentication token handling has been fixed. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Resolved the store spread test failure caused by an expired macaroon authentication token. The issue was closed after updating the credential handling to prevent invalid token errors. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #3089 ci: move staging store tests to spread | snapcraft | closed | Superseded by merged PR #3090, which moved staging store tests to Spread in commit 3a037fb11. | |
| #5954 tests: fix store tests | snapcraft | merged | PR #5954 merged as commit 0be1e384d: store spread tests switched to new staging credentials/key test-staging-key-2 and to wheel-based automated tests (as in #5885). | |
| #1460 fix(tests): make store spread tests less flaky | charmcraft | merged | Merged PR #1460 as fd5bd6ba, making store spread tests less timing-sensitive and fixing flaky upload/release checks in #1429. | |
| #1218 tests: store resources spread test is flaky | charmcraft | closed | Flaky store resources spread test was fixed by merged PR canonical/charmcraft#1223 in commit 35993996. | |
| #1290 test(spread): clean up store tests | charmcraft | merged | Merged in commit 34ab4bdd, cleaning up store spread tests by deleting 28 lines across four files; the remaining library-test failure was fixed separately in #1292. |