Add a travis suite to run the staging store tests
Metadata
Current evaluation
Merged PR #602 via commit 1fafddaca, adding a Travis CI suite for staging-store tests; occasional registration races were accepted and reruns used.
Resolution: closed resolved
Reason: PR #602 was merged as commit 1fafddaca. The maintainer marked it good to go after accepting a rare staging registration race and validating it through repeated Travis runs.
Evaluated by: mr-cal-bot
No scores available.
Issue body
LP: #1596072
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #602 via commit 1fafddaca, adding a Travis CI suite for staging-store tests; occasional registration races were accepted and reruns used. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #602 (commit 1fafddaca) added a Travis CI suite running staging-store tests; flaky registration races with the rate-limited staging account were accepted and handled by rerunning. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #602 as commit 1fafddaca, adding a Travis CI suite for staging-store tests. Occasional registration races were accepted, with reruns used to recover. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged. Added Travis CI suite for staging store tests. Known race condition causes occasional registration failures, mitigated by retriggering. Rate limiting and test refactoring planned for production rollout. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged the Travis CI suite for staging store tests. A rare race condition causes occasional test failures, accepted as a known limitation pending future refactoring. Tests passed after retriggering and the branch was merged. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #601 Add a travis suite to run the staging store tests | snapcraft | closed | Closed unmerged by author after being opened on the wrong branch; the same change was redone as PR #602 on ubuntu-core and merged as commit 1fafddaca, adding the Travis staging-store test suite. | |
| #1596072 travis integration tests are not running against the staging store | snapcraft (launchpad) | closed | Added Travis CI coverage for staging-store integration tests via merged canonical/snapcraft#602 (commit 1fafddaca). | |
| #603 Run the travis tests on the ubuntu-core team against the staging store | snapcraft | closed | Closed unmerged as a temporary demonstration that #602 kept personal-branch tests on the fake store; the staging-store Travis suite was merged through #602 as 1fafddaca. | |
| #1318 tests: refactor the travis jobs using stages | snapcraft | merged | Merged PR #1318 (commit 59902915d) by come-maiz reorganized Travis CI jobs into stages, touching 7 files (+201/-40) to streamline the test pipeline; approved by 2 reviewers. | |
| #1164 tests: run the master tests against the staging server | snapcraft | merged | Merged in commit 8e6928371, configuring Travis CI to test master against staging while personal-fork PRs continue using fake servers. | |
| #5954 tests: fix store tests | snapcraft | merged | PR #5954 merged as commit 0be1e384d: store spread tests switched to new staging credentials/key test-staging-key-2 and to wheel-based automated tests (as in #5885). | |
| #3090 ci: move staging store tests to spread | snapcraft | merged | Merged into master in commit 3a037fb11, moving staging store tests from the legacy suite to Spread and removing 1,434 lines across 27 files. | |
| #2903 tests: fix status test for staging store | snapcraft | merged | Merged PR #2903 as commit 0f0492482, correcting the status test for the staging store. | |
| #3089 ci: move staging store tests to spread | snapcraft | closed | Superseded by merged PR #3090, which moved staging store tests to Spread in commit 3a037fb11. | |
| #802 Add the TEST_STORE environment variable to the travis script | snapcraft | merged | Merged PR #802 in commit 3a32f5937, adding TEST_STORE to Travis so Docker-based tests used the intended Snap Store configuration. |