tests: fix remote-build tests
Metadata
Current evaluation
Merged fix for failing weekly remote-build tests. All tests pass except Fedora, which remains excluded due to unrelated spread configuration issues. Approved by two reviewers and passed CI checks.
Suggested action: —
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] Have you successfully run `tox run -m lint`?
- [x] Have you successfully run `tox run -e test-py310`? (supported versions: `py39`, `py310`, `py311`, `py312`)
-----
The weekly remote-build tests have been failing for a few months.
This fixes all remote-build tests except for the fedora remote-build test (which fails for an unrelated reason - none of our spread tests are set up to run on fedora).
See the weekly workflow jobs here: https://github.com/canonical/snapcraft/actions/runs/8882021542
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged fix for failing weekly remote-build tests. All tests pass except Fedora, which remains excluded due to unrelated spread configuration issues. Approved by two reviewers and passed CI checks. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to fix months of failing weekly remote-build tests. All pass except Fedora, which remains skipped due to unrelated spread configuration gaps. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to resolve failing weekly remote-build tests. The test suite now passes except for Fedora, which remains broken due to unrelated configuration gaps. CI stability restored. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #4433 tests(spread): add remote-build spread test | snapcraft | merged | Merged changes adding spread tests for new and legacy remote-build, resolving issue #4398. Approved by two reviewers with passing CI checks. | |
| #96 fix(test): fix spread tests on Fedora | snapcraft-rocks | merged | Merged a fix for Fedora spread tests by switching from the closed core18 docker branch to the default branch for Fedora 39. Approved by one reviewer with all CI checks passing. | |
| #97 fix(test): fix spread tests on Fedora | snapcraft-rocks | merged | Merged fix for spread tests on Fedora by switching from the closed core18 docker branch to the default branch for Fedora 39 compatibility. Approved by one reviewer with all CI checks passing. | |
| #95 fix(test): fix spread tests on Fedora | snapcraft-rocks | merged | Merged a fix for spread tests on Fedora 39 by switching from the closed core18 docker branch to the default branch. Approved and passed all CI checks. | |
| #1632 ci: move remote-build tests to weekly job | charmcraft | merged | Relocated remote-build tests to a weekly CI job. The change modifies two files, removing 32 lines and adding 7. Approved by two reviewers and successfully merged. | |
| #1600 test(spread): move flaky parallel-build test to weeklies | charmcraft | merged | Merged to address issue #1332 by relocating a flaky parallel-build test to the weekly suite. Approved by two reviewers, the change modifies two files (+19/-2) to stabilize CI runs. | |
| #4660 refactor(test): versioned remote-build tests | snapcraft | merged | Merged test refactoring for versioned remote-build tests with no logic changes. Approved by two reviewers, zero unresolved comments, and passing CI. Codecov confirmed full coverage on modified lines. Successfully integrated. | |
| #2216 spread tests: keep sources local | snapcraft | merged | Merged PR #2216 to replace remote FTP sources in spread tests with in-tree tar archives, preventing test failures from server downtime. Approved by one reviewer, passed CI checks, and slightly increased code coverage. | |
| #5715 test: update remote-build artifact name | snapcraft | merged | Merged after two reviewer approvals. Updates the expected filename for a remote-build spread test to fix a minor test mismatch. Passed all required CI checks and involved a single-line change. |