tests(spread): add remote-build spread test
Metadata
Current evaluation
Merged changes adding spread tests for new and legacy remote-build, resolving issue #4398. Approved by two reviewers with passing CI checks.
Suggested action: —
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] Have you successfully run `make lint`?
- [x] Have you successfully run `pytest tests/unit`?
-----
Test the new and legacy remote-build in the weekly spread test.
See a successful workflow job [here](https://github.com/snapcore/snapcraft/actions/runs/6711140620/job/18238067023)
Fixes #4398
(CRAFT-2095)
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged changes adding spread tests for new and legacy remote-build, resolving issue #4398. Approved by two reviewers with passing CI checks. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged into main. Adds spread tests for new and legacy remote-build, fixing #4398. CI validated the changes despite a minor coverage drop. Maintainer advised force-pushing if store tests fail, but the PR was successfully integrated. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged into main. Adds spread tests for new and legacy remote-build workflows, resolving issue #4398. The change enables weekly test coverage for remote builds, with a minor coverage decrease noted during the merge process. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #4398 Add spread test for remote-build | snapcraft | closed | Adding a spread test for remote-build was abandoned. Closed without implementation or discussion, no pull requests were opened, and the task remains unaddressed. | |
| #4767 tests: fix remote-build tests | snapcraft | merged | Merged fix for failing weekly remote-build tests. All tests pass except Fedora, which remains excluded due to unrelated spread configuration issues. Approved by two reviewers and passed CI checks. | |
| #1366 tests(spread): make release test less flaky | charmcraft | merged | Merged changes that reduce flakiness in the spread release test, resolving issue #1362. Approved by two reviewers, the update modifies one file (+17/-7) after addressing feedback. | |
| #13 test(spread): add more spread tests | snapcraft-rocks | merged | Successfully merged spread tests covering architectures, chisel slices, craftctl, package-repositories, and patchelf. Approved by two reviewers across 15 files (+206/-5 lines). | |
| #2216 spread tests: keep sources local | snapcraft | merged | Merged PR #2216 to replace remote FTP sources in spread tests with in-tree tar archives, preventing test failures from server downtime. Approved by one reviewer, passed CI checks, and slightly increased code coverage. | |
| #4924 tests: add spread tests for validation-sets | snapcraft | merged | Merged changes adding spread tests for edit-validation-sets and list-validation-sets. Approved by two reviewers with passing CI, resolving issue #4918. | |
| #2978 tests: add microk8s spread test | snapcraft | merged | Merged after single reviewer approval and passing CI. Adds a spread test to verify microk8s builds and installs correctly, deferring instrumentation to a future update. Changes affect 2 files (+35/-0 lines). | |
| #534 test(spread): workaround for flaky test | fetch-service | merged | Merged a workaround for a flaky spread test (issue #533). The change adjusts one file (+2/-1 lines) to skip a no-op name query check while retaining other validations. Approved by two reviewers and passed all CI checks. | |
| #3662 tests: update spread url | snapcraft | merged | Merged update to spread tarball URLs in test files. Approved by a reviewer, passed CI checks, modified two files with minimal changes, and maintained existing code coverage. | |
| #3432 spread tests: remove legacy plugin tests | snapcraft | merged | Merged removal of legacy plugin tests from the spread test suite. Deleted 665 lines across 29 files. Approved by reviewer, passed CI, and maintained coverage. Unrelated test failures were addressed in a separate PR. |