test: fix spread.yaml multipass backend
Metadata
Current evaluation
Merged fix for the spread.yaml multipass backend that prevented automatic image upgrades, forcing it to use only explicitly requested task.yaml images. Approved by reviewers and passed CI.
Suggested action: —
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/canonical/snapcraft/blob/main/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] Have you successfully run `make lint`?
- [x] Have you successfully run `make test`?
---
The multipass backend had a switch that would cause it to pull a newer image than desired. This PR forces it to only use the image explicitly requested by task.yaml files. Tested locally, works for selecting both 22.04 and 24.04 images with spread.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged fix for the spread.yaml multipass backend that prevented automatic image upgrades, forcing it to use only explicitly requested task.yaml images. Approved by reviewers and passed CI. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged a fix for the spread.yaml multipass backend that incorrectly pulled newer images. The change forces the backend to use only explicitly requested images from task.yaml files, verified for 22.04 and 24.04. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged fix for the spread.yaml multipass backend that incorrectly pulled newer images. The change forces the backend to use only images explicitly specified in task.yaml files, verified with 22.04 and 24.04 targets. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #4571 test: fix spread multipass backend | snapcraft | merged | Merged fix for the spread multipass backend to use SSH passwords with newer sshd versions and enable multiple workers. Approved by two reviewers, passed CI checks, and maintained 88.33% test coverage. | |
| #723 fix(testing): more intelligent test handling | craft-application | merged | Merged after approval. Updates test handling to run spread tests as root and strictly parse top-level spread.yaml keys. Approved by two reviewers and passed CI checks before integration. | |
| #1029 fix(testing): error early if spread.yaml is invalid. | craft-application | merged | Merged after two approvals. Adds early validation to fail tests immediately if spread.yaml is invalid. CI passed except for an unrelated snap-test failure, which was overridden. | |
| #2979 tests: add multipass adhoc spread backend | snapcraft | merged | Merged addition of a multipass adhoc spread backend to streamline local container and snap testing. Approved by a reviewer, passed CI, and updated one file with 38 lines of test configuration. | |
| #3966 Spread multipass tests | snapcraft | merged | Merged a minor refactor moving manual multipass tests out of the legacy directory. An unrelated spread test failure was noted and resolved by a separate pull request. | |
| #3662 tests: update spread url | snapcraft | merged | Merged update to spread tarball URLs in test files. Approved by a reviewer, passed CI checks, modified two files with minimal changes, and maintained existing code coverage. | |
| #534 test(spread): workaround for flaky test | fetch-service | merged | Merged a workaround for a flaky spread test (issue #533). The change adjusts one file (+2/-1 lines) to skip a no-op name query check while retaining other validations. Approved by two reviewers and passed all CI checks. | |
| #3663 tests: update spread url | snapcraft | merged | Merged following reviewer approval and passing CI. Updated spread tarball URLs in test configuration files, modifying two files with minimal changes. | |
| #565 feat(testing): process simplified spread.yaml | craft-application | merged | Merged to resolve issue #560. Processes a user-supplied simplified spread.yaml into a complete project file for the spread testing framework. Approved by two reviewers, passed CI, and modified 11 files. | |
| #712 fix(TestingService): provide a better error if spread.yaml is missing | craft-application | merged | Merged update that improves error messaging when spread.yaml is missing in the TestingService. Approved by two reviewers, passed CI checks, and includes a changelog entry. Resolves #703. |