tests: support running spread suite in autopkgtests
Metadata
Current evaluation
Merged. Adds an autopkgtest suite to run the spread test suite during releases. CI failures were resolved by fixing missing build dependencies and temporarily disabling armhf execution. Approved by one reviewer and merged.
Suggested action: —
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
The spread suite should run as part of the release process. Add an autopkgtest suite to run it.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged. Adds an autopkgtest suite to run the spread test suite during releases. CI failures were resolved by fixing missing build dependencies and temporarily disabling armhf execution. Approved by one reviewer and merged. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to run the spread suite via autopkgtests during releases. Resolved CI failures by adding missing build dependencies, including openssh-server for armhf, and temporarily disabling the suite on armhf to isolate architecture-specific issues before final merge. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged implementation adding autopkgtest support for the spread suite. Resolved armhf test failures by adding g++ and openssh-server dependencies, temporarily disabling the suite on that architecture. Successfully merged after passing on other architectures. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #3065 tests: fix local plugin spread test to be multi-arch aware | snapcraft | merged | Merged a fix updating the local plugin spread test for multi-architecture compatibility, enabling autopkgtests to pass on non-amd64 platforms. Approved by one reviewer, passed CI checks, and applied with minimal changes. | |
| #1630 tests: allow to select a suite when running autopkgtests | snapcraft | merged | Merged after approval and passing CI checks. Enables suite selection for autopkgtests to support PPA and Travis daily test integration. | |
| #2182 tests: add spread suite for autotools plugin | snapcraft | merged | Merged to master, consolidating Autotools plugin and snapd tests into a single Spread suite to resolve Launchpad bug #1783825. The commit modifies six files, reduces code by 16 lines, passed CI checks, and received reviewer approval prior to integration. | |
| #1716 tests: split the integration autopkgtests | snapcraft | merged | Merged after splitting integration autopkgtests to eliminate timeout failures. The change adds minor per-test setup overhead but resolves recurring execution timeouts. Approved by two reviewers with passing CI checks. | |
| #2978 tests: add microk8s spread test | snapcraft | merged | Merged after single reviewer approval and passing CI. Adds a spread test to verify microk8s builds and installs correctly, deferring instrumentation to a future update. Changes affect 2 files (+35/-0 lines). | |
| #2203 tests: add spread suite for kbuild plugin | snapcraft | merged | Merged following approval and passing CI. Resolves LP: #1783835 by migrating Kbuild plugin integration tests to a Spread suite across six files, increasing overall coverage by 0.02%. | |
| #4433 tests(spread): add remote-build spread test | snapcraft | merged | Merged changes adding spread tests for new and legacy remote-build, resolving issue #4398. Approved by two reviewers with passing CI checks. | |
| #1200 tests: allow to run individual autopkgtest suites | snapcraft | merged | Merged implementation enabling execution of individual autopkgtest suites. Resolves Launchpad bug #1673981. Updated one test file with 17 additions and 13 deletions to support selective suite execution. | |
| #2681 spread: fix unbound variable error | snapcraft | merged | Merged a fix for an unbound variable error in spread's autopkgtest. The set -u flag caused failures on unset variables. The change uses the ${var:-} syntax to safely check variables, resolving the test failure. Approved and merged. | |
| #573 ci: run spread tests on 'spread-installed' runners | rockcraft | merged | Merged a two-file, four-line CI configuration change to run spread tests on spread-installed runners. Approved by three reviewers and integrated. |