tests: use autopkgtest to leverage snap testing
Metadata
Current evaluation
Merged. Updates the test suite to use autopkgtest for snap testing, modifying 31 files and reducing 137 lines. Changes were integrated into the main branch after passing CI checks.
Suggested action: —
No scores available.
Issue body
Signed-off-by: Sergio Schvezov <sergio.schvezov@canonical.com>
- [ ] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [ ] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [ ] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [ ] Have you successfully run `./runtests.sh static`?
- [ ] Have you successfully run `./runtests.sh tests/unit`?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged. Updates the test suite to use autopkgtest for snap testing, modifying 31 files and reducing 137 lines. Changes were integrated into the main branch after passing CI checks. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged into the main branch. The pull request updates the test suite to use autopkgtest for snap testing. Changes were integrated despite a Codecov warning regarding missing base commit coverage. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged into main. Updates the test suite to use autopkgtest for snap testing. Accepted by the maintainer without further discussion, despite a Codecov notification about missing base commit coverage. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #2182 tests: add spread suite for autotools plugin | snapcraft | merged | Merged to master, consolidating Autotools plugin and snapd tests into a single Spread suite to resolve Launchpad bug #1783825. The commit modifies six files, reduces code by 16 lines, passed CI checks, and received reviewer approval prior to integration. | |
| #2018 tests: minor fixes to autopkgtests | snapcraft | merged | Merged minor autopkgtest fixes by sergiusens. The changes updated 4 files with 17 additions and 3 deletions to correct test configurations. | |
| #1603 tests: add /snap/bin to PATH in autopkgtests | snapcraft | merged | Merged to add /snap/bin to the autopkgtests PATH, fixing binary lookup failures. Approved, passed CI, and depends on PR #1595. | |
| #2514 test: autopkgtest beta | snapcraft | merged | Merged into master following approval and CI validation. The update refined autopkgtest beta configurations, removing 100 lines. Maintainer confirmed the minor coverage decrease was expected. | |
| #1643 tests: run daily autopkgtest in travis | snapcraft | merged | Merged. Configured Travis CI to run daily autopkgtests by updating .travis.yml. Changes were approved and integrated into the main branch. | |
| #1755 tests: collect the autopkgtest results and save them in git | snapcraft | merged | Merged to collect autopkgtest results and store them in git. Approved by two reviewers across five files (+131/-3 lines). Six unresolved review comments remained but did not prevent integration. | |
| #1596068 The unittests in autopkgtest are run twice | snapcraft (launchpad) | closed | Autopkgtest configuration updated to skip unit tests already executed during package builds. Only integration and snaps suites now run, eliminating redundant execution and improving developer build times. Resolved and verified. | |
| #1716 tests: split the integration autopkgtests | snapcraft | merged | Merged after splitting integration autopkgtests to eliminate timeout failures. The change adds minor per-test setup overhead but resolves recurring execution timeouts. Approved by two reviewers with passing CI checks. | |
| #1570992 autopkgtests are running snapcraft from source | snapcraft (launchpad) | closed | Fixed and verified. Autopkgtests now install and execute against the built deb package instead of source, ensuring realistic testing conditions with no regression. | |
| #464 autopkgtests: run the tests using the installed package | snapcraft | merged | Merged following reviewer approval and a requested rebase. The change modifies autopkgtests to execute against the installed package rather than the source tree, updating four files with 17 additions and 11 deletions. Addresses LP: #1570992. |