autopkgtests: run the install examples tests in classic
Metadata
Current evaluation
PR #481 merged as commit ca2c23904, switching autopkgtests to a classic container so the install examples suite can install and test the generated snaps; resolves LP #1572764.
Resolution: closed resolved
Reason: The pull request was merged into snapcraft as commit ca2c23904 ("autopkgtests: run the install examples tests in classic (#481)"), which moved the autopkgtest install examples suite to a classic-snapped environment. The follow-up concern raised by kyrofa about examples failing on non-test-case snaps was split out to snapcraft bug #1577867.
Evaluated by: mr-cal-bot
Issue body
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | PR #481 merged as commit ca2c23904, switching autopkgtests to a classic container so the install examples suite can install and test the generated snaps; resolves LP #1572764. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged as ca2c23904 via PR #481, enabling classic autopkgtests to install and test generated snaps, resolving LP #1572764. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged following CI retests and reviewer approval. Configures autopkgtests to run install examples in classic mode. A related bug was filed to adjust example exit logic. The commit updates six files to standardize test execution. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to run install examples tests in classic mode via autopkgtests, resolving LP #1572764. After multiple test cycles and reviewer feedback on example behavior (tracked as LP #1577867), the change passed final checks and was integrated. |
Update history
No update history recorded yet.
Related work
-
Likely Fixed By:
snapcraft (launchpad)#1577867
(confidence 60%)
Follow-up low-priority bug filed by kyrofa at maintainer's request so the example snaps only fail on a specific error message rather than any failure.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1572764 autopkgtests are not installing the generated snaps | snapcraft (launchpad) | closed | Autopkgtests did not install the generated example snaps. Fixed by snapcraft PR #481 (commit ca2c23904, "autopkgtests: run the install examples tests in classic"), shipped in snapcraft 2.9 and released to xenial -updates; bug auto-closed by ~janitor after verification. | |
| #464 autopkgtests: run the tests using the installed package | snapcraft | merged | Merged PR #464 in commit bce2d23ec, changing autopkgtests to test the installed built package instead of the source tree; LP #1570992 was fixed and verified. | |
| #164 Updated the autopkgtests. | snapcraft | merged | PR #164 merged in commit 70d4e0b26, updating autopkgtests to run integration tests, build examples without installing them, and skip redundant unit tests. |