tests: use the snapcraft snap for integration tests
Metadata
Current evaluation
Merged PR #1625 updated integration tests to run the installed Snapcraft snap, better matching the user environment. Resolution: commit eebb070e6.
Resolution: closed resolved
Reason: PR #1625 was merged, changing the integration suite to test the installed Snapcraft snap rather than the source tree. Commit eebb070e6 records the resolution.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #1625 updated integration tests to run the installed Snapcraft snap, better matching the user environment. Resolution: commit eebb070e6. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #1625 switches integration tests to the installed Snapcraft snap, validating the packaged executable users actually run. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged after two approvals. The PR updates integration tests to run against the installed snapcraft snap, aligning with user environments. Despite a reported Go runtime address space conflict in CI, the changes were accepted and merged. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. Replaces integration test execution with the installed snapcraft snap to improve security and user parity. Reviewers approved the approach. Despite a reported Go runtime address space conflict during unit tests, the changes were successfully merged. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #2096 tests: don't use os_release and repo from snapcraft | snapcraft | merged | Merged PR #2096 in commit 0e27e147d, replacing integration tests' use of Snapcraft's os_release and repo modules with test-specific helpers; it fixes #1982. | |
| #1849 tests: add snap not found tests | snapcraft | merged | Merged missing-snap test coverage; snapcraft PR #1849 landed as commit 54cf2bd9e. | |
| #1982 Update snaps_tests to use the testing tools from tests.integration | snapcraft | closed | Fixed by merged PR #2096 in commit 0e27e147d, replacing Snapcraft OS-release and repository dependencies in integration tests with test-specific helpers. | |
| #1894 tests: allow to overwrite the snapcraft install command | snapcraft | merged | Merged PR #1894 as commit 596896be8, adding SNAPCRAFT_INSTALL_COMMAND so integration tests can override Snapcraft installation and skip the preceding build stage. | |
| #3609 tests: move legacy snapcraft tests (CRAFT-728) | snapcraft | merged | Merged PR #3609 in commit a71aeff54, moving snapcraft_legacy unit tests from tests/unit to tests/legacy to match the package rename. | |
| #4755 tests: fix devel base snap test | snapcraft | merged | Merged #4755, fixing the devel-base integration test to verify Snapcraft can create the base snap and that the resulting devel base is usable. | |
| #2353 tests: remove dependency on snapcraft for integration tests | snapcraft | merged | PR #2353 by sergiusens merged as commit 6a7c860c4, dropping snapcraft imports from integration tests (27 files, +956/-733) so the suite no longer depends on snapcraft and tests stay independent, alongside the bases/multipass cleanup. | |
| #1542 tests: add integration tests for build snaps | snapcraft | merged | PR #1542 merged as 8c9900f38, adding integration coverage for build snaps; two scenarios remained excluded due to Launchpad bugs #1716054 and #1716055. | |
| #1877 tests: move test files out of the snapcraft dir | snapcraft | closed | Closed unmerged after conflicts; the test reorganization was redone and merged via snapcraft#1948 at commit 55ad11ccc, moving tests out of the snapcraft package. | |
| #1590268 snapcraft-parser has no integration tests | snapcraft (launchpad) | closed | Added a user-level happy-path integration test for snapcraft-parser via merged canonical/snapcraft#560 (commit 8f5b30dba); released in Snapcraft 2.12. |