tests: add integration tests for build snaps
Metadata
Current evaluation
PR #1542 merged as 8c9900f38, adding integration coverage for build snaps; two scenarios remained excluded due to Launchpad bugs #1716054 and #1716055.
Resolution: closed resolved
Reason: PR snapcraft#1542 was merged into the main project as commit 8c9900f38, adding integration tests for build snaps.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
There are two missing scenarios because of bugs:
https://bugs.launchpad.net/snapcraft/+bug/1716054
https://bugs.launchpad.net/snapcraft/+bug/1716055
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | PR #1542 merged as 8c9900f38, adding integration coverage for build snaps; two scenarios remained excluded due to Launchpad bugs #1716054 and #1716055. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged as 8c9900f38, adding integration coverage for build snaps; two scenarios remain excluded due to Launchpad bugs #1716054 and #1716055. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR canonical/snapcraft#1542 in commit 8c9900f38, adding integration coverage for build snaps. Two scenarios remain omitted due to Launchpad bugs #1716054 and #1716055. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged integration tests for build snaps. Approved by two reviewers and passed CI. Two test scenarios omitted due to known bugs. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. Added integration tests for build snaps. Two scenarios remain untested due to existing bugs 1716054 and 1716055. |
Update history
No update history recorded yet.
Related work
-
Blocked By:
launchpad#1716054
(confidence 100%)
One scenario was excluded because this known Snapcraft bug blocked it.
-
Blocked By:
launchpad#1716055
(confidence 100%)
Another scenario was excluded because this known Snapcraft bug blocked it.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1105 tests: rename the integration test snaps | snapcraft | merged | Renamed integration test snaps across 139 files; PR #1105 merged as commit 02de32a3, addressing Launchpad bug #1661893. | |
| #1849 tests: add snap not found tests | snapcraft | merged | Merged missing-snap test coverage; snapcraft PR #1849 landed as commit 54cf2bd9e. | |
| #73 tests: add stage snaps integration test (CRAFT-68) | craft-parts | merged | Merged PR #73 via commit a5dbc53e (merge 978aeac1), adding an integration test that verifies stage snaps are unpacked into the part install directory. | |
| #5841 Include "build snapd snap" test in test suite | snapcraft | closed | Added spread coverage for building snapd and base snaps in merged PR #5845 (commit fb8c81e8f). | |
| #706 Add integration tests using the snap | charmcraft | closed | Snap-based integration coverage was added through Charmcraft's Spread suite by merged PR canonical/charmcraft#862 (commit 7790c044). | |
| #1625 tests: use the snapcraft snap for integration tests | snapcraft | merged | Merged PR #1625 updated integration tests to run the installed Snapcraft snap, better matching the user environment. Resolution: commit eebb070e6. | |
| #1198 tests: add manual tests for the kernel snaps | snapcraft | merged | Merged PR #1198 (commit cf7df7e64) added 105 lines of manual kernel-snap tests, addressing Launchpad bug #1590258. | |
| #1552 tests: replace the first batch of demo tests with snapd integration tests | snapcraft | merged | Merged PR #1552 (commit efa8927e8): replaced the first batch of demo integration tests with a new snapd integration suite that builds, installs and runs Python hello-world snaps; the opencv demo test was kept after review. | |
| #4755 tests: fix devel base snap test | snapcraft | merged | Merged #4755, fixing the devel-base integration test to verify Snapcraft can create the base snap and that the resulting devel base is usable. | |
| #1378 Integration tests for snap command with target arch | snapcraft | merged | PR #1378 merged as 18a767537, fixing --target-arch parsing before the snap subcommand and adding integration tests for invocation forms. |