tests: add integration tests for build snaps
Metadata
Current evaluation
Merged integration tests for build snaps. Approved by two reviewers and passed CI. Two test scenarios omitted due to known bugs.
Suggested action: —
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
There are two missing scenarios because of bugs:
https://bugs.launchpad.net/snapcraft/+bug/1716054
https://bugs.launchpad.net/snapcraft/+bug/1716055
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged integration tests for build snaps. Approved by two reviewers and passed CI. Two test scenarios omitted due to known bugs. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. Added integration tests for build snaps. Two scenarios remain untested due to existing bugs 1716054 and 1716055. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Integration tests for build snaps merged. Two scenarios omitted due to unresolved bugs 1716054 and 1716055. Changes successfully integrated. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1849 tests: add snap not found tests | snapcraft | merged | Merged tests for missing snap scenarios. Approved by two reviewers and integrated into the codebase despite unresolved review comments and reported integration test timeouts. | |
| #73 tests: add stage snaps integration test (CRAFT-68) | craft-parts | merged | Merged an integration test verifying stage-snaps are correctly unpacked into the part install directory. Approved by two reviewers, passed CI, and added 133 lines across two files. | |
| #1625 tests: use the snapcraft snap for integration tests | snapcraft | merged | Merged after two approvals. The PR updates integration tests to run against the installed snapcraft snap, aligning with user environments. Despite a reported Go runtime address space conflict in CI, the changes were accepted and merged. | |
| #150 inspectors/snap: add additional inspector tests | fetch-service | merged | Merged after approval by two reviewers. The pull request adds additional inspector tests for snap. Successfully integrated into the main branch. | |
| #706 Add integration tests using the snap | charmcraft | closed | Resolved by implementing the requested snap integration tests as part of the spread test suite. | |
| #2014 integration tests: snap tests shouldn't be arch-specific | snapcraft | merged | Merged a change removing architecture-specific constraints from snap integration tests. Approved by one reviewer with a two-line modification across a single file. | |
| #1198 tests: add manual tests for the kernel snaps | snapcraft | merged | Added manual tests for kernel snaps and merged. Approved by one reviewer, adding 105 lines to one file. Addresses Launchpad bug #1590258. | |
| #4755 tests: fix devel base snap test | snapcraft | merged | Merged a fix for the devel base snap test. The update ensures snapcraft correctly creates and utilizes the devel base. Approved by two reviewers, passed CI checks, and applied with a minimal one-file change. | |
| #2421 tests: remove obsolete snap and external tests | snapcraft | merged | Merged after maintainer approval, removing obsolete snap and external tests. Accepted despite minor coverage drop and unrelated CI failures, though later noted to break documentation. | |
| #521 test(spread): add an improved snap inspector test | fetch-service | merged | Merged an improved snap inspector test that emulates system setup by stopping snapd, clearing device files, setting a global proxy, and restarting snapd to uncover network requests. Approved by two reviewers, passed all CI checks, and merged. |