tests: replace the first batch of demo tests with snapd integration tests
Metadata
Current evaluation
Merged PR #1552 (commit efa8927e8): replaced the first batch of demo integration tests with a new snapd integration suite that builds, installs and runs Python hello-world snaps; the opencv demo test was kept after review.
Resolution: closed resolved
Reason: The PR itself was merged into snapcraft master as commit efa8927e8, adding integration_tests/snapd/ install-and-run tests and removing the corresponding demo tests, after kyrofa and sergiusens approved the new separate suite and the opencv test was reverted.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
The mosquitto demo is not showing anything interesting, and it's test is not going to catch any bugs.
Instead of that, I have added a new suite of tests for the integration with snapd, that will execute a python hello world, showing that a python snap built with snapcraft can be executed.
The same with the others. I replaced them with installing and running a hello world.
To this new suite now we can add more interesting things like hooks, and config. With the added benefit that it will run on travis, so we will catch bugs earlier.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #1552 (commit efa8927e8): replaced the first batch of demo integration tests with a new snapd integration suite that builds, installs and runs Python hello-world snaps; the opencv demo test was kept after review. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #1552 (commit efa8927e8) replaced the first batch of demo tests with a dedicated snapd integration suite (integration_tests/snapd) that builds, installs and runs hello-world snaps; opencv test was re-added on review. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged as snapcore/snapcraft#1552 in commit efa8927e8, replacing demo tests with a dedicated snapd integration suite that installs and runs Python hello-world snaps. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged as commit efa8927e8, replacing the first batch of demo tests with a dedicated snapd integration suite that installs and runs hello-world snaps. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged after reviewer consensus. Replaces outdated demo tests with a dedicated snapd integration suite, adding Travis compatibility and streamlining future hook and config validation. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged after replacing demo tests with snapd integration tests. Reviewers approved a dedicated suite for Travis CI. An opencv test was temporarily reverted per maintainer request before final approval and merge. |
Update history
No update history recorded yet.
Related work
-
Related To:
canonical/snapcraft#1596
(confidence 78%)
Follow-up merged PR (commit 535b8db63) continuing the same effort by moving the Ruby demo test into the snapd integration suite.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1596 tests: move ruby demo test to snapd integration suite | snapcraft | merged | PR #1596 merged (commit 535b8db63): moved the Ruby demo test out of snapcraft's integration suite into snapd's, and fixed the command in the ruby-hello demo snap. | |
| #1542 tests: add integration tests for build snaps | snapcraft | merged | PR #1542 merged as 8c9900f38, adding integration coverage for build snaps; two scenarios remained excluded due to Launchpad bugs #1716054 and #1716055. | |
| #336 examples_tests: added more tests after the snaps are installed | snapcraft | merged | Merged PR #336 via bdd7fd6b0, adding post-install tests for gopaste, Java, OpenCV, Shout, Tomcat, webcam and webchat snaps. |