tests: split the integration autopkgtests
Metadata
Current evaluation
Merged in snapcraft#1716 via 57af155a7, splitting integration autopkgtests into separate runs to prevent timeout failures despite added setup overhead.
Resolution: closed resolved
Reason: PR #1716 was merged as commit 57af155a7. The maintainer confirmed afterward that autopkgtest failures were no longer caused by timeouts.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
I hate these splits, but at least we will not have to worry about the timeouts in autopkgtests for a good while.
The downside is that every autopkgtest execution will be a little longer now, because every test comes with a little overhead to setup.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged in snapcraft#1716 via 57af155a7, splitting integration autopkgtests into separate runs to prevent timeout failures despite added setup overhead. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #1716 as 57af155a7, splitting integration autopkgtests into separate runs to prevent timeouts despite slightly higher setup overhead. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged in canonical/snapcraft#1716 as 57af155a7, splitting integration autopkgtests to prevent timeouts. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged after splitting integration autopkgtests to eliminate timeout failures. The change adds minor per-test setup overhead but resolves recurring execution timeouts. Approved by two reviewers with passing CI checks. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to split integration autopkgtests, resolving recurring timeout failures. The change adds slight setup overhead per test but eliminates timeout-related build failures. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #783 Add an integration test for autotools | snapcraft | merged | Merged snapcraft#783 in commit 874b28041, adding integration-test coverage for the Autotools plugin and resolving LP bug #1621694. | |
| #1541421 Run unittests as part of the integration tests | snapcraft (launchpad) | closed | Unit tests were added to the autopkgtest suite across tested architectures via canonical/snapcraft#293 (merge commit af4d3bbf5, implementation 4057fe797). | |
| #1200 tests: allow to run individual autopkgtest suites | snapcraft | merged | Merged PR #1200 as commit 532b6d2ff, adding selectable autopkgtest suites so integration and snaps_tests can run independently; fixes LP #1673981. | |
| #1603 tests: add /snap/bin to PATH in autopkgtests | snapcraft | merged | Merged PR #1603 (commit 70a0c6fb1) into master, adding /snap/bin to PATH in the autopkgtest setup so integration tests could find snap binaries; it depended on #1595, also merged. | |
| #1760 tests: move the catkin integration tests to a separate suite | snapcraft | merged | Merged in snapcraft#1760 as commit c97c45131, moving Catkin integration tests to a separate suite to reduce timeouts in the main plugins suite. | |
| #1625 tests: use the snapcraft snap for integration tests | snapcraft | merged | Merged PR #1625 updated integration tests to run the installed Snapcraft snap, better matching the user environment. Resolution: commit eebb070e6. | |
| #1542 tests: add integration tests for build snaps | snapcraft | merged | PR #1542 merged as 8c9900f38, adding integration coverage for build snaps; two scenarios remained excluded due to Launchpad bugs #1716054 and #1716055. | |
| #2353 tests: remove dependency on snapcraft for integration tests | snapcraft | merged | PR #2353 by sergiusens merged as commit 6a7c860c4, dropping snapcraft imports from integration tests (27 files, +956/-733) so the suite no longer depends on snapcraft and tests stay independent, alongside the bases/multipass cleanup. | |
| #1609 tests: remove the duplicate nodejs integration tests | snapcraft | merged | Merged in snapcraft#1609 via commit d0be68b68, removing duplicate Node.js integration tests already covered by unit tests for npm as the default. | |
| #2380 tests: use autopkgtest to leverage snap testing | snapcraft | merged | Merged #2380 as commit 4c5b97a6b, updating 31 files to use autopkgtest for snap testing. |