tests: split the integration autopkgtests
Metadata
Current evaluation
Merged after splitting integration autopkgtests to eliminate timeout failures. The change adds minor per-test setup overhead but resolves recurring execution timeouts. Approved by two reviewers with passing CI checks.
Suggested action: —
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
I hate these splits, but at least we will not have to worry about the timeouts in autopkgtests for a good while.
The downside is that every autopkgtest execution will be a little longer now, because every test comes with a little overhead to setup.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged after splitting integration autopkgtests to eliminate timeout failures. The change adds minor per-test setup overhead but resolves recurring execution timeouts. Approved by two reviewers with passing CI checks. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to split integration autopkgtests, resolving recurring timeout failures. The change adds slight setup overhead per test but eliminates timeout-related build failures. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged split of integration autopkgtests to eliminate timeout failures. Test execution incurs slight setup overhead, but timeout issues are resolved. Reviewer confirmed the fix. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1755 tests: collect the autopkgtest results and save them in git | snapcraft | merged | Merged to collect autopkgtest results and store them in git. Approved by two reviewers across five files (+131/-3 lines). Six unresolved review comments remained but did not prevent integration. | |
| #2188 tests: support running spread suite in autopkgtests | snapcraft | merged | Merged. Adds an autopkgtest suite to run the spread test suite during releases. CI failures were resolved by fixing missing build dependencies and temporarily disabling armhf execution. Approved by one reviewer and merged. | |
| #177 Updated the autopkg integration tests. | snapcraft | merged | Merged after maintainer approval. Updated autopkg integration tests with minor changes across two files. Approved by @kyrofa. | |
| #600 Remove the unittests from the autopkgtest execution | snapcraft | merged | Merged to prevent duplicate unittest execution by removing tests from autopkgtest, as they already run during the build phase. Resolved LP #1596068. CI passed after resolving external execution delays. | |
| #1705 test: extend timeout for some spread tests | charmcraft | merged | Merged changes extending timeouts for specific spread tests to prevent failures from lengthy preparation steps. Approved by reviewers, passed CI, and modified two files. | |
| #1252 ci: split plugin integration tests out. | snapcraft | merged | Merged to split plugin integration tests across multiple jobs, resolving Travis CI timeout limits. The change modified 23 files with minimal additions and required no review. | |
| #1657 tests: in autopkgtests, use a tempdir in home, not in the tmpfs | snapcraft | merged | Merged changes to autopkgtests that route temporary directories to the home folder instead of tmpfs. Approved by two reviewers, the update (+23/-1 lines across 3 files) was successfully integrated. | |
| #82 test: improve integration testing | craft-store | merged | Merged improvements to integration testing across eight files. The update works around external fork credential limitations by running full tests only after merging to main. Approved by one reviewer and passed CI. | |
| #1538 tests: update the store failure tests | snapcraft | merged | Merged after approval and passing CI. Updates store failure tests by adjusting autopkgtest scripts to report final errors, sets exception exit codes to 2, and clarifies integration test execution against fake servers. | |
| #2514 test: autopkgtest beta | snapcraft | merged | Merged into master following approval and CI validation. The update refined autopkgtest beta configurations, removing 100 lines. Maintainer confirmed the minor coverage decrease was expected. |