tests: reorganize unit and integration suites to make them easier to split for travis
Metadata
Current evaluation
Merged following two approvals. Reorganized unit and integration test suites to facilitate splitting for Travis CI. A transient CI network error was observed but did not prevent the merge.
Suggested action: —
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
requires #1630
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged following two approvals. Reorganized unit and integration test suites to facilitate splitting for Travis CI. A transient CI network error was observed but did not prevent the merge. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged reorganization of unit and integration test suites to facilitate splitting for Travis CI. A transient DNS timeout triggered a single CI failure on xenial-armhf, but the changes were accepted and merged. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged reorganization of unit and integration test suites to facilitate Travis CI splitting. Requires PR #1630. A transient DNS resolution failure on xenial-armhf did not prevent merge. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1252 ci: split plugin integration tests out. | snapcraft | merged | Merged to split plugin integration tests across multiple jobs, resolving Travis CI timeout limits. The change modified 23 files with minimal additions and required no review. | |
| #2217 Travis test | snapcraft | merged | Merged after approval. Updated Travis CI configuration across 26 files, reducing 483 lines. A Codecov base commit warning appeared but did not prevent the merge. | |
| #2057 tests: extract lifecycle suite from general suite | snapcraft | merged | Merged changes extracting the lifecycle test suite from the oversized general suite to resolve Travis CI timeouts. The refactor splits tests across 19 files, successfully addressing the timeout issue. | |
| #7 tools: Split unit and integration tests | starbase | merged | Merged changes splitting unit and integration tests into separate directories. Approved by one reviewer. The update modifies six files, adding 33 net lines. The integration folder was created solely for structural separation. | |
| #2301 tests: move most tests to spread and reorder travis.yaml | snapcraft | merged | Merged changes migrating most Python tests to spread instances while retaining store tests. Optimized Travis CI ordering for faster execution. Approved, passed checks, and merged with no coverage impact. | |
| #1318 tests: refactor the travis jobs using stages | snapcraft | merged | Merged refactoring of Travis CI jobs to use stages. Approved by two reviewers, the update modifies seven files with 201 additions and 40 deletions to streamline the test pipeline. | |
| #107 ci: separate unit and integration tests | starbase | merged | Merged into main after approval and passing CI checks. The PR separated unit and integration tests in the CI pipeline, modifying two files (+46/-7 lines). Code coverage remained unchanged at 100%. | |
| #82 test: improve integration testing | craft-store | merged | Merged improvements to integration testing across eight files. The update works around external fork credential limitations by running full tests only after merging to main. Approved by one reviewer and passed CI. | |
| #131 build: separate unit and integration tests in CI | craft-application | merged | Merged into main. Separates unit and integration tests in CI to improve readability and fix log rotation conflicts. Scope was narrowed from parallel execution to simply splitting test categories. Approved and passed checks. | |
| #2614 [WIP] travis-ci: split spread tests to reduce job times | snapcraft | closed | Closed without merging. The Travis CI spread test split failed to reduce job times due to existing worker logic. The author abandoned the PR in favor of PR #2615, which implements the correct optimization. |