tests: move most tests to spread and reorder travis.yaml
Metadata
Current evaluation
Merged PR #2301 moved most Python tests into spread, retained the store test, and reordered Travis jobs to improve test speed (commit 88005edf4).
Resolution: closed resolved
Reason: The approved pull request was merged into master as commit 88005edf4, completing the test-infrastructure and Travis-ordering changes described in the PR.
Evaluated by: mr-cal-bot
No scores available.
Issue body
Keep the python test runner, but have them run inside spread instances instead.
The store one remains given that we expose that as a test point with other
teams to be able to do pre deployment tests.
Also optimize travis ordering for speed.
LP: #1794761
Signed-off-by: Sergio Schvezov <sergio.schvezov@canonical.com>
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh tests/unit`?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #2301 moved most Python tests into spread, retained the store test, and reordered Travis jobs to improve test speed (commit 88005edf4). | |
| stealth/space-bunny-alpha | — | closed resolved | Merged #2301 (commit 88005edf4) moved most Python tests to spread, retained store tests, and reordered Travis jobs for faster execution. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #2301 in commit 88005edf4, running most Python tests in spread instances, retaining store tests, and reordering Travis CI for faster execution. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged changes migrating most Python tests to spread instances while retaining store tests. Optimized Travis CI ordering for faster execution. Approved, passed checks, and merged with no coverage impact. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged into master. Moved most Python tests to spread instances, retained store tests for pre-deployment checks, and optimized Travis CI build ordering for speed. Code coverage remained unchanged. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1794761 move python driven tests to spread | snapcraft (launchpad) | closed | Migrated Python-driven tests from Travis to spread via snapcore/snapcraft#2301, merged as commit 88005edf4 ("tests: move most tests to spread and reorder travis.yaml"), leaving store tests on Travis. | |
| #1638 tests: reorganize unit and integration suites to make them easier to split for travis | snapcraft | merged | Merged #1638 as commit 30f62685c, reorganizing unit and integration test suites for easier splitting across Travis CI jobs. | |
| #2614 [WIP] travis-ci: split spread tests to reduce job times | snapcraft | closed | Closed unmerged in favor of snapcraft#2615, which increased Spread worker parallelism and merged as commit 5c91f9681 to reduce job times. | |
| #3089 ci: move staging store tests to spread | snapcraft | closed | Superseded by merged PR #3090, which moved staging store tests to Spread in commit 3a037fb11. | |
| #6171 test(spread): update python tests | snapcraft | merged | Merged PR #6171 in commit 0bd8a7894, aligning core26 spread tests and documentation to use the same ordered set of Python packages. | |
| #3090 ci: move staging store tests to spread | snapcraft | merged | Merged into master in commit 3a037fb11, moving staging store tests from the legacy suite to Spread and removing 1,434 lines across 27 files. | |
| #1460 fix(tests): make store spread tests less flaky | charmcraft | merged | Merged PR #1460 as fd5bd6ba, making store spread tests less timing-sensitive and fixing flaky upload/release checks in #1429. | |
| #3375 ci: migrate spread tests to github actions | snapcraft | merged | Merged #3375 moved spread tests from Travis CI to GitHub Actions, updating three CI files (+84/-6). |