tests: move most tests to spread and reorder travis.yaml
Metadata
Current evaluation
Merged changes migrating most Python tests to spread instances while retaining store tests. Optimized Travis CI ordering for faster execution. Approved, passed checks, and merged with no coverage impact.
Suggested action: —
No scores available.
Issue body
Keep the python test runner, but have them run inside spread instances instead.
The store one remains given that we expose that as a test point with other
teams to be able to do pre deployment tests.
Also optimize travis ordering for speed.
LP: #1794761
Signed-off-by: Sergio Schvezov <sergio.schvezov@canonical.com>
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh tests/unit`?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged changes migrating most Python tests to spread instances while retaining store tests. Optimized Travis CI ordering for faster execution. Approved, passed checks, and merged with no coverage impact. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged into master. Moved most Python tests to spread instances, retained store tests for pre-deployment checks, and optimized Travis CI build ordering for speed. Code coverage remained unchanged. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged into master. Moved most Python tests to spread instances, retained store tests, and optimized Travis CI ordering for faster builds. Code coverage remained unchanged at 90.56%. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1794761 move python driven tests to spread | snapcraft (launchpad) | closed | Closed without discussion or comments. The request to migrate Python tests to spread and clean up Travis YAML was abandoned or superseded by newer CI tooling. | |
| #2682 tests: change default spread provider to lxd outside of travis | snapcraft | merged | Merged after approval and CI. Refactored runtests script for clarity and updated Travis config to use google spread provider, removing legacy code and simplifying non-Travis test execution. | |
| #1638 tests: reorganize unit and integration suites to make them easier to split for travis | snapcraft | merged | Merged following two approvals. Reorganized unit and integration test suites to facilitate splitting for Travis CI. A transient CI network error was observed but did not prevent the merge. | |
| #723 fix(testing): more intelligent test handling | craft-application | merged | Merged after approval. Updates test handling to run spread tests as root and strictly parse top-level spread.yaml keys. Approved by two reviewers and passed CI checks before integration. | |
| #1643 tests: run daily autopkgtest in travis | snapcraft | merged | Merged. Configured Travis CI to run daily autopkgtests by updating .travis.yml. Changes were approved and integrated into the main branch. | |
| #3090 ci: move staging store tests to spread | snapcraft | merged | Merged into master. The change migrated staging store tests to the spread testing framework, removing 1434 lines across 27 files. Approved by two reviewers, passed CI, and achieved 100% diff coverage prior to integration. |