test: randomize the order of tests
Metadata
Current evaluation
Merged after two approvals and passing CI. Changes modify two files to randomize test execution order, preventing order-dependent failures. The update adds 1076 lines and removes 1061 lines.
Suggested action: —
No scores available.
Issue body
Inspired by https://github.com/canonical/rockcraft/pull/895
- [ ] Have you followed the guidelines for contributing?
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [ ] Have you successfully run `make lint && make test`?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged after two approvals and passing CI. Changes modify two files to randomize test execution order, preventing order-dependent failures. The update adds 1076 lines and removes 1061 lines. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged changes to randomize test execution order, improving reliability by catching order-dependent failures. The pull request was approved and integrated into the main branch without additional comments or revisions. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #895 test: randomize the order of tests | rockcraft | merged | Merged a pilot implementation to randomize test execution order, preventing inter-test dependencies. Approved by two reviewers with all CI checks passing. Diff adds 16 lines and removes 1 across two files. | |
| #461 test: improve test coverage | fetch-service | merged | Merged to improve test coverage, adding 270 lines across three files. Approved by two reviewers with all CI checks passing. |