← Back to issue list

test: randomize the order of tests

View original Github issue

Metadata

Project
craft-store
Number
#289
Type
pull request
State
merged
Author
lengau
Labels
—
Created
Updated
Closed

Current evaluation

Merged PR #289 in commit e0e4f4f, randomizing test execution order to prevent order-dependent failures; all CI checks passed.

Resolution: closed resolved

Reason: PR #289 was merged as commit e0e4f4f after approval by two reviewers, with all CI checks passing and no unresolved review comments.

Evaluated by: mr-cal-bot

No scores available.

Issue body

Inspired by https://github.com/canonical/rockcraft/pull/895 - [ ] Have you followed the guidelines for contributing? - [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)? - [ ] Have you successfully run `make lint && make test`? -----

Evaluation history

Date Model Scores Action Summary
stealth/space-bunny-alpha — closed resolved Merged PR #289 in commit e0e4f4f, randomizing test execution order to prevent order-dependent failures; all CI checks passed.
stealth/space-bunny-alpha — closed resolved Merged PR #289 (commit e0e4f4f), randomizing test execution order to prevent order-dependent failures; two reviewers approved it and all CI checks passed.
qwen/qwen3.6-35b-a3b — — Merged after two approvals and passing CI. Changes modify two files to randomize test execution order, preventing order-dependent failures. The update adds 1076 lines and removes 1061 lines.

Update history

No update history recorded yet.

Related work

  • Related To: canonical/rockcraft#895 (confidence 90%)

    The PR description cites Rockcraft PR #895 as its inspiration.

Related issues

Issue Project State Summary Similarity
#895 test: randomize the order of tests rockcraft merged Merged canonical/rockcraft#895, adding randomized test ordering to uncover inter-test dependencies; landed as commit 2676b48e with all CI checks passing.
84%
#136 test: randomize the order of tests craft-platforms merged PR #136 merged as commit 1cf8225 ("test: randomize the order of tests"), adding pytest-randomly>=3.15.0 to test dependencies to catch order-dependent test failures; inspired by rockcraft#895.
77%