feat: add support to spread test expressions
Metadata
Current evaluation
Merged PR #775 as commit 7f70ecb0, adding Spread test-expression matching and CI filtering; fixes issue #748.
Resolution: closed resolved
Reason: PR #775 was merged into main as commit 7f70ecb0, adding Spread-style test expressions, glob matching, and CI backend/host filtering.
Evaluated by: mr-cal-bot
No scores available.
Issue body
If no arguments are passed to the `test` command, the `craft` backend
is used for testing. If the testing environment is detected as CI,
a system matching the host system is also specified.
If arguments are passed to the `test` command, they are interpreted as
Spread test expressions to match job names according to Spread rules,
including the use of `...` for globbing. If the testing environment is
detected as CI, only the tests matching the `craft` backend and the host
system are executed.
More information about spread test expressions are available in the
Spread documentation at https://github.com/canonical/spread?#selecting
Fixes #748
Signed-off-by: Claudio Matsuoka <claudio.matsuoka@canonical.com>
- [x] Have you followed the guidelines for contributing?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [ ] Have you successfully run `make lint && make test`?
- [ ] Have you added an entry to the changelog (`docs/reference/changelog.rst`)?
---
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #775 as commit 7f70ecb0, adding Spread test-expression matching and CI filtering; fixes issue #748. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #775 as commit 7f70ecb0, adding Spread test-expression support to the test command, including CI filtering by backend and host system; fixes #748. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged feature adding spread test expression support to the test command. Filters jobs by craft backend and CI host system. Approved by two reviewers and merged despite unreviewed commits and a failing OSV-scanner check. Fixes #748. |
Update history
No update history recorded yet.
Related work
-
Related To:
canonical/craft-application#748
(confidence 100%)
Issue requesting broader Spread-supported test specifications, explicitly resolved by PR #775.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #748 Allow all spread-supported test specs | craft-application | closed | Merged PR #775 via commit 7f70ecb0 added support for Spread test expressions, including [backend:][system:][suite/test] specs, resolving #748. | |
| #16 tests: add spread support | rockcraft | merged | Merged PR #16 added Spread support for CRAFT-865 via commit 3aeba2b3 (merge commit 5bf2680a). | |
| #291 Refactor spread testing to use spread extensions | fetch-service | closed | Fixed by merged PR #299 (commit 44d9906), which refactored spread tests to generate spread.yaml and use the new spread extension framework. | |
| #738 feat(test): add more spread interactions | craft-application | merged | Merged in PR #738 as commit 833ddfb9, adding specific test paths plus --shell, --shell-after, and --debug to the test command; released in 5.2.0. | |
| #415 test: fix typo in spread extension | fetch-service | closed | PR #415 was closed after approval was retracted; its typo fix was incorporated into merged PR #417 via commit 8363f15. | |
| #869 feat: add 'test' command | rockcraft | merged | Merged #869 (a6d1b77a), adding the test CLI command and a Spread test with hardcoded files pending init-profile test support. | |
| #613 Execute spread testing | craft-application | closed | Spread testing delivered: TestingService and an opt-in 'test' command merged via PR #694 (commit 4910b2d8), building on #565 and #592. Maintainer mr-cal closed the issue citing that PR. | |
| #5398 feat: add init test profile | snapcraft | merged | Merged in #5398 via commit 0fb29e11f, adding a separate test init profile with spread.yaml and spread-extension templates; fixes #5099. | |
| #4924 tests: add spread tests for validation-sets | snapcraft | merged | Merged PR #4924 added spread coverage for edit-validation-sets and list-validation-sets, closing #4918; merge commit 157d0a182. | |
| #1287 tests: minor cleanups on the spread tests | snapcraft | merged | Merged into master as commit 1cf0f8c9f "tests: minor cleanups on the spread tests (#1287)" — a test-only tidy-up touching 4 spread test files (+16/-6), reviewed and approved by fgimenez, with coverage unchanged at 95.27%. |