tests: update testing to use craft-test
Metadata
Current evaluation
Merged #386 as commit 323b0e1, replacing direct Spread calls with snapcraft test and updating the test base to core24.
Resolution: closed resolved
Reason: PR #386 was approved and merged into main as commit 323b0e1. It updated spread.yaml and GitHub workflows to run integration tests through snapcraft test.
Evaluated by: mr-cal-bot
No scores available.
Issue body
Update spread.yaml and github workflows to use snapcraft test instead of
calling spread directly. Updating to base core24 is needed to use snapcraft
test.
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged #386 as commit 323b0e1, replacing direct Spread calls with snapcraft test and updating the test base to core24. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged #386 (commit 323b0e1), replacing direct Spread calls with snapcraft test in workflows and updating the test base to core24. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged. Replaced direct spread calls with snapcraft test in workflows and spread.yaml, requiring a core24 base update. Approved by two reviewers and modified 10 files (+56/-125 lines). |
Update history
| Date | Change |
|---|---|
| created |
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1272 tests: initial setup for the snapcraft snap tests with spread | snapcraft | merged | Merged PR #1272 as commit 545344442, adding initial Spread-based test infrastructure for the snapcraft snap. | |
| #1007 fix(craft-test): enable spread tests with 26.04 backends | craft-application | closed | Merged via canonical/snapcraft#6018, adding a temporary ubuntu-daily fallback so Spread tests could use 26.04 backends before ubuntu:26.04 images existed. | |
| #16 tests: add spread support | rockcraft | merged | Merged PR #16 added Spread support for CRAFT-865 via commit 3aeba2b3 (merge commit 5bf2680a). | |
| #5845 test(spread): test building base and snapd snaps | snapcraft | merged | Merged as fb8c81e8f, adding manual Spread coverage that builds current base snaps and the snapd snap against mainline Snapcraft. | |
| #6018 fix(craft-test): enable spread tests with 26.04 backends | snapcraft | merged | Merged #6018 as commit 3ac850650, documenting a temporary craft-test workaround that uses ubuntu-daily for Ubuntu 26.04 spread-test backends. | |
| #5371 test(spread): update store tests | snapcraft | merged | Merged #5371 (commits 3067b4bac/6979dd634, CRAFT-4419): adjusted snapcraft store spread tests and CI secrets after re-provisioning, pointing metrics tests at the testing snap, base64-encoding credentials, and using new staging keys. | |
| #102 test: update craftctl test | snapcraft-rocks | merged | Merged #102 added spread coverage confirming the craftctl failure in #33 was fixed. Fixes for core22-7 and core24-8 merged in #45 and #67; all CI checks passed. | |
| #1325 test(spread): consolidate basic init/build tests | charmcraft | merged | Merged PR #1325 as commit 90e25caf, consolidating basic Spread init/build tests for CRAFT-2127 and reducing duplicated setup across four files. | |
| #202 Add snapcraft tests | fetch-service | open | Snap package integration tests were added and CI now runs the Spread suite through snapcraft test, although the tracking issue remains open. | |
| #943 test(spread): test on more bases | craft-application | merged | Merged PR #943: added an external Python runtime for testcraft and expanded Spread tests across multiple snap bases to detect base-specific bugs earlier. |