Refactor spread testing to use spread extensions
Metadata
Current evaluation
Fixed by merged PR #299 (commit 44d9906), which refactored spread tests to generate spread.yaml and use the new spread extension framework.
Resolution: closed resolved
Reason: PR #299 merged as commit 44d9906, adding a prototype spread extension and converting the existing suites to dynamically generated, extension-based spread configuration.
Evaluated by: mr-cal-bot
No scores available.
Issue body
### What needs to get done
Reorganize the existing spread test execution to use the new testing framework and spread extensions.
### Why it needs to get done
Integrate the experimental testing framework into snapcraft, and exercise it using the fetch service spread tests.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Fixed by merged PR #299 (commit 44d9906), which refactored spread tests to generate spread.yaml and use the new spread extension framework. | |
| stealth/space-bunny-alpha | — | closed resolved | Fixed by canonical/fetch-service#299, which merged the prototype spread extension and refactored the spread suites to generate spread.yaml before execution. | |
| qwen/qwen3.6-35b-a3b | — | — | Abandoned. The request to refactor spread testing was synced to internal Jira ticket CRAFT-3690 and closed without implementation. No code changes or resolution were provided. |
Update history
| Date | Change |
|---|---|
| created |
Related work
-
Likely Fixed By:
canonical/fetch-service#299
(confidence 100%)
Merged PR explicitly linked as the resolution and associated with commit 44d9906.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #299 refactor(spread): prototype spread extension | fetch-service | merged | Merged as 44d9906, reorganizing spread test suites to use extension-generated spread.yaml and resolving fetch-service#291. | |
| #415 test: fix typo in spread extension | fetch-service | closed | PR #415 was closed after approval was retracted; its typo fix was incorporated into merged PR #417 via commit 8363f15. | |
| #1555 refactor(tests/spread): stop use init in most spread tests | charmcraft | closed | Closed unmerged and replaced by PR #1556, merged as commit 4682b32b, which updated Spread tests to use explicit charmcraft.yaml files instead of charmcraft init. | |
| #565 feat(testing): process simplified spread.yaml | craft-application | merged | Merged PR #565 added simplified spread.yaml expansion into a complete project file, resolving #560 after approval by two reviewers. | |
| #723 fix(testing): more intelligent test handling | craft-application | merged | Merged PR #723 via commit 6b319b77, running Spread tests as root and strictly validating only top-level spread.yaml keys. | |
| #775 feat: add support to spread test expressions | craft-application | merged | Merged PR #775 as commit 7f70ecb0, adding Spread test-expression matching and CI filtering; fixes issue #748. | |
| #665 Start using `spread` for integration tests | charmcraft | closed | Adopted spread for integration tests via merged PR canonical/charmcraft#862 (merge commit 7790c044, branch spread-bootstrap). Issue closed by maintainer sergiusens on 2023-03-16 noting the work was done in that PR. | |
| #2701 spread tests: update gnome extension tests | snapcraft | merged | Merged in PR #2701 (commit 53fb65790), updating GNOME extension spread tests to skip unsupported architectures and use shared base-test setup. | |
| #127 Fix spread tests | imagecraft | merged | Fixed and merged as commit cd43de1, updating 11 files (+49/-38); all listed CI checks, including spread, passed. | |
| #613 Execute spread testing | craft-application | closed | Spread testing delivered: TestingService and an opt-in 'test' command merged via PR #694 (commit 4910b2d8), building on #565 and #592. Maintainer mr-cal closed the issue citing that PR. |