feat(testing): execute spread on generated file
Metadata
Current evaluation
Merged after approval. Updates the testing workflow to execute spread on a generated temporary file with a resolved testing backend. Unrelated integration test failures were addressed in a separate pull request.
Suggested action: —
No scores available.
Issue body
Process the craft test spread.yaml file and generate a temporary
file with resolved testing backend. Execute spread on the generated
file.
- [ ] Have you followed the guidelines for contributing?
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [ ] Have you successfully run `tox`?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged after approval. Updates the testing workflow to execute spread on a generated temporary file with a resolved testing backend. Unrelated integration test failures were addressed in a separate pull request. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. Implements spread execution on a generated temporary file with a resolved testing backend. Initial test failures stemmed from external craft-cli updates and were resolved in a separate PR. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #565 feat(testing): process simplified spread.yaml | craft-application | merged | Merged to resolve issue #560. Processes a user-supplied simplified spread.yaml into a complete project file for the spread testing framework. Approved by two reviewers, passed CI, and modified 11 files. | |
| #534 test(spread): workaround for flaky test | fetch-service | merged | Merged a workaround for a flaky spread test (issue #533). The change adjusts one file (+2/-1 lines) to skip a no-op name query check while retaining other validations. Approved by two reviewers and passed all CI checks. | |
| #926 test: address a couple of non-flaky spread failures | rockcraft | merged | Merged after two approvals and passing all CI checks. Resolves non-flaky spread test failures by updating test configurations across three files, eliminating consistent failures. | |
| #1287 tests: minor cleanups on the spread tests | snapcraft | merged | Merged minor spread test cleanups into master. Modified four files with 16 additions and 6 deletions. Approved by one reviewer with zero unresolved comments, maintaining 95.27% coverage upon integration. | |
| #723 fix(testing): more intelligent test handling | craft-application | merged | Merged after approval. Updates test handling to run spread tests as root and strictly parse top-level spread.yaml keys. Approved by two reviewers and passed CI checks before integration. | |
| #143 docs: make docs spread-testable | craft-store | merged | Merged documentation spread-testing infrastructure setup. Approved by two reviewers and passing CI, the change modifies six files (+136/-41 lines) to enable local spread test execution for documentation. | |
| #1366 tests(spread): make release test less flaky | charmcraft | merged | Merged changes that reduce flakiness in the spread release test, resolving issue #1362. Approved by two reviewers, the update modifies one file (+17/-7) after addressing feedback. | |
| #665 Start using `spread` for integration tests | charmcraft | closed | Completed and merged via pull request #862, which implemented the spread infrastructure and added integration tests. The issue was closed after the changes were successfully integrated. | |
| #1029 fix(testing): error early if spread.yaml is invalid. | craft-application | merged | Merged after two approvals. Adds early validation to fail tests immediately if spread.yaml is invalid. CI passed except for an unrelated snap-test failure, which was overridden. | |
| #299 refactor(spread): prototype spread extension | fetch-service | merged | Merged after two approvals. Refactored test suites to use the spread extension mechanism, dynamically generating spread.yaml before execution. Resolves #291. Modified 14 files, +325/-317 lines. |