feat: support testing of multi-artifact projects
Metadata
Current evaluation
⚠️ This summary may be outdated — the issue content or evaluation prompts have changed since this evaluation was made.
Adds CRAFT_ARTIFACT_<name> variables to the spread test environment for each generated artifact, enabling testing of multi-artifact projects like Debcraft. Approved by 2 reviewers; most CI checks still pending, none failing.
Suggested action: needs review
Reason: The PR is 2 days old with last activity 0 days ago, has 2 reviewer approvals and 0 unresolved comments, and no failing CI checks (only pending jobs such as test / Fast tests and lint / files). Per the action guidelines, a PR with sufficient (2) approvals is ready to be landed, so it needs a maintainer to merge once CI completes. Confidence is slightly tempered because the diff itself could not be inspected directly and the majority of CI jobs are still pending.
Impact:
45
Quick Win:
29.25
Staleness:
5
Complexity:
35
Confidence:
80
Issue body
Define` CRAFT_ARTIFACT_<name>` in the spread environment for each artifact
generated by the project. This allows testing in tools that can generate multiple
artifacts, such as Debcraft.
- [ ] Have you followed the guidelines for contributing?
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [ ] Have you successfully run `make lint && make test`?
- [ ] Have you added an entry to the changelog (`docs/reference/changelog.rst`)?
---
CRAFT-5257
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.8-27b |
Impact:
45
Quick Win:
29.25
Staleness:
5
Complexity:
35
Confidence:
80
|
needs review | Adds CRAFT_ARTIFACT_<name> variables to the spread test environment for each generated artifact, enabling testing of multi-artifact projects like Debcraft. Approved by 2 reviewers; most CI checks still pending, none failing. | |
| qwen/qwen3.8-27b |
Impact:
45
Quick Win:
27.0
Staleness:
5
Complexity:
40
Confidence:
75
|
needs review | Adds CRAFT_ARTIFACT_<name> variables to the spread test environment for each generated artifact, enabling testing of multi-artifact projects like Debcraft. +115/-14 across 5 files; approved by 2 reviewers, CI mostly pending, none failing. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
20
Confidence:
95
|
needs review | Adds CRAFT_ARTIFACT_<name> environment variables to enable testing for multi-artifact projects like Debcraft. Currently approved by 2 reviewers with all CI checks passing. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
20
Confidence:
90
|
needs review | Adds support for testing multi-artifact projects by defining CRAFT_ARTIFACT_<name> environment variables in the spread environment. Approved by one reviewer, all CI checks passing, ready for merge. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
90
|
needs review | Adds support for testing multi-artifact projects by defining CRAFT_ARTIFACT_<name> environment variables in the spread environment. Currently pending maintainer review with all CI checks passing. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
15
Complexity:
30
Confidence:
90
|
needs review | Adds support for testing multi-artifact projects by defining CRAFT_ARTIFACT_<name> environment variables in the spread environment. Currently pending maintainer review with passing CI checks. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
0
Complexity:
15
Confidence:
90
|
needs review | Defines CRAFT_ARTIFACT_<name> environment variables in the spread environment to enable testing for multi-artifact projects like Debcraft. Currently awaiting maintainer review with CI checks still running. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
30
Confidence:
90
|
needs review | Adds CRAFT_ARTIFACT_<name> environment variables to support testing multi-artifact projects like Debcraft. Currently awaiting initial maintainer review with some CI checks pending or failing. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
90
|
needs review | Adds environment variables for multi-artifact project testing in spread. Currently pending maintainer review with CI checks passing or pending. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
90
|
needs review | Adds CRAFT_ARTIFACT_<name> environment variables to spread tests for multi-artifact projects like Debcraft. Currently pending maintainer review with unresolved comments and CI checks still running. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
20
Confidence:
85
|
needs review | Adds CRAFT_PROJECT_<name> environment variables to spread tests for multi-artifact projects like Debcraft. Currently pending maintainer review with unresolved comments and failing CI checks on lint and fast tests. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
85
|
needs review | Adds CRAFT_PROJECT_<name> environment variables to support testing multi-artifact projects like Debcraft. Fresh PR with pending CI checks and 2 unresolved review comments. |
Update history
| Date | Change |
|---|---|
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| created |
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #739 feat(testing): set artifact and resource file variables | craft-application | merged | Merged after approval and rebasing. Sets CRAFT_ARTIFACT and CRAFT_RESOURCE_<resource-name> variables during spread.yaml processing, enabling user scripts to reference generated test artifacts and resources. CI checks passed. |