feat: support testing of multi-artifact projects
Metadata
Current evaluation
Merged in canonical/craft-application#1167 via commit b9159fe7, adding per-artifact CRAFT_ARTIFACT_<name> Spread variables for multi-artifact project testing.
Resolution: closed resolved
Reason: The approved PR merged with all listed CI checks passing. Commit b9159fe7 adds the environment generation, tests, and changelog entry.
Evaluated by: mr-cal-bot
No scores available.
Issue body
Define` CRAFT_ARTIFACT_<name>` in the spread environment for each artifact
generated by the project. This allows testing in tools that can generate multiple
artifacts, such as Debcraft.
- [ ] Have you followed the guidelines for contributing?
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [ ] Have you successfully run `make lint && make test`?
- [ ] Have you added an entry to the changelog (`docs/reference/changelog.rst`)?
---
CRAFT-5257
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged in canonical/craft-application#1167 via commit b9159fe7, adding per-artifact CRAFT_ARTIFACT_<name> Spread variables for multi-artifact project testing. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged canonical/craft-application#1167 (CRAFT-5257), adding CRAFT_ARTIFACT_<name> spread variables for generated artifacts to support multi-artifact testing tools such as Debcraft. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged feature enabling testing for multi-artifact projects by defining CRAFT_ARTIFACT_<name> environment variables in the spread environment. Approved by two reviewers with all CI checks passing. | |
| qwen/qwen3.8-27b |
Impact:
45
Quick Win:
29
Staleness:
5
Complexity:
35
Confidence:
80
|
needs review | Adds CRAFT_ARTIFACT_<name> variables to the spread test environment for each generated artifact, enabling testing of multi-artifact projects like Debcraft. Approved by 2 reviewers; most CI checks still pending, none failing. | |
| qwen/qwen3.8-27b |
Impact:
45
Quick Win:
27
Staleness:
5
Complexity:
40
Confidence:
75
|
needs review | Adds CRAFT_ARTIFACT_<name> variables to the spread test environment for each generated artifact, enabling testing of multi-artifact projects like Debcraft. +115/-14 across 5 files; approved by 2 reviewers, CI mostly pending, none failing. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
20
Confidence:
95
|
needs review | Adds CRAFT_ARTIFACT_<name> environment variables to enable testing for multi-artifact projects like Debcraft. Currently approved by 2 reviewers with all CI checks passing. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
20
Confidence:
90
|
needs review | Adds support for testing multi-artifact projects by defining CRAFT_ARTIFACT_<name> environment variables in the spread environment. Approved by one reviewer, all CI checks passing, ready for merge. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
90
|
needs review | Adds support for testing multi-artifact projects by defining CRAFT_ARTIFACT_<name> environment variables in the spread environment. Currently pending maintainer review with all CI checks passing. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
15
Complexity:
30
Confidence:
90
|
needs review | Adds support for testing multi-artifact projects by defining CRAFT_ARTIFACT_<name> environment variables in the spread environment. Currently pending maintainer review with passing CI checks. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
0
Complexity:
15
Confidence:
90
|
needs review | Defines CRAFT_ARTIFACT_<name> environment variables in the spread environment to enable testing for multi-artifact projects like Debcraft. Currently awaiting maintainer review with CI checks still running. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
30
Confidence:
90
|
needs review | Adds CRAFT_ARTIFACT_<name> environment variables to support testing multi-artifact projects like Debcraft. Currently awaiting initial maintainer review with some CI checks pending or failing. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
90
|
needs review | Adds environment variables for multi-artifact project testing in spread. Currently pending maintainer review with CI checks passing or pending. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
90
|
needs review | Adds CRAFT_ARTIFACT_<name> environment variables to spread tests for multi-artifact projects like Debcraft. Currently pending maintainer review with unresolved comments and CI checks still running. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
20
Confidence:
85
|
needs review | Adds CRAFT_PROJECT_<name> environment variables to spread tests for multi-artifact projects like Debcraft. Currently pending maintainer review with unresolved comments and failing CI checks on lint and fast tests. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
85
|
needs review | Adds CRAFT_PROJECT_<name> environment variables to support testing multi-artifact projects like Debcraft. Fresh PR with pending CI checks and 2 unresolved review comments. |
Update history
| Date | Change |
|---|---|
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| created |
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1120 Handle multi-artifact generation in testing | craft-application | closed | Multi-artifact test support landed in PR #1167 via commit b9159fe7, treating sibling outputs uniformly as artifacts. | |
| #739 feat(testing): set artifact and resource file variables | craft-application | merged | Merged PR #739 added CRAFT_ARTIFACT and CRAFT_RESOURCE_<resource-name> variables for artifact and resource files generated during the test lifecycle. |