Use `rockcraft test` to test the rocks
Metadata
Current evaluation
Maintainer-filed task to replace/augment spread tests in spread.yaml and CI workflows with `rockcraft test` so built snapcraft rocks are exercised; untouched for 421 days, no labels or discussion.
Suggested action: needs triage
Reason: No labels, zero comments, no assignee and 421 days of inactivity, so there is no sign this has been assessed or prioritised despite the maintainer (lengau) filing it. The body is a one-line directive with no target branch list, no expected test steps and no design spec, and the pinned tree of main contains no spread.yaml or tests/ directory (only .github/workflows/build-rock.yaml running canonical/craft-actions/rockcraft-pack@main), so the work has to be worked out per core2X-Y branch. Upstream rockcraft#181 ('Add testing framework?') is still open, which adds uncertainty about how stable/available `rockcraft test` semantics are.
Evaluated by: mr-cal-bot
Issue body
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha |
Impact:
35
Quick Win:
9
Complexity:
45
Confidence:
62
Actionability:
45
|
needs triage | Maintainer-filed task to replace/augment spread tests in spread.yaml and CI workflows with `rockcraft test` so built snapcraft rocks are exercised; untouched for 421 days, no labels or discussion. | |
| qwen/qwen3.6-35b-a3b |
Impact:
30
Quick Win:
13
Complexity:
40
Confidence:
70
Actionability:
70
|
needs triage | Feature request to update spread.yaml and CI workflows to use the `rockcraft test` command for testing rocks. Open 410 days with no labels or maintainer response. | |
| qwen/qwen3.8-27b |
Impact:
25
Quick Win:
16
Staleness:
88
Complexity:
35
Confidence:
62
Support Request:
5
|
needs triage | Task to update spread.yaml and CI workflows in snapcraft-rocks to use `rockcraft test` for testing rocks. Open ~389 days with no labels, comments, or maintainer assessment; no evidence of implementation found. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
95
Complexity:
30
Confidence:
80
Support Request:
10
|
needs triage | Request to update spread.yaml and CI workflows to use rockcraft test for testing rocks. Open for 348 days with no comments, labels, or maintainer assessment. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
95
Complexity:
15
Confidence:
85
Support Request:
5
|
close stale | Request to update spread.yaml and CI workflows to use rockcraft test. Issue is unlabelled, inactive for over a year, and has zero comments. |
Update history
No update history recorded yet.
Related work
-
Related To:
rockcraft#181
(confidence 80%)
Upstream tracking issue for rockcraft's test command/framework that this downstream CI change depends on; summary states `rockcraft test` was added in a6d1b77a and downstream CI supports its implicit pack-and-test flow
-
Related To:
rockcraft#100
(confidence 40%)
Merged Rockcraft PR printing rockcraft log files after spread failures; touches the same rock-testing-in-spread workflow this issue wants to migrate
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #181 Add testing framework? | rockcraft | open | Rockcraft now exposes an upstream-backed rockcraft test command for built-rock testing; commit a6d1b77a added it, and downstream CI supports its implicit pack-and-test flow. | |
| #85 test: cleanup test now that we have a new enough snapcraft | snapcraft-rocks | merged | Merged in snapcraft-rocks#85, removing six obsolete test lines after upgrading past the stable Snapcraft behavior delivered by canonical/snapcraft#4666. | |
| #63 spread: add some basic docs on running spread | rockcraft | merged | Merged canonical/rockcraft#63, adding basic instructions for running spread tests with submodules, a rockcraft snap, and snapd-spread access. | |
| #118 feat: pack snapcraft 9 for core26 | snapcraft-rocks | open | Maintainer cmatsuoka adds an experimental rockcraft.yaml plus CI/workflow changes (+179/-3, 3 files) so the build rock can pack with Snapcraft 9 against core26. Open 13 days, unreviewed (0 reviewers), CLA passing, build-rock check still pending. | |
| #174 tests: check before handling rockcraft instances | rockcraft | merged | Merged PR #174 added an existence check before Rockcraft LXC instance cleanup, so spread tests that create no instances no longer fail during teardown. |