create new Spread task for daily compatibility matrix testing
Metadata
Current evaluation
Feature request to add a dedicated daily spread test that runs rockcraft pack across multiple LXD/multipass/docker versions to catch dependency breakage early. Maintainer discussion on 2024-08-08; no implementation found in current codebase.
Suggested action: keep open
Reason: The issue was discussed by maintainers (tigarmo raised maintenance-burden concerns, cjdcordeiro responded with rationale) but no PR or commit implementing a dedicated compatibility-matrix spread task was found in the repo. The spread workflow does run on a schedule (cron 0 0 */2 * *) but only tests the current LXD version, not a matrix of versions. The underlying need (catching LXD/multipass breakage) remains valid given ongoing spread test churn in the repo.
Issue body
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.8-27b |
Impact:
45
Quick Win:
20.25
Staleness:
75
Complexity:
55
Confidence:
70
Support Request:
5
|
keep open | Feature request to add a dedicated daily spread test that runs rockcraft pack across multiple LXD/multipass/docker versions to catch dependency breakage early. Maintainer discussion on 2024-08-08; no implementation found in current codebase. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
90
Complexity:
45
Confidence:
85
Support Request:
10
|
needs triage | Proposal to add a daily Spread test for dependency compatibility matrix. Maintainer discussion highlights trade-offs between early breakage detection and maintenance burden. Currently open with no labels or assignee. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
90
Complexity:
60
Confidence:
75
Support Request:
10
|
needs triage | Proposal to add a daily Spread task testing rockcraft compatibility across dependency versions. Unlabelled, no maintainer response, and inactive for nearly two years. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
85
Complexity:
50
Confidence:
80
Support Request:
10
|
needs triage | Proposal to add a daily Spread test running rockcraft pack across dependency versions to catch upstream breakage early. Currently open with no labels, last discussed ~1.9 years ago regarding maintenance trade-offs. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
85
Complexity:
35
Confidence:
75
Support Request:
5
|
close stale | Proposes a daily Spread test matrix to verify Rockcraft compatibility with LXD, multipass, and docker. Maintainer advocates for early issue detection, while a contributor cites maintenance overhead. Currently under discussion with no implementation. |
Update history
No update history recorded yet.
Related work
-
Related To:
canonical/rockcraft#694
(confidence 60%)
PR that pinned spread tests to LXD 5.21/candidate — related to the LXD version dependency this issue wants to test across
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1962 Spread test the documentation examples | charmcraft | open | Feature request to add spread tests for documentation examples (like Rockcraft) to prevent them from becoming outdated. Open since 2023, no labels/assignees, only a Jira-sync bot comment; no evidence of implementation. | |
| #109 tests: spread tests fail intermittently | rockcraft | open | Rockcraft spread tests intermittently fail because the docker snap daemon never starts in test VMs, and the retry loop is insufficient. Feb 2026 triage confirmed the same pattern is still in spread.yaml; a fix (diagnostics on failure) is suggested but no PR proposed. |