create new Spread task for daily compatibility matrix testing
Metadata
Current evaluation
Daily Spread matrix testing for LXD, Multipass, and Docker remains under maintainer discussion; supported versions and handling external failures are unresolved.
Suggested action: keep open
Reason: The maintainer explicitly confirmed the goal of quickly detecting upstream changes, while @tigarmo raised an unresolved concern about maintenance and externally caused failures. Scheduled source, docs, and manual Spread runs already exist, but no dependency matrix was found; implementation still requires a supported-version policy and CI design.
Evaluated by: mr-cal-bot
Impact:
55
Quick Win:
11
Complexity:
67
Confidence:
91
Actionability:
59
Issue body
### What needs to get done
Rockcraft has several loose dependencies, like LXD, multipass and docker (for the docs).
It would be good to have a dedicated spread test, with variants, to run a basic `rockcraft pack` on different versions of said dependencies.
Ideally, this test should also be run daily to improve our reaction time to changes happening elsewhere.
### Why it needs to get done
Ref issues:
- https://matrix.to/#/!NPPCseDHKRvSBMUEXN:ubuntu.com/$-vmFv8bAbeJxRHijSyMdCUQ0YobwrQuM5Ft9AzIxpS4?via=ubuntu.com&via=matrix.org&via=kde.org
- https://matrix.to/#/!NPPCseDHKRvSBMUEXN:ubuntu.com/$jGb-V3d53ShKU-ejxpTsT5S8jfaqF1H76fCw6JkW0AA?via=ubuntu.com&via=matrix.org
- https://matrix.to/#/!NPPCseDHKRvSBMUEXN:ubuntu.com/$Y-rD0RdB2Jnj6rQbY1DYj4SuGFPd9rguzpL-JCdkguQ?via=ubuntu.com&via=matrix.org
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha |
Impact:
55
Quick Win:
11
Complexity:
67
Confidence:
91
Actionability:
59
|
keep open | Daily Spread matrix testing for LXD, Multipass, and Docker remains under maintainer discussion; supported versions and handling external failures are unresolved. | |
| qwen/qwen3.6-35b-a3b |
Impact:
35
Quick Win:
13
Complexity:
45
Confidence:
60
Actionability:
65
|
needs triage | Request to create a daily Spread test task for Rockcraft compatibility matrix testing with LXD, multipass, and docker. Open for 772 days with maintenance concerns raised but no resolution. | |
| qwen/qwen3.8-27b |
Impact:
45
Quick Win:
20
Staleness:
75
Complexity:
55
Confidence:
70
Support Request:
5
|
keep open | Feature request to add a dedicated daily spread test that runs rockcraft pack across multiple LXD/multipass/docker versions to catch dependency breakage early. Maintainer discussion on 2024-08-08; no implementation found in current codebase. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
90
Complexity:
45
Confidence:
85
Support Request:
10
|
needs triage | Proposal to add a daily Spread test for dependency compatibility matrix. Maintainer discussion highlights trade-offs between early breakage detection and maintenance burden. Currently open with no labels or assignee. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
90
Complexity:
60
Confidence:
75
Support Request:
10
|
needs triage | Proposal to add a daily Spread task testing rockcraft compatibility across dependency versions. Unlabelled, no maintainer response, and inactive for nearly two years. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
85
Complexity:
50
Confidence:
80
Support Request:
10
|
needs triage | Proposal to add a daily Spread test running rockcraft pack across dependency versions to catch upstream breakage early. Currently open with no labels, last discussed ~1.9 years ago regarding maintenance trade-offs. |
Update history
No update history recorded yet.
Related issues
No related issues found above the similarity threshold.