ci: split QA workflows by runner
Metadata
Current evaluation
Splits QA into qa-github-hosted.yaml and qa-self-hosted.yaml, moving s390x/ppc64el/resolute/jammy-arm64 lanes to self-hosted runners. Maintainer-authored, 0 reviews, idle 148 days; 11 checks failing, all self-hosted lanes.
Suggested action: keep open
Reason: Every one of the 11 failing checks is a self-hosted lane (noble/s390x/edge, noble/ppc64el/edge, resolute/amd64, jammy/arm64/medium, and test-common Minimum dependencies), while all GitHub-hosted lanes pass — pointing at self-hosted runner provisioning/labels, i.e. an external dependency, not a defect in the +147/-24 diff. All GitHub-hosted jobs passing (lint, policy, security scans, ubuntu-22.04/24.04/24.04-arm lanes) confirms the split logic itself is sound. Against that, the base has drifted substantially since: a85b4349/#1568, ec6458af/#1583 (test-flaky job), 12f12816 (ubuntu-26.04 platforms), 585b7237 (permissions) and the d2be519e starbase merge (#1728) all rewrote .github/workflows/qa.yaml after this branch point, so it needs a rebase before it is even reviewable. Kept open rather than closed as stale because no maintainer requested revisions, the author is a maintainer (lengau), 148 days is under the 1-year abandonment bar, and divergence is recoverable by rebase.
Evaluated by: mr-cal-bot
Issue body
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha |
Impact:
32
Quick Win:
3
Complexity:
42
Confidence:
63
Actionability:
18
|
keep open | Splits QA into qa-github-hosted.yaml and qa-self-hosted.yaml, moving s390x/ppc64el/resolute/jammy-arm64 lanes to self-hosted runners. Maintainer-authored, 0 reviews, idle 148 days; 11 checks failing, all self-hosted lanes. | |
| qwen/qwen3.6-35b-a3b |
Impact:
25
Quick Win:
2
Complexity:
15
Confidence:
75
Actionability:
10
|
close stale | Splits QA CI workflows into separate GitHub-hosted and self-hosted runner files. Open for 137 days with no reviewer engagement, 0 comments, and 11 failing CI checks. | |
| qwen/qwen3.8-27b |
Impact:
25
Quick Win:
14
Staleness:
60
Complexity:
45
Confidence:
78
|
needs review | Splits QA workflow into separate GitHub-hosted and self-hosted runner files. 117 days old, zero review activity, 11 CI checks failing on self-hosted platforms (s390x, ppc64el, resolute, arm64). Not yet merged; qa.yaml in repo still unsplit. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
78
Complexity:
42
Confidence:
60
|
close stale | Splits CI QA workflows into separate GitHub-hosted and self-hosted runners. Currently pending review with multiple failing CI checks across various architectures and edge versions. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
65
Complexity:
15
Confidence:
85
|
needs review | Splits QA CI workflows into separate GitHub-hosted and self-hosted runner files. Currently unreviewed and inactive for 63 days. |
Update history
No update history recorded yet.
Related work
-
Related To:
craft-parts#1728
(confidence 72%)
Starbase merge (d2be519e) rewrote .github/workflows/qa.yaml after this PR's base; this PR must rebase to stay applicable.
-
Related To:
craft-parts#1583
(confidence 68%)
ec6458af 'ci: separate flaky tests into their own job' added the test-flaky job to qa.yaml, changing the job set this split is meant to partition.
-
Related To:
craft-parts#1568
(confidence 60%)
a85b4349 replaced the jammy arm64 medium lane that appears in the failing self-hosted checks, so that lane's config has since changed.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #359 ci: use hosted runners for QA | craft-cli | merged | Merged #359 via commit 216b18c, switching QA from self-hosted runners to hosted runners for non-x86 ARM coverage; all checks passed. | |
| #1160 ci(qa): switch to hosted runners | rockcraft | merged | Merged in PR #1160 as commit 0a9a3537, switching unit and integration QA jobs to GitHub-hosted runners to avoid self-hosted CI access issues for external contributors. |