ci: enable and stabilize multipass tests in QA
Metadata
Current evaluation
Enables and stabilizes multipass integration tests in CI by updating qa.yaml, Makefile, and test assertions. CI passing, 4 unresolved review comments, 0 reviewers assigned.
Suggested action: needs review
Reason: The PR has 4 unresolved review comments with 0 reviewers assigned, indicating review is pending but incomplete. CI checks are all passing and the changes come from a maintainer, but the unresolved review comments must be addressed before merge.
Impact:
35
Quick Win:
26.25
Staleness:
45
Complexity:
25
Confidence:
65
Issue body
Summary: Enable and stabilize Multipass integration testing in CI by focusing QA on test-multipass and fixing test-side issues exposed by this mode.
Changes:
- Keep only test-multipass enabled in qa.yaml for this branch.
- Run slow multipass tests on self-hosted-linux-amd64-resolute-large.
- Disable LXD setup for this job (use-lxd false).
- Make setup-tests depend on install-multipass via Makefile.
- Wait for multipassd readiness before running tests.
- Dump multipass diagnostics on readiness timeout.
- Fix multipass integration test bytes-vs-string assertions.
- Make cache-mount assertion resilient to the documented fallback path.
Goal: make multipass CI runs reliable and actionable.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen3.6-35b-a3b-mtp-q6 |
Impact:
35
Quick Win:
26.25
Staleness:
45
Complexity:
25
Confidence:
65
|
needs review | Enables and stabilizes multipass integration tests in CI by updating qa.yaml, Makefile, and test assertions. CI passing, 4 unresolved review comments, 0 reviewers assigned. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
85
|
needs review | Enables and stabilizes Multipass integration testing in CI by configuring qa.yaml, adjusting runner targets, fixing test assertions, and adding readiness checks. Currently pending maintainer review with 4 unresolved comments and 2 failing CI jobs. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
90
|
needs review | Enables and stabilizes Multipass integration tests in CI by updating qa.yaml, adding readiness checks, and fixing test assertions. Currently pending maintainer review with four unresolved comments and two failing CI checks on slow multipass jobs. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
90
|
needs review | Enables and stabilizes Multipass integration tests in CI by configuring QA workflows, fixing test assertions, and improving readiness checks. Currently pending maintainer review with one unresolved comment and mostly passing CI checks. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
85
|
needs review | Enables and stabilizes Multipass integration testing in CI by focusing QA, fixing test assertions, and improving setup readiness. Currently passing initial checks with several slow tests and policy checks pending. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
90
|
needs review | Enables and stabilizes Multipass integration tests in CI by configuring qa.yaml, adding readiness checks, and fixing assertion failures. Currently pending maintainer review with unresolved comments and several CI checks still running. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
90
|
needs review | Enables and stabilizes Multipass integration testing in CI by configuring QA workflows, fixing test assertions, and improving readiness checks. Currently pending review with 4 unresolved comments and one failing CI check (zizmor). | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
30
Confidence:
90
|
needs review | Enables and stabilizes Multipass integration tests in CI by focusing QA on test-multipass, fixing test assertions, and adjusting Makefile dependencies. Currently pending reviewer approval with slow CI jobs running. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
90
|
needs review | Enables and stabilizes Multipass integration tests in CI by updating qa.yaml, adjusting Makefile dependencies, fixing test assertions, and configuring self-hosted runners. Currently pending review with one unresolved comment and several pending CI checks. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
90
|
needs review | Enables and stabilizes Multipass integration tests in CI by updating QA config, fixing test assertions, and adjusting Makefile dependencies. Currently pending maintainer review with one unresolved comment and multiple CI checks still running. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
90
|
keep open | Temporarily disables most QA CI jobs except test-multipass for debugging multipass runner behavior. Marked as draft, pending maintainer review, with failing security scans and unresolved comments. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
90
|
keep open | Temporarily disables most QA workflow jobs to isolate test-multipass for debugging. Marked as draft, pending review, and explicitly notes it should not be merged until disabled jobs are restored. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
90
|
keep open | Temporarily disables most QA workflow jobs to isolate multipass testing for debugging. Marked as draft, pending review, and explicitly notes it should not be merged until disabled jobs are restored. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
5
Confidence:
90
|
keep open | Temporarily disables most QA workflow jobs to isolate multipass testing for debugging. Marked as draft, not ready for merge, and requires restoring disabled jobs before landing. |
Update history
| Date | Change |
|---|---|
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| created |
Related issues
No related issues found above the similarity threshold.