tests: expect failures for the tests that can't be run in arm64
Metadata
Current evaluation
PR #1145 merged as commit b24e70721, setting expectFailure on tests that cannot run on arm64 in two test files (+32/-3). It superseded the earlier skip-only PR #1119, which was closed unmerged.
Resolution: closed resolved
Reason: The PR itself was merged into snapcraft as b24e70721 with review approval from two reviewers, replacing the abandoned approach in #1119 with expectFailure markers so arm64 autopkgtest runs still exercise the suite. Follow-up concerns were deferred to Launchpad bug #1665165, scheduled for the 2.28 milestone.
Evaluated by: mr-cal-bot
No scores available.
Issue body
LP: [#1662917](https://bugs.launchpad.net/snapcraft/+bug/1662917)
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | PR #1145 merged as commit b24e70721, setting expectFailure on tests that cannot run on arm64 in two test files (+32/-3). It superseded the earlier skip-only PR #1119, which was closed unmerged. | |
| stealth/space-bunny-alpha | — | closed resolved | PR #1145 merged as commit b24e70721: updated two test files to expect failures for tests that cannot run on arm64, superseding the earlier skip-only PR #1119 (closed unmerged) for LP bug #1662917. | |
| stealth/space-bunny-alpha | — | closed resolved | PR #1145 merged as commit b24e70721: updated two test files so arm64-incompatible tests are marked as expected failures instead of being skipped, for LP bug #1662917. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged as b24e70721: updated two test files to expect failures for unsupported arm64 tests, superseding the abandoned skip-only PR #1119. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged. Updated test suite to expect failures on arm64 where execution is unsupported. Changes modify two files to adjust expectations, resolving the bug report. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to configure tests to expect failures on arm64 where execution is unsupported. This aligns the test suite with platform limits, deferring broader arm64 autopkgtest integration and ROS demo updates to later work. |
Update history
No update history recorded yet.
Related work
-
Related To:
canonical/snapcraft#1119
(confidence 90%)
Predecessor PR adding skips for the same arm64-unsupported tests; closed instead of merged.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1119 tests: skip the tests that can't be run in arm64 | snapcraft | closed | Closed unmerged; PR #1145 superseded it and was merged as b24e70721, changing unsupported arm64 tests to expect failure instead of being skipped. | |
| #144 Some tests fail on arm64 | craft-archives | closed | Fixed arm64 test failures by deriving expected APT Architectures from the host architecture; PR #145 merged as 8459563. | |
| #145 fix: fix tests on arm64 | craft-archives | merged | Merged as commit 8459563, fixing arm64 test expectations after prerequisite #143 and resolving #144. |