Package service integration tests fail on non-amd64 architectures
Metadata
Current evaluation
ARM64 CI exposed amd64 assumptions in package/build integration tests; QA remains deliberately restricted to amd64 with an explicit workaround for this unresolved issue.
Suggested action: keep open
Reason: The report identifies failing tests with exact logs and links the ARM64 CI job. The current QA workflow still explicitly says amd64 is a workaround for #2018 and that ARM64 testing should be enabled after resolution, confirming the bug remains relevant.
Evaluated by: mr-cal-bot
Impact:
40
Quick Win:
21
Complexity:
38
Confidence:
95
Actionability:
84
Issue body
### Bug Description
We have 'amd64' hardcoded in some of the package service integration tests that cause them to fail on other architectures.
### To Reproduce
https://github.com/canonical/charmcraft/actions/runs/12205703353/job/34053604513?pr=2015
### Environment
Canonical hosted GH CI, arm64
### charmcraft.yaml
```yaml
n/a
```
### Relevant log output
```shell
=========================== short test summary info ============================
FAILED tests/integration/commands/test_pack.py::test_build_basic_charm[platforms-jammy-charm] - IndexError: list index out of range
FAILED tests/integration/services/test_package.py::test_write_metadata[complex-legacy] - RuntimeError: Could not determine run-on bases.
FAILED tests/integration/services/test_package.py::test_write_metadata[basic] - check charmcraft-version: 3.0-test-version
charmcraft-started-at: '2020-03-14T00:00:00+00:00'
bases:
- name: ubuntu
channel: '22.04'
architectures:
- arm64
analysis:
attributes:
- name: language
result: unknown
- name: framework
result: unknown
== charmcraft-version: 3.0-test-version
charmcraft-started-at: '2020-03-14T00:00:00+00:00'
bases:
- name: ubuntu
channel: '22.04'
architectures:
- amd64
analysis:
attributes:
- name: language
result: unknown
- name: framework
result: unknown
test_package.py:69 in test_write_metadata() -> pytest_check.equal((test_prime_dir / file.name).read_text(), file.read_text())
------------------------------------------------------------
Failed Checks: 1
FAILED tests/integration/services/test_package.py::test_write_metadata[complex-self-contained] - RuntimeError: Could not determine run-on bases.
FAILED tests/integration/services/test_package.py::test_write_metadata[basic-reactive] - check charmcraft-version: 3.0-test-version
charmcraft-started-at: '2020-03-14T00:00:00+00:00'
bases:
- name: ubuntu
channel: '22.04'
architectures:
- arm64
analysis:
attributes:
- name: language
result: unknown
- name: framework
result: unknown
== charmcraft-version: 3.0-test-version
charmcraft-started-at: '2020-03-14T00:00:00+00:00'
bases:
- name: ubuntu
channel: '22.04'
architectures:
- amd64
analysis:
attributes:
- name: language
result: unknown
- name: framework
result: unknown
test_package.py:69 in test_write_metadata() -> pytest_check.equal((test_prime_dir / file.name).read_text(), file.read_text())
------------------------------------------------------------
Failed Checks: 1
FAILED tests/integration/services/test_package.py::test_overwrite_metadata[complex-legacy] - RuntimeError: Could not determine run-on bases.
FAILED tests/integration/services/test_package.py::test_overwrite_metadata[basic] - check charmcraft-version: 3.0-test-version
charmcraft-started-at: '2020-03-14T00:00:00+00:00'
bases:
- name: ubuntu
channel: '22.04'
architectures:
- arm64
analysis:
attributes:
- name: language
result: unknown
- name: framework
result: unknown
== charmcraft-version: 3.0-test-version
charmcraft-started-at: '2020-03-14T00:00:00+00:00'
bases:
- name: ubuntu
channel: '22.04'
architectures:
- amd64
analysis:
attributes:
- name: language
result: unknown
- name: framework
result: unknown
test_package.py:103 in test_overwrite_metadata() -> pytest_check.equal((test_prime_dir / file.name).read_text(), file.read_text())
------------------------------------------------------------
Failed Checks: 1
FAILED tests/integration/services/test_package.py::test_overwrite_metadata[complex-self-contained] - RuntimeError: Could not determine run-on bases.
FAILED tests/integration/services/test_package.py::test_overwrite_metadata[basic-reactive] - check charmcraft-version: 3.0-test-version
charmcraft-started-at: '2020-03-14T00:00:00+00:00'
bases:
- name: ubuntu
channel: '22.04'
architectures:
- arm64
analysis:
attributes:
- name: language
result: unknown
- name: framework
result: unknown
== charmcraft-version: 3.0-test-version
charmcraft-started-at: '2020-03-14T00:00:00+00:00'
bases:
- name: ubuntu
channel: '22.04'
architectures:
- amd64
analysis:
attributes:
- name: language
result: unknown
- name: framework
result: unknown
test_package.py:103 in test_overwrite_metadata() -> pytest_check.equal((test_prime_dir / file.name).read_text(), file.read_text())
------------------------------------------------------------
Failed Checks: 1
= 9 failed, 2398 passed, 1 skipped, 20 deselected, 1 xfailed, 2078 warnings in 54.37s =
```
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha |
Impact:
40
Quick Win:
21
Complexity:
38
Confidence:
95
Actionability:
84
|
keep open | ARM64 CI exposed amd64 assumptions in package/build integration tests; QA remains deliberately restricted to amd64 with an explicit workaround for this unresolved issue. | |
| qwen/qwen3.6-35b-a3b |
Impact:
30
Quick Win:
14
Complexity:
40
Confidence:
70
Actionability:
80
|
keep open | Integration tests fail on non-amd64 architectures (arm64) due to hardcoded 'amd64' values in test fixtures and expected output files. | |
| qwen/qwen3.8-27b |
Impact:
35
Quick Win:
21
Staleness:
55
Complexity:
40
Confidence:
78
Support Request:
5
|
keep open | Package service integration tests hardcode amd64, causing failures on arm64 CI. Still open; QA workflow limits tests to amd64 as a workaround referencing this issue. No fix merged yet. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
90
Complexity:
30
Confidence:
85
Support Request:
5
|
needs triage | Integration tests fail on non-amd64 architectures due to hardcoded amd64 values. Open for over a year with no maintainer response, labels, or assignee. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
85
Complexity:
25
Confidence:
80
Support Request:
5
|
needs triage | Integration tests for the package service fail on non-amd64 architectures due to hardcoded amd64 references. Open for over a year with no maintainer triage or follow-up beyond an automated Jira sync. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
90
Complexity:
30
Confidence:
80
Support Request:
5
|
needs triage | Package service integration tests fail on non-amd64 architectures due to hardcoded amd64 references. Open for over a year with no maintainer labels or direct responses, only a Jira sync bot comment. |
Update history
No update history recorded yet.
Related work
-
Related To:
canonical/charmcraft#2015
(confidence 99%)
The issue links the ARM64 Actions failure from PR #2015 as its reproducer.
Related issues
No related issues found above the similarity threshold.