feat!(test): switch from the custom test command to upstream
Metadata
Current evaluation
Merged. Replaced the custom test command with the upstream version, resolving #2364. Approved after review with CI passing. Several unrelated spread tests remain known to be broken.
Suggested action: —
No scores available.
Issue body
CHARMCRAFT-631
Fixes #2364
The following spread tests are known to be broken and are unrelated:
- google:ubuntu-20.04-64:tests/spread/smoketests/basic:focal_bases
- google:ubuntu-20.04-64:tests/spread/smoketests/different-dir
- google:ubuntu-20.04-64:tests/spread/smoketests/full-lifecycle:kubernetes
- google:ubuntu-20.04-64:tests/spread/smoketests/full-lifecycle:machine
- google:ubuntu-20.04-64:tests/spread/smoketests/lxd
- google:ubuntu-20.04-64:tests/spread/smoketests/pinned-dependencies
- google:ubuntu-20.04-64:tests/spread/smoketests/reactive:stable
- google:ubuntu-20.04-64:tests/spread/smoketests/reactive:two
- google:ubuntu-22.04-64:tests/spread/dependencies/charmlibs
- google:ubuntu-22.04-64:tests/spread/dependencies/setuptools-scm-python:charm
- google:ubuntu-22.04-64:tests/spread/dependencies/setuptools-scm-python:python
- google:ubuntu-22.04-64:tests/spread/smoketests/basic:focal_bases
- google:ubuntu-22.04-64:tests/spread/smoketests/different-dir
- google:ubuntu-22.04-64:tests/spread/smoketests/full-lifecycle:kubernetes
- google:ubuntu-22.04-64:tests/spread/smoketests/full-lifecycle:machine
- google:ubuntu-22.04-64:tests/spread/smoketests/pinned-dependencies
- google:ubuntu-22.04-64:tests/spread/smoketests/reactive:stable
- google:ubuntu-22.04-64:tests/spread/smoketests/reactive:two
- google:ubuntu-22.04-64:tests/spread/smoketests/help-slug
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged. Replaced the custom test command with the upstream version, resolving #2364. Approved after review with CI passing. Several unrelated spread tests remain known to be broken. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged the switch from the custom test command to the upstream version, resolving #2364. Several unrelated spread tests remain broken. Reviewers approved with a note to add init-test coverage once templates are available. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged the switch from a custom test command to the upstream version, resolving #2364. Several unrelated spread tests remain broken. Init-test coverage will be added once profile templates are available. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #2417 fix: fix a series of breaking spread tests | charmcraft | merged | Merged after fixing multiple breaking spread tests. Commits resolve individual failures, while remaining broken tests are marked non-blocking for core24 migration. Approved by reviewers and merged following CI validation. |