`charmcraft test` v4.0.1 lost `--list` support
Metadata
Current evaluation
charmcraft test --list regressed in 4.0 after PR #2385 replaced the custom Spread wrapper; v4.0.1 rejects the flag. The issue is reproducible but remains unlabeled and untriaged.
Suggested action: needs triage
Reason: The reporter provides an exact failing command on v4.0.1 and links PR #2385, whose merged commit b7730efc replaced the custom test command and removed its Spread-specific CLI behavior. The compatibility regression and CI use case are clear, but the issue has no labels, maintainer response, or prioritization.
Evaluated by: mr-cal-bot
Impact:
45
Quick Win:
26
Complexity:
36
Confidence:
94
Actionability:
91
Issue body
### Bug Description
Hi,
The `charmcraft test --list` used to work in charmcraft v3 and has lost `--list` in v4.0 ([here](https://github.com/canonical/charmcraft/pull/2385)).
It was a useful wrapper for users for `spread -list`. We used it in CI as well.
It would be nice to restore it. Tnx in advance!
P.S. references:
* https://github.com/jnsgruk/zinc-k8s-operator/pull/389/files
* https://matrix.to/#/!fcfzhmtmKApekMQcxX:ubuntu.com/$rQlo3T7B4KKbixL_WSmvYkaQnNQ3LuqQhQRJuDijmTM?via=ubuntu.com&via=matrix.org
* https://matrix.to/#/!fcfzhmtmKApekMQcxX:ubuntu.com/$-v1EvYDM_cs2pgxZ59AXzTaG1eLTtErCccl_SAZkuaY?via=ubuntu.com&via=matrix.org
### To Reproduce
```
> git clone https://github.com/canonical/postgresql-operator && cd postgresql-operator
> charmcraft test --list
Error: unrecognized arguments: --list
```
### Environment
```
> snap list charmcraft
Name Version Rev Tracking Publisher Notes
charmcraft 4.0.1 7517 latest/stable canonical✓ classic
```
### charmcraft.yaml
```yaml
https://github.com/canonical/postgresql-operator/blob/main/charmcraft.yaml
```
### Relevant log output
```shell
none
```
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha |
Impact:
45
Quick Win:
26
Complexity:
36
Confidence:
94
Actionability:
91
|
needs triage | charmcraft test --list regressed in 4.0 after PR #2385 replaced the custom Spread wrapper; v4.0.1 rejects the flag. The issue is reproducible but remains unlabeled and untriaged. | |
| qwen/qwen3.6-35b-a3b |
Impact:
40
Quick Win:
20
Complexity:
30
Confidence:
75
Actionability:
70
|
keep open | charmcraft test --list flag was removed in v4.0.0 (PR #2385) when switching to upstream test command. Issue requests restoration of this feature used in CI workflows. | |
| qwen/qwen3.8-27b |
Impact:
35
Quick Win:
26
Staleness:
70
Complexity:
25
Confidence:
75
Support Request:
10
|
needs triage | charmcraft test --list was dropped in v4.0.1 when the custom test command was replaced by upstream spread (PR #2385); reporter requests restoring the --list wrapper for CI use. No maintainer response or labels yet. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
85
Complexity:
30
Confidence:
90
Support Request:
10
|
needs triage | charmcraft test --list flag removed in v4.0.1, causing CI failures. Open for 8 months with no maintainer response or labels. Needs triage to assess restoration or alternative. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
85
Complexity:
30
Confidence:
90
Support Request:
10
|
needs triage | charmcraft test --list flag removed in v4.0.1, breaking CI workflows. Issue opened 230 days ago with no maintainer response or labels. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
80
Complexity:
45
Confidence:
80
Support Request:
20
|
needs triage | Reports removal of charmcraft test --list flag in v4.0.1, previously available in v3 and used in CI. Currently unlabelled with no maintainer response after 227 days. |
Update history
No update history recorded yet.
Related work
-
Caused By:
canonical/charmcraft#2385
(confidence 98%)
Merged PR #2385, commit b7730efc, replaced the custom test command with upstream infrastructure and removed --list support.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #2105 Unable to enable spread verbose with `charmcraft test` | charmcraft | open | Request to pass spread's -vv flag through `charmcraft test`; current TestCommand only accepts test expressions and has no maintainer triage yet. | |
| #2130 Unable to use spread artifacts with `charmcraft test` | charmcraft | open | Request to pass spread's -artifacts flag through charmcraft test; TestCommand currently only exposes test expressions. No labels, comments, or maintainer response. |