feat: add test command and templates
Metadata
Current evaluation
Merged as commit 097a4e9a, adding `charmcraft test` with templates for local or remote Spread suites using a Multipass backend.
Resolution: closed resolved
Reason: PR #1660 received approval and was merged into main at commit 097a4e9a, delivering the new test command, predefined Spread configuration, and Multipass backend.
Evaluated by: mr-cal-bot
No scores available.
Issue body
The `charmcraft test` command invokes spread to run test suites on
local and remote machines. A pre-defined spread configuration and
multipass back-end are supplied.
Signed-off-by: Claudio Matsuoka <claudio.matsuoka@canonical.com>
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged as commit 097a4e9a, adding `charmcraft test` with templates for local or remote Spread suites using a Multipass backend. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #1660 (commit 097a4e9a), adding charmcraft test plus templates to run Spread suites locally and remotely with a Multipass backend. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged addition of the charmcraft test command and templates. The feature invokes spread to run test suites locally and remotely using a multipass backend. Approved by two reviewers and rebased on main before integration. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged the addition of the charmcraft test command and associated templates. The feature enables running spread test suites on local and remote machines using a pre-defined configuration and multipass backend. Rebased on main prior to merge. |
Update history
No update history recorded yet.
Related work
-
Related To:
charmcraft#1686
(confidence 100%)
Follow-up PR that fixed argument parsing for the test command introduced here.
-
Related To:
charmcraft#2385
(confidence 100%)
Later PR #2385 replaced the custom test command with upstream craft-application test infrastructure.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1514 feat(testing): add spread testing template files | charmcraft | closed | Closed unmerged as superseded by #1660 (commit 097a4e9a), which added charmcraft test and Spread templates, plus merged follow-up #1686 (58d36668). | |
| #869 feat: add 'test' command | rockcraft | merged | Merged #869 (a6d1b77a), adding the test CLI command and a Spread test with hardcoded files pending init-profile test support. | |
| #1556 refactor(tests/spread): test with explicit charmcraft.yaml files | charmcraft | merged | Merged PR #1556 in commit 4682b32b, replacing prepare-step manipulation of charmcraft.yaml with explicit spread-test configuration files. | |
| #1988 feat: add --verbose flag to pass -vv to spread from charmcraft test | charmcraft | closed | Closed unmerged as superseded by PR #2385 (commit b7730efc), which switched charmcraft test to the upstream test command. | |
| #5366 feat: add 'test' command | snapcraft | merged | Merged as commit 89b946712, adding a new test command with 170 lines across eight files. | |
| #2385 feat!(test): switch from the custom test command to upstream | charmcraft | merged | Merged PR charmcraft#2385 (commit b7730efc) for CHARMCRAFT-631, replacing charmcraft's custom 'test' command with craft-application's upstream test infrastructure; it fixes and closes issue #2364. Some spread tests on 20.04/22.04 still fail. | |
| #2365 Add test configuration templates for charmcraft | charmcraft | closed | Test init profiles delivered by merged PR #2401 (commit a7334d49), adding test-machine and test-kubernetes templates for `charmcraft init`; shipped in Charmcraft 4.0. | |
| #1324 test(spread): test-deploy charms in large spread tests | charmcraft | merged | Merged PR #1324 via commit a14d6d91, adding test deployment of charms and bundles to large Spread tests. |