feat: add test command and templates
Metadata
Current evaluation
Merged addition of the charmcraft test command and templates. The feature invokes spread to run test suites locally and remotely using a multipass backend. Approved by two reviewers and rebased on main before integration.
Suggested action: —
No scores available.
Issue body
The `charmcraft test` command invokes spread to run test suites on
local and remote machines. A pre-defined spread configuration and
multipass back-end are supplied.
Signed-off-by: Claudio Matsuoka <claudio.matsuoka@canonical.com>
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged addition of the charmcraft test command and templates. The feature invokes spread to run test suites locally and remotely using a multipass backend. Approved by two reviewers and rebased on main before integration. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged the addition of the charmcraft test command and associated templates. The feature enables running spread test suites on local and remote machines using a pre-defined configuration and multipass backend. Rebased on main prior to merge. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged the charmcraft test command and templates. The feature invokes spread to run local and remote test suites using a multipass backend. Rebased on main and integrated by maintainer cmatsuoka. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #869 feat: add 'test' command | rockcraft | merged | Merged. Added the 'test' CLI command and spread tests for rockcraft. Approved by two reviewers, passed CI checks, and introduced 276 lines across seven files to validate the command using hardcoded fixtures. | |
| #1324 test(spread): test-deploy charms in large spread tests | charmcraft | merged | Merged to add test deployment for charms and bundles in large spread tests. Approved by two reviewers, modified six files with 85 additions and 26 deletions, and linked to a passing CI run. | |
| #775 feat: add support to spread test expressions | craft-application | merged | Merged feature adding spread test expression support to the test command. Filters jobs by craft backend and CI host system. Approved by two reviewers and merged despite unreviewed commits and a failing OSV-scanner check. Fixes #748. | |
| #586 feat: add a 'remote-build' command | craft-application | merged | Merged a 'remote-build' command adapted from Charmcraft to be craft-tool-agnostic. Approved by three reviewers and implemented across six files with 331 additions. | |
| #1556 refactor(tests/spread): test with explicit charmcraft.yaml files | charmcraft | merged | Merged a refactor replacing dynamic charmcraft.yaml manipulation during the prepare step with explicit configuration files. Approved by three reviewers, the change simplifies testing for upcoming variants across nine modified files. | |
| #5366 feat: add 'test' command | snapcraft | merged | Merged pull request introducing a new 'test' command. Approved by two reviewers, the change modified eight files with 170 additions and was successfully integrated into the repository. | |
| #1287 fix(tests): fixes bundle spread test | charmcraft | merged | Merged. Resolves issue #1262 and CRAFT-2052 by fixing the bundle spread test. Replaced a failing charm path check with Python-based YAML validation. Approved by two reviewers, passed CI, and successfully executed the large spread test. | |
| #1514 feat(testing): add spread testing template files | charmcraft | closed | Adds Jinja2 template files for machine charm spread testing. After reviewers requested changes and left unresolved comments, the work was closed and superseded by pull requests #1660 and #1686. | |
| #2401 feat(test): add testing profiles for init command | charmcraft | merged | Merged. Adds test-machine and test-kubernetes profiles to the init command for charmcraft test. Fixes #2365. Approved by three reviewers despite failing CI checks. Future updates will integrate jubilant and expand profiles. | |
| #1198 tests: add charm library multiple versions update test | charmcraft | merged | Merged after approval, adding a test for updating charm library multiple versions. The change introduces 120 lines to address CRAFT-1916 and issue #1020, with zero unresolved review comments. |