tests: add more charms and bundles to large spread suite
Metadata
Current evaluation
Merged test expansion adding more charms and bundles to the large spread suite to increase breaking change sensitivity. Approved by two reviewers, passed CI, and addressed timeout configuration queries.
Suggested action: —
No scores available.
Issue body
This covers a broader set of charms, increasing sensitivity to breaking changes.
Manual run of these changes (still including failure from #1215): https://github.com/canonical/charmcraft/actions/runs/5882073645
Progress for #1140 and #1193
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged test expansion adding more charms and bundles to the large spread suite to increase breaking change sensitivity. Approved by two reviewers, passed CI, and addressed timeout configuration queries. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged additions of more charms and bundles to the large spread test suite, improving breaking change detection. Manual testing verified existing timeout limits were adequate, progressing related tracking issues. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged after adding more charms and bundles to the large spread test suite to improve breaking change detection. Maintainer confirmed existing timeout settings are sufficient, advancing related tracking issues. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1324 test(spread): test-deploy charms in large spread tests | charmcraft | merged | Merged to add test deployment for charms and bundles in large spread tests. Approved by two reviewers, modified six files with 85 additions and 26 deletions, and linked to a passing CI run. | |
| #1214 tests: add more charms to large spread tests | charmcraft | closed | Adding more charms to large spread tests was closed without merging. Lacking reviewer feedback or CI checks over a year, the changes were abandoned. | |
| #1292 test(spread): make library tests register/unregister charms | charmcraft | merged | Fixed library test failures caused by store timeouts by updating tests to register and unregister charms. Merged following approval from two reviewers, with changes spanning two files (+22/-8 lines). | |
| #889 spread: add large external charm pack tests | charmcraft | merged | Merged changes adding large external charm pack tests to the spread system. Tests run weekly via cron and execute only the pack command. Approved by one reviewer across six modified files. | |
| #1287 fix(tests): fixes bundle spread test | charmcraft | merged | Merged. Resolves issue #1262 and CRAFT-2052 by fixing the bundle spread test. Replaced a failing charm path check with Python-based YAML validation. Approved by two reviewers, passed CI, and successfully executed the large spread test. | |
| #280 ci, spread: add "large spreads" suite | rockcraft | merged | Merged addition of a new large spreads test suite to CI. Configured to run weekly via cron or manually via label. Approved by two reviewers and successfully integrated. | |
| #1198 tests: add charm library multiple versions update test | charmcraft | merged | Merged after approval, adding a test for updating charm library multiple versions. The change introduces 120 lines to address CRAFT-1916 and issue #1020, with zero unresolved review comments. | |
| #1660 feat: add test command and templates | charmcraft | merged | Merged addition of the charmcraft test command and templates. The feature invokes spread to run test suites locally and remotely using a multipass backend. Approved by two reviewers and rebased on main before integration. | |
| #1705 test: extend timeout for some spread tests | charmcraft | merged | Merged changes extending timeouts for specific spread tests to prevent failures from lengthy preparation steps. Approved by reviewers, passed CI, and modified two files. | |
| #1427 tests(spread): make dependencies restore work even if no charm is built | charmcraft | merged | Merged a one-line change ensuring spread test dependencies restore correctly when no charm is built. Approved by two reviewers and successfully integrated. |