← Back to issue list

tests: add more charms and bundles to large spread suite

View original Github issue

Metadata

Project
charmcraft
Number
#1217
Type
pull request
State
merged
Author
lengau
Labels
—
Created
Updated
Closed

Current evaluation

Merged #1217 as commit 0f4591a9, expanding the large spread suite with more charms and bundles to broaden breaking-change coverage.

Resolution: closed resolved

Reason: Pull request #1217 was approved and merged as commit 0f4591a9, adding broader spread-test coverage.

Evaluated by: mr-cal-bot

No scores available.

Issue body

This covers a broader set of charms, increasing sensitivity to breaking changes. Manual run of these changes (still including failure from #1215): https://github.com/canonical/charmcraft/actions/runs/5882073645 Progress for #1140 and #1193

Evaluation history

Date Model Scores Action Summary
stealth/space-bunny-alpha — closed resolved Merged #1217 as commit 0f4591a9, expanding the large spread suite with more charms and bundles to broaden breaking-change coverage.
stealth/space-bunny-alpha — closed resolved Merged in #1217 as 0f4591a9, expanding the large spread suite with more charms and bundles to improve detection of breaking changes.
stealth/space-bunny-alpha — closed resolved Merged as 0f4591a9 via #1217, expanding the large spread suite with more charms and bundles to improve detection of breaking changes.
qwen/qwen3.6-35b-a3b — — Merged test expansion adding more charms and bundles to the large spread suite to increase breaking change sensitivity. Approved by two reviewers, passed CI, and addressed timeout configuration queries.
qwen3.6-35b-a3b-mtp-q6 — — Merged additions of more charms and bundles to the large spread test suite, improving breaking change detection. Manual testing verified existing timeout limits were adequate, progressing related tracking issues.

Update history

No update history recorded yet.

Related work

Related issues

Issue Project State Summary Similarity
#1214 tests: add more charms to large spread tests charmcraft closed Closed unmerged after 1,135 days; its large-spread test expansion landed through merged PR canonical/charmcraft#1217 in commit 0f4591a9.
84%
#1324 test(spread): test-deploy charms in large spread tests charmcraft merged Merged PR #1324 via commit a14d6d91, adding test deployment of charms and bundles to large Spread tests.
82%
#889 spread: add large external charm pack tests charmcraft merged Merged PR #889 added scheduled Spread pack tests for large external charms, running Wednesdays and Sundays at midnight; merged as c4de1261.
76%
#1292 test(spread): make library tests register/unregister charms charmcraft merged Merged #1292 in commit 99a5a505, making library spread tests register and unregister charms and fixing store-timeout failures in #1279.
76%
#1198 tests: add charm library multiple versions update test charmcraft merged Merged PR #1198 (commit 154bf5d6) added a 120-line regression test covering updates across multiple charm-library versions, linked to #1020/CRAFT-1916.
74%
#1262 Bundle spread tests are failing charmcraft closed Bundle spread tests were fixed by merged PR #1287 (commit f60186ce), which validated YAML semantically and removed an obsolete charm-path assertion.
72%
#1514 feat(testing): add spread testing template files charmcraft closed Closed unmerged as superseded by #1660 (commit 097a4e9a), which added charmcraft test and Spread templates, plus merged follow-up #1686 (58d36668).
72%
#1287 fix(tests): fixes bundle spread test charmcraft merged Merged PR #1287 (commit f60186ce, CRAFT-2052) fixed the failing bundle spread test by validating YAML with Python and dropping a non-working charm path check, resolving #1262.
72%
#1266 tests(spread): requirements dependencies charmcraft merged Merged PR #1266 at 97d95b39, adding spread tests for requirements-file and charm-dependency combinations; the PR explicitly fixes #1179.
71%