test: improve integration testing
Metadata
Current evaluation
Merged integration-test improvements in #82 (commits a7fe0b7 and aaa5568). External-fork PRs still skip credentialed Charmhub tests; main runs them.
Resolution: closed resolved
Reason: PR #82 was approved and merged with integration-test improvements recorded in commits a7fe0b7 and aaa5568. The remaining external-fork credential limitation was documented and does not block merged-run testing.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
-----
We should probably get a service account for charmhub, but in the meantime this improves the testing a bit.
Outstanding issue: Charmhub credentials aren't used when running with a PR from an external repository, so it skips tests that require charmhub credentials. However, those tests will run on merge to main.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged integration-test improvements in #82 (commits a7fe0b7 and aaa5568). External-fork PRs still skip credentialed Charmhub tests; main runs them. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged integration-test improvements in #82 via commits a7fe0b7 and aaa5568; credentialed Charmhub tests run on main but are skipped for external PRs. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #82 via commits a7fe0b7 and aaa5568 improved integration testing; external-fork PRs skip credentialed Charmhub tests, while main runs them. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged integration-test improvements (a7fe0b7, aaa5568); external-fork PRs still skip credentialed Charmhub tests, while main runs them. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged improvements to integration testing across eight files. The update works around external fork credential limitations by running full tests only after merging to main. Approved by one reviewer and passed CI. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1540 fix: template integration tests | charmcraft | merged | Merged PR #1540 as commit f3f82031, updating integration-test templates to use charmcraft.yaml instead of metadata.yaml and completing the stalled change from #1468. | |
| #139 tests: Scaffold the Charmhub workflow test | craft-store | merged | Merged PR #139 as b7eb570, adding a Charmhub end-to-end workflow test scaffold that expanded coverage and supported work on #124. | |
| #706 Add integration tests using the snap | charmcraft | closed | Snap-based integration coverage was added through Charmcraft's Spread suite by merged PR canonical/charmcraft#862 (commit 7790c044). |