test: improve integration testing
Metadata
Current evaluation
Merged improvements to integration testing across eight files. The update works around external fork credential limitations by running full tests only after merging to main. Approved by one reviewer and passed CI.
Suggested action: —
No scores available.
Issue body
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
-----
We should probably get a service account for charmhub, but in the meantime this improves the testing a bit.
Outstanding issue: Charmhub credentials aren't used when running with a PR from an external repository, so it skips tests that require charmhub credentials. However, those tests will run on merge to main.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged improvements to integration testing across eight files. The update works around external fork credential limitations by running full tests only after merging to main. Approved by one reviewer and passed CI. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged integration test improvements. External pull requests skip Charmhub credential checks due to repository access limits, but all tests run upon merging to main. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #576 Allow to run a subset of integration tests. | snapcraft | merged | Merged to allow running a subset of integration tests. The change updates four files with minor adjustments (+7/-2 lines). The author requested retests before final merge approval. | |
| #461 test: improve test coverage | fetch-service | merged | Merged to improve test coverage, adding 270 lines across three files. Approved by two reviewers with all CI checks passing. | |
| #76 docs: document getting credentials for integration tests | craft-store | merged | Merged documentation update detailing how to obtain credentials for integration tests. Approved by one reviewer with passing CI checks, adding 19 lines to a single file. | |
| #458 test: improve test coverage | fetch-service | merged | Merged after approval from two reviewers and passing CI checks. Added 370 lines of test code across five files to improve overall test coverage. | |
| #278 tests: additional tests to improve coverage | fetch-service | merged | Merged after two reviews and passing CI checks. Adds additional tests across ten files to improve code coverage, changing +386/-60 lines. | |
| #307 tests: disable broken integration test | craft-application | merged | Merged a temporary workaround disabling a broken integration test to restore CI functionality, pending a permanent fix in issue #306. Approved by two reviewers with passing checks. | |
| #7 tools: Split unit and integration tests | starbase | merged | Merged changes splitting unit and integration tests into separate directories. Approved by one reviewer. The update modifies six files, adding 33 net lines. The integration folder was created solely for structural separation. | |
| #3842 requirements: update | snapcraft | merged | Merged into main after updating project requirements. Approved by a reviewer, passed CI checks, and modified two files. Integration increased test coverage by 0.08%. | |
| #131 build: separate unit and integration tests in CI | craft-application | merged | Merged into main. Separates unit and integration tests in CI to improve readability and fix log rotation conflicts. Scope was narrowed from parallel execution to simply splitting test categories. Approved and passed checks. | |
| #56 Add a fuller integration test, and multiple minor changes to support it | craft-archives | merged | Merged. Added a comprehensive integration test for repo.install() with minor supporting changes across seven files. Approved, passed CI, and achieved 100% diff coverage. Resolves CRAFT-1649 and CRAFT-1682. |