← Back to issue list

fix(test): make endpoint tests less flaky

View original Github issue

Metadata

Project
craft-store
Number
#391
Type
pull request
State
merged
Author
lengau
Labels
Created
Updated
Closed

Current evaluation

Merged changes that stabilize endpoint tests in CI by reducing flakiness on slower machines. Approved with all CI checks passing. Minimal adjustments across two files resolve test instability.

Suggested action:

No scores available.

Issue body

We often get fast test failures because these tests are somewhat flaky in CI (probably due to the machines being slow). This should make them far less flaky. --- - [x] I've followed the [contribution guidelines](https://github.com/canonical/craft-store/blob/main/CONTRIBUTING.md). - [x] I've signed the [CLA](http://www.ubuntu.com/legal/contributors/). - [x] I've successfully run `make lint && make test`. - [ ] I've added or updated any relevant documentation. - [ ] In documents I changed, I [added a meta description](https://canonical-starflow.readthedocs-hosted.com/how-to/add-a-page-meta-description/) if one was missing. - [ ] I've updated the relevant release notes.

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.6-35b-a3b Merged changes that stabilize endpoint tests in CI by reducing flakiness on slower machines. Approved with all CI checks passing. Minimal adjustments across two files resolve test instability.
qwen3.6-35b-a3b-mtp-q6 Merged a fix to reduce endpoint test flakiness in CI caused by slow machines. The changes improve test stability and passed all linting and testing checks.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#2637 unit tests: make lifecycle tests more robust snapcraft merged Merged updates to improve lifecycle unit test robustness. Replaced strict message assertions with flexible checks to prevent fake webserver output from causing false failures. Approved and passed CI.
72%
#5899 ci: improve the state of some flaky tests snapcraft merged Merged CI updates fixing flaky tests. Several unstable tests were resolved, while integration store, remote build, and snapd tests were excluded due to upstream issues. Approved by two reviewers and passed all CI checks before merge.
71%
#1460 fix(tests): make store spread tests less flaky charmcraft merged Merged following approval by two reviewers and successful CI checks. The change resolves issue #1429 by adjusting two files to reduce flakiness in store spread tests, with a net diff of +7/-4 lines.
70%