← Back to issue list

fix(test): make endpoint tests less flaky

View original Github issue

Metadata

Project
craft-store
Number
#391
Type
pull request
State
merged
Author
lengau
Labels
—
Created
Updated
Closed

Current evaluation

Merged PR #391 as commit c42cd69, updating two test files to reduce endpoint-test flakiness on slow CI machines.

Resolution: closed resolved

Reason: PR #391 was approved, passed all CI checks, and merged as commit c42cd69. Its timing adjustment makes endpoint tests less flaky in slow CI environments.

Evaluated by: mr-cal-bot

No scores available.

Issue body

We often get fast test failures because these tests are somewhat flaky in CI (probably due to the machines being slow). This should make them far less flaky. --- - [x] I've followed the [contribution guidelines](https://github.com/canonical/craft-store/blob/main/CONTRIBUTING.md). - [x] I've signed the [CLA](http://www.ubuntu.com/legal/contributors/). - [x] I've successfully run `make lint && make test`. - [ ] I've added or updated any relevant documentation. - [ ] In documents I changed, I [added a meta description](https://canonical-starflow.readthedocs-hosted.com/how-to/add-a-page-meta-description/) if one was missing. - [ ] I've updated the relevant release notes.

Evaluation history

Date Model Scores Action Summary
stealth/space-bunny-alpha — closed resolved Merged PR #391 as commit c42cd69, updating two test files to reduce endpoint-test flakiness on slow CI machines.
stealth/space-bunny-alpha — closed resolved Merged PR #391 as commit c42cd69, adjusting two test files to reduce endpoint-test flakiness in slow CI environments.
qwen/qwen3.6-35b-a3b — — Merged changes that stabilize endpoint tests in CI by reducing flakiness on slower machines. Approved with all CI checks passing. Minimal adjustments across two files resolve test instability.
qwen3.6-35b-a3b-mtp-q6 — — Merged a fix to reduce endpoint test flakiness in CI caused by slow machines. The changes improve test stability and passed all linting and testing checks.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#1088 ci: separate flaky tests into their own run craft-application merged Merged PR #1088 in commit 6d755f00, splitting flaky slow tests into dedicated test-flaky CI runs for quicker reruns during network outages.
72%
#5899 ci: improve the state of some flaky tests snapcraft merged Merged PR #5899 as commit 9db127202, stabilizing several flaky CI tests; store, remote-build, and snapd-bases failures remained out of scope.
70%