← Back to issue list

ci: separate flaky tests into their own run

View original Github issue

Metadata

Project
craft-application
Number
#1088
Type
pull request
State
merged
Author
lengau
Labels
Created
Updated
Closed

Current evaluation

Merged changes that isolate flaky tests into a dedicated CI workflow, streamlining re-execution after network disruptions. Approved by two reviewers with all checks passing across multiple OS and Python versions.

Suggested action:

No scores available.

Issue body

This should make it quicker and easier to re-run flaky tests once the network issue breaking them is resolved. - [x] Have you followed the guidelines for contributing? - [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)? - [x] Have you successfully run `make lint && make test`? - [ ] Have you added an entry to the changelog (`docs/reference/changelog.rst`)? ---

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.6-35b-a3b Merged changes that isolate flaky tests into a dedicated CI workflow, streamlining re-execution after network disruptions. Approved by two reviewers with all checks passing across multiple OS and Python versions.
qwen3.6-35b-a3b-mtp-q6 Merged a maintainer's pull request isolating flaky tests into a dedicated CI run. This separation simplifies re-executing unstable tests after network issues resolve, streamlining debugging and improving CI workflow efficiency.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#1583 ci: separate flaky tests into their own job craft-parts merged Merged PR isolates flaky tests into a dedicated test-flaky CI job, enabling independent reruns and avoiding full suite re-executions. Approved by two reviewers and merged.
85%
#5899 ci: improve the state of some flaky tests snapcraft merged Merged CI updates fixing flaky tests. Several unstable tests were resolved, while integration store, remote build, and snapd tests were excluded due to upstream issues. Approved by two reviewers and passed all CI checks before merge.
74%