coveralls code coverage report is usually wrong
Metadata
Current evaluation
Replaced unreliable Coveralls reporting with Codecov: snapcraft PR #939 (commit e3a71c5e4, released in 2.23) swapped the coverage service and badge, resolving the Launchpad complaint about wrong coverage numbers.
Resolution: closed resolved
Reason: The maintainer comment pointed to codecov.io as a better alternative, and canonical/snapcraft#939 "Replace coveralls with codecov" was merged as commit e3a71c5e4, which changed the CI upload target and badge (noted in the 2.23 release changelog). The bug was closed once Codecov reporting was in place.
Evaluated by: mr-cal-bot
Issue body
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Replaced unreliable Coveralls reporting with Codecov: snapcraft PR #939 (commit e3a71c5e4, released in 2.23) swapped the coverage service and badge, resolving the Launchpad complaint about wrong coverage numbers. | |
| stealth/space-bunny-alpha | — | closed resolved | Coverage reporting was fixed by replacing Coveralls with Codecov in merged PR canonical/snapcraft#939, commit e3a71c5e4. | |
| stealth/space-bunny-alpha | — | closed stale | Closed as stale after years without activity; the inaccurate Coveralls report was abandoned with no fix, replacement, or maintainer explanation recorded. | |
| qwen/qwen3.6-35b-a3b | — | — | Closed without resolution. Coveralls consistently returned inaccurate coverage metrics and poor visualizations. No fix was implemented, and the issue was abandoned. | |
| qwen/qwen3.6-35b-a3b | — | — | Inaccurate Coveralls code coverage reports were documented but the ticket was closed without resolution. No comments or fixes were provided, indicating the problem was abandoned. | |
| qwen/qwen3.6-35b-a3b | — | — | Closed without resolution. The issue reported inaccurate Coveralls code coverage metrics and poor visualization. With zero comments and no implemented fixes, the problem was abandoned. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Abandoned and closed without resolution. The report cited inconsistent Coveralls coverage numbers and poor visualization. No fixes or configuration updates were applied. |
Update history
| Date | Change |
|---|---|
| created |
Related work
-
Likely Fixed By:
canonical/snapcraft#939
(confidence 97%)
Merged PR replacing Coveralls with Codecov, landing as commit e3a71c5e4 and referenced directly in the closing comment.
-
Related To:
canonical/snapcraft#2138
(confidence 35%)
Later commit 57f439a4d "ci: resurrect codecov (#2138)" indicates the Codecov setup needed re-enabling years later.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #939 Replace coveralls with codecov | snapcraft | merged | Merged PR #939 replaced Coveralls with Codecov for test coverage reporting and updated the coverage badge; the change landed as commit e3a71c5e4. |