validation-sets sorts integer sequence alphabetically
Metadata
Current evaluation
`snapcraft validation-sets --sequence all` lists sequences lexicographically (1, 10, 11, 2...) instead of numerically. Clear reproducer; two fix PRs (#6339, #6449) were opened and both closed unmerged, so the bug persists.
Suggested action: keep open
Reason: The report is unambiguous and reproducible ("validation set with 10 or more sequences" then `snapcraft validation-sets --name X --sequence all`), and a maintainer (@wanacode) explicitly acknowledged it: "A fix has been submitted in #6339". However, both candidate fixes were closed without merging — #6339 "Closed unmerged after 73 days ... the Canonical CLA check failed" and #6449 "closed unmerged after author requested review ... The underlying bug (issue #6324) remains open" — so the reported behaviour is still unfixed in the codebase and the issue must stay open. Repo source inspection was unavailable in this round (no pinned SHA for snapcraft), which is the main reason confidence is not higher.
Evaluated by: mr-cal-bot
Issue body
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha |
Impact:
32
Quick Win:
23
Complexity:
18
Confidence:
82
Actionability:
86
|
keep open | `snapcraft validation-sets --sequence all` lists sequences lexicographically (1, 10, 11, 2...) instead of numerically. Clear reproducer; two fix PRs (#6339, #6449) were opened and both closed unmerged, so the bug persists. | |
| stealth/space-bunny-alpha |
Impact:
30
Quick Win:
20
Complexity:
20
Confidence:
78
Actionability:
82
|
keep open | `snapcraft validation-sets --sequence all` orders sequence numbers lexicographically (1, 10, 11, 2...) because the store client never sorts; still open after two fix PRs (#6339, #6449) were both closed unmerged. | |
| stealth/space-bunny-alpha |
Impact:
28
Quick Win:
20
Complexity:
15
Confidence:
85
Actionability:
82
|
keep open | `snapcraft validation-sets --sequence all` lists sequences lexicographically (1, 10, 11, 2...) because the store client does not sort. Fix PR #6449 is open awaiting review; earlier PR #6339 was closed unmerged. | |
| stealth/space-bunny-alpha |
Impact:
37
Quick Win:
25
Complexity:
22
Confidence:
96
Actionability:
88
|
keep open | CLI and snapcraft.io list validation-set sequence numbers lexicographically rather than numerically. Proposed fix #6339 was closed unmerged, leaving the bug unresolved. | |
| qwen3.6-35b-a3b-mtp-q6 |
Impact:
55
Quick Win:
47
Staleness:
25
Complexity:
15
Confidence:
75
Support Request:
5
|
keep open | Validation sets command sorts sequence numbers alphabetically instead of numerically. A fix was submitted in PR #6339 but closed due to CLA issues, leaving the bug unfixed. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
20
Confidence:
95
Support Request:
0
|
keep open | Bug: validation-sets command sorts integer sequences alphabetically instead of numerically. Fix submitted in PR #6339. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
5
Complexity:
15
Confidence:
90
Support Request:
5
|
needs triage | Bug report: snapcraft validation-sets command and snapcraft.io sort sequence numbers alphabetically instead of numerically. Open, unlabelled, awaiting maintainer triage. |
Update history
| Date | Change |
|---|---|
| updated |
Related work
-
Related To:
canonical/snapcraft#6449
(confidence 92%)
Second fix PR sorting numerically by sequence plus by name first for both table and JSON output; closed unmerged with no reviewers, bug still open.
-
Related To:
canonical/snapcraft#6339
(confidence 90%)
First fix PR adding a numeric sort on sequence in the store client; closed unmerged after 73 days (CLA check failure), so it did not resolve the issue.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #6449 fix(validation-sets): sort sequences numerically | snapcraft | closed | PR #6449 proposed numeric validation-set sequence sorting for #6324 but was closed unmerged; no merge commit was created and #6324 remains open. |