The examples test output is not good
Metadata
Current evaluation
Improve examples test output readability. Fixed by ubuntu-core/snapcraft PR #573, merged as commit fe779919f (pexpect-based snap-build example tests), released in snapcraft 2.12; verified in xenial-updates.
Resolution: closed resolved
Reason: Maintainer linked snapcraft PR #573 in the comment on 2016-06-15; that PR merged as commit fe779919f ('Use pexpect when testing the building of snaps') and the fix was released in snapcraft 2.12, verified by the SRU team, so the bug was marked verification-done.
Evaluated by: mr-cal-bot
No scores available.
Issue body
The results of successful and failed examples tests is not good. It's hard to parse, and doesn't provide all the information needed to understand the steps that lead to an error.
Some things we can do to improve it:
Print the commands executed and their output as they are run.
Print a summary at the end of the execution.
Replace the \n and \t in the output detail with proper white spaces.
[Impact]
* For users, None.
* This change will make it easier to understand the errors introduced by branches in progress.
[Test Case]
* Open the results in the jenkins job and check the output and reports.
[Regression Potential]
* autopkgtests could start failing. This will block the PR from merging into master, so we are covered.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Improve examples test output readability. Fixed by ubuntu-core/snapcraft PR #573, merged as commit fe779919f (pexpect-based snap-build example tests), released in snapcraft 2.12; verified in xenial-updates. | |
| stealth/space-bunny-alpha | — | closed resolved | Improved example-test diagnostics with pexpect. PR #573 merged as fe779919f, and Snapcraft 2.12 was successfully verified in xenial-updates. | |
| stealth/space-bunny-alpha | — | closed stale | No resolving change, duplicate, or maintainer explanation is shown; the output-improvements issue closed without recorded discussion. | |
| qwen/qwen3.6-35b-a3b | — | — | Test output formatting was fixed to print commands, outputs, and summaries with proper whitespace. Changes were implemented, verified, and the issue was closed. | |
| qwen/qwen3.6-35b-a3b | — | — | Implemented improvements to example test output formatting. Commands and outputs now print live, a final summary is displayed, and escape characters are converted to whitespace. Resolved and verified. | |
| qwen/qwen3.6-35b-a3b | — | — | Test output formatting was fixed to print commands, outputs, and summaries with proper whitespace. The changes were implemented, verified, and the issue was closed. |
Update history
| Date | Change |
|---|---|
| created |
Related work
-
Likely Fixed By:
canonical/snapcraft#573
(confidence 95%)
PR referenced directly by the maintainer in a comment; merged as commit fe779919f and released in snapcraft 2.12
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1569401 example tests are failing because they call the old snappy command | snapcraft (launchpad) | closed | Example tests were updated from snappy to snap, fixing Launchpad #1569401 through merged PR ubuntu-core/snapcraft#439 (commit bce446559). |