tests: run tests on Trusty on Travis
Metadata
Current evaluation
Closed unmerged; native Trusty Travis testing and optional image support never landed. Related PR canonical/snapcraft#2011 was also closed unmerged.
Resolution: closed stale
Reason: PR #2013 was closed without merging after roughly eight years, with no reviews, CI checks, or comments. Its two-file change is absent from subsequent run_tests.sh history, and the closely related #2011 was also closed unmerged.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
This PR adds a stage to Travis for running `tests/integration/general`, `tests/integration/store` and `tests.integration.plugins_catkin` on **Trusty** natively - due to [LP: #1628289](https://bugs.launchpad.net/snappy/+bug/1628289/comments/18) we can't use a Trusty container.
The script `tools/travis/run_tests.sh` gains a new optional **image** argument which can currently be `ubuntu:xenial` (the default) or `native` to run the tests on the host.
**Note on testing**: As follows I did some sanity checks. This PR is using Travis to pull in Python 3.6, so tests won't run properly out of the box on Trusty.
I locally tested the scripts like so, on a Trusty VM and Xenial:
- `sudo -H ./tools/travis/run_tests.sh tests/unit ubuntu:xenial`
- `sudo -H ./tools/travis/run_tests.sh tests/unit native`
Manual test steps:
- `sudo -H ./tools/travis/run_tests.sh tests/unit ubuntu:trusty`
- Observe `Invalid image: ubuntu:trusty`
- `sudo -H ./tools/travis/run_tests.sh tests/unit ubuntu:xenial`
- `sudo -H ./tools/travis/run_tests.sh tests/unit`
- `sudo -H ./tools/travis/run_tests.sh tests/unit native`
**Note:** Run these commands before each attempt at running the non-native tests if you're not running from a new machine. Stop any other containers that you may have running, otherwise removing the network device will fail - errors `not found` and `The device doesn't exist` are safe to ignore.
- `lxc delete --force test-runner; lxc network delete testbr0; lxc profile device remove default eth0`
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed stale | Closed unmerged; native Trusty Travis testing and optional image support never landed. Related PR canonical/snapcraft#2011 was also closed unmerged. | |
| stealth/space-bunny-alpha | — | closed stale | Closed unmerged; its native-test image support does not appear in the resulting Travis run_tests.sh history. | |
| qwen/qwen3.6-35b-a3b | — | — | Closed without being merged. The PR proposed adding native Ubuntu Trusty execution for Travis CI tests but received zero reviews or CI checks, indicating it was abandoned. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Closed without merge. The update added native Trusty testing to Travis CI by modifying the test runner script to support a native image argument. Likely abandoned or superseded. |
Update history
No update history recorded yet.
Related work
-
Related To:
canonical/snapcraft#2011
(confidence 98%)
Same-title predecessor proposing native Trusty Travis testing; it was also closed unmerged.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #2011 tests: run tests on Trusty on Travis | snapcraft | closed | Closed unmerged; snapcraft#2013 proposed the same native Trusty Travis coverage and Python 3.4 compatibility updates, but none landed. | |
| #1992 tests: run integration tests on trusty | snapcraft | closed | Closed unmerged; superseded by snapcraft#2013, which also closed unmerged, so native Trusty integration tests were never added. | |
| #371 travis: run the tests in the GCE trusty machine | snapcraft | merged | Merged PR #371 as 59631c283, removing the slow, timing-out Xenial LXC Travis workaround and running tests on GCE Trusty now that Jenkins covers them. | |
| #1532213 Run the tests in xenial | snapcraft (launchpad) | closed | Travis tests moved to a Xenial Docker container via merged snapcraft#597 (ee28121ba), replacing the reverted LXC attempt from #202. | |
| #1411 tests: build the snapcraft snap in travis tests | snapcraft | merged | Merged #1411 via commit 92c1e43b1, adding Travis coverage that builds the Snapcraft snap after LXD test infrastructure landed in #1415. |