← Back to issue list

tests: spread tests fail intermittently

View original Github issue

Metadata

Project
rockcraft
Number
#109
Type
issue
State
open
Author
mr-cal
Labels
Status: Triaged Type: Bug
Created
2022-09-29 16:20:44+00:00
Updated
2026-02-26 18:48:48+00:00
Closed

Current evaluation

No evaluation has been recorded for this issue yet.

Issue body

### Overview The spread tests are failing intermittently due to a docker error, `docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?`. ### Details @tigarmo added the [`retry`](https://github.com/canonical/rockcraft/pull/94/files#diff-e1e5ecb5e7fe7aa228c64f680564673541f91452212c3c6c23cbbd27bb78dcedR47) command from [`snapd-testing-tools`](https://github.com/snapcore/snapd-testing-tools/blob/main/tools/retry), but we're still seeing the failure. We have two more ideas: 1. Increase the `retry` timeout 2. [Run `snap logs docker`](https://github.com/canonical/rockcraft/pull/96/files) if docker never starts ### Logs [source](https://github.com/canonical/rockcraft/actions/runs/3152544084/jobs/5128003514) ``` 2022-09-29T15:30:03.8353470Z 2022-09-29 15:30:03 Preparing google:ubuntu-20.04-64 (sep291529-710396)... 2022-09-29T15:30:50.7936227Z 2022-09-29 15:30:50 Error preparing google:ubuntu-18.04-64 (sep291529-710434) : 2022-09-29T15:30:50.7937212Z ----- ... 2022-09-29T15:30:50.8202707Z + snap install docker 2022-09-29T15:30:50.8203825Z docker 20.10.14 from Canonical** installed 2022-09-29T15:30:50.8204725Z + retry -n 10 --wait 2 sh -c 'docker run --rm hello-world' 2022-09-29T15:30:50.8205417Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8206155Z See 'docker run --help'. 2022-09-29T15:30:50.8206755Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8207558Z See 'docker run --help'. 2022-09-29T15:30:50.8208252Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8208953Z See 'docker run --help'. 2022-09-29T15:30:50.8209589Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8210394Z See 'docker run --help'. 2022-09-29T15:30:50.8211104Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8211805Z See 'docker run --help'. 2022-09-29T15:30:50.8212509Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8213310Z See 'docker run --help'. 2022-09-29T15:30:50.8213902Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8214654Z See 'docker run --help'. 2022-09-29T15:30:50.8215310Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8215947Z See 'docker run --help'. 2022-09-29T15:30:50.8216654Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8217364Z See 'docker run --help'. 2022-09-29T15:30:50.8217867Z docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. 2022-09-29T15:30:50.8218561Z See 'docker run --help'. 2022-09-29T15:30:50.8219376Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8220001Z retry: next attempt in 2.0 second(s) (attempt 1 of 10) 2022-09-29T15:30:50.8220713Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8221349Z retry: next attempt in 2.0 second(s) (attempt 2 of 10) 2022-09-29T15:30:50.8222215Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8222833Z retry: next attempt in 2.0 second(s) (attempt 3 of 10) 2022-09-29T15:30:50.8223556Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8224459Z retry: next attempt in 2.0 second(s) (attempt 4 of 10) 2022-09-29T15:30:50.8225376Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8225965Z retry: next attempt in 2.0 second(s) (attempt 5 of 10) 2022-09-29T15:30:50.8227152Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8227788Z retry: next attempt in 2.0 second(s) (attempt 6 of 10) 2022-09-29T15:30:50.8228467Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8228917Z retry: next attempt in 2.0 second(s) (attempt 7 of 10) 2022-09-29T15:30:50.8229547Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8230011Z retry: next attempt in 2.0 second(s) (attempt 8 of 10) 2022-09-29T15:30:50.8230616Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8231159Z retry: next attempt in 2.0 second(s) (attempt 9 of 10) 2022-09-29T15:30:50.8231896Z retry: command sh -c docker run --rm hello-world failed with code 125 2022-09-29T15:30:50.8232682Z retry: command sh -c docker run --rm hello-world keeps failing after 10 attempts 2022-09-29T15:30:50.8233455Z ----- 2022-09-29T15:30:50.8233874Z . 2022-09-29T15:30:50.8234466Z 2022-09-29 15:30:50 Discarding google:ubuntu-18.04-64 (sep291529-710434)... ```

Evaluation history

No evaluation history available.