[bug] Error: failed to solve: rpc error: code = Unknown desc = content digest sha256:...: not found #101

2019-07-08T14:54:40Z

Summary

This error occurs randomly, and causes a build to fail when otherwise it would have succeeded. On re-running the exact same build, the error goes away.

Environment

docker-buildx version: standalone binary downloaded from https://github.com/docker/buildx/releases/download/v0.2.2/buildx-v0.2.2.linux-amd64 (sha256 5c31e171440213bb7fffd023611b1aaa7e0498162c54cb708c2a8abe3679717e)

Docker engine version:

Server: Docker Engine - Community
 Engine:
  Version:          18.09.6
  API version:      1.39 (minimum version 1.12)
  Go version:       go1.10.8
  Git commit:       481bc77
  Built:            Sat May  4 01:59:36 2019
  OS/Arch:          linux/amd64
  Experimental:     false

How to reproduce

Unfortunately, I have not found a way to reproduce it reliably. However it does not seem to be related to the contents of the Dockerfile, since I have reproduced it (accidentally) with two completely unrelated Dockerfiles.

Based on my understanding of the error message, it appears that --load is required to reproduce.

Here is the output of the most recent occurrence:

+ /home/sh/bin/docker-buildx build --load --build-arg user=sh --build-arg uid=1002 --build-arg docker_guid=999 -t dev -
[+] Building 11.1s (54/54) FINISHED
 => [internal] load .dockerignore                                                               0.0s
 => => transferring context: 2B                                                                 0.0s
 => [internal] load build definition from Dockerfile                                            0.1s
 => => transferring dockerfile: 2.30kB                                                          0.0s
 => [internal] load metadata for docker.io/library/alpine:latest                                0.4s
 => [1/49] FROM docker.io/library/alpine@sha256:ca1c944a4f8486a153024d9965aafbe24f5723c1d5c02f  0.0s
 => => resolve docker.io/library/alpine@sha256:ca1c944a4f8486a153024d9965aafbe24f5723c1d5c02f4  0.0s
 => CACHED [2/49] RUN apk update                                                                0.0s
 => CACHED [3/49] RUN apk add openssh                                                           0.0s
 => CACHED [4/49] RUN apk add bash                                                              0.0s
 => CACHED [5/49] RUN apk add bind-tools                                                        0.0s
 => CACHED [6/49] RUN apk add curl                                                              0.0s
 => CACHED [7/49] RUN apk add docker                                                            0.0s
 => CACHED [8/49] RUN apk add g++                                                               0.0s
 => CACHED [9/49] RUN apk add gcc                                                               0.0s
 => CACHED [10/49] RUN apk add git                                                              0.0s
 => CACHED [11/49] RUN apk add git-perl                                                         0.0s
 => CACHED [12/49] RUN apk add make                                                             0.0s
 => CACHED [13/49] RUN apk add python                                                           0.0s
 => CACHED [14/49] RUN apk add openssl-dev                                                      0.0s
 => CACHED [15/49] RUN apk add vim                                                              0.0s
 => CACHED [16/49] RUN apk add py-pip                                                           0.0s
 => CACHED [17/49] RUN apk add file                                                             0.0s
 => CACHED [18/49] RUN apk add groff                                                            0.0s
 => CACHED [19/49] RUN apk add jq                                                               0.0s
 => CACHED [20/49] RUN apk add man                                                              0.0s
 => CACHED [21/49] RUN cd /tmp && git clone https://github.com/AGWA/git-crypt && cd git-crypt   0.0s
 => CACHED [22/49] RUN apk add go                                                               0.0s
 => CACHED [23/49] RUN apk add coreutils                                                        0.0s
 => CACHED [24/49] RUN apk add python2-dev                                                      0.0s
 => CACHED [25/49] RUN apk add python3-dev                                                      0.0s
 => CACHED [26/49] RUN apk add tar                                                              0.0s
 => CACHED [27/49] RUN apk add vim                                                              0.0s
 => CACHED [28/49] RUN apk add rsync                                                            0.0s
 => CACHED [29/49] RUN apk add less                                                             0.0s
 => CACHED [30/49] RUN pip install awscli                                                       0.0s
 => CACHED [31/49] RUN curl --silent --location "https://github.com/weaveworks/eksctl/releases  0.0s
 => CACHED [32/49] RUN curl https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-  0.0s
 => CACHED [33/49] RUN curl -L -o /usr/local/bin/kubectl https://storage.googleapis.com/kubern  0.0s
 => CACHED [34/49] RUN curl -L -o /usr/local/bin/kustomize  https://github.com/kubernetes-sigs  0.0s
 => CACHED [35/49] RUN apk add ruby                                                             0.0s
 => CACHED [36/49] RUN apk add ruby-dev                                                         0.0s
 => CACHED [37/49] RUN gem install bigdecimal --no-ri --no-rdoc                                 0.0s
 => CACHED [38/49] RUN gem install kubernetes-deploy --no-ri --no-rdoc                          0.0s
 => CACHED [39/49] RUN apk add npm                                                              0.0s
 => CACHED [40/49] RUN npm config set unsafe-perm true                                          0.0s
 => CACHED [41/49] RUN npm install -g yarn                                                      0.0s
 => CACHED [42/49] RUN npm install -g netlify-cli                                               0.0s
 => CACHED [43/49] RUN apk add libffi-dev                                                       0.0s
 => CACHED [44/49] RUN pip install docker-compose                                               0.0s
 => CACHED [45/49] RUN apk add shadow sudo                                                      0.0s
 => CACHED [46/49] RUN echo '%wheel ALL=(ALL) NOPASSWD: ALL' > /etc/sudoers                     0.0s
 => CACHED [47/49] RUN useradd -G docker,wheel -m -s /bin/bash -u 1002 sh                       0.0s
 => CACHED [48/49] RUN groupmod -o -g 999 docker                                                0.0s
 => CACHED [49/49] WORKDIR /home/sh                                                             0.0s
 => ERROR exporting to oci image format                                                        10.5s
 => => exporting layers                                                                         0.6s
 => => exporting manifest sha256:97c8dedb84183d0d87b6c930b12e1b9396bb81fd9c6587fe2fbb9ae092d30  0.0s
 => => exporting config sha256:ef15b3f6a374fd494a0a586f7b33ac9435953460776e268b20f2eee5f14def6  0.0s
 => => sending tarball                                                                          9.6s
 => importing to docker                                                                         0.0s
------
 > exporting to oci image format:
------
Error: failed to solve: rpc error: code = Unknown desc = content digest sha256:ef15b3f6a374fd494a0a586f7b33ac9435953460776e268b20f2eee5f14def65: not found
Usage:
  /home/sh/bin/docker-buildx build [OPTIONS] PATH | URL | - [flags]

Aliases:
  build, b

Flags:
      --add-host strings         Add a custom host-to-IP mapping (host:ip)
      --build-arg stringArray    Set build-time variables
      --cache-from stringArray   External cache sources (eg. user/app:cache, type=local,src=path/to/dir)
      --cache-to stringArray     Cache export destinations (eg. user/app:cache, type=local,dest=path/to/dir)
  -f, --file string              Name of the Dockerfile (Default is 'PATH/Dockerfile')
  -h, --help                     help for build
      --iidfile string           Write the image ID to the file
      --label stringArray        Set metadata for an image
      --load                     Shorthand for --output=type=docker
      --network string           Set the networking mode for the RUN instructions during build (default "default")
      --no-cache                 Do not use cache when building the image
  -o, --output stringArray       Output destination (format: type=local,dest=path)
      --platform stringArray     Set target platform for build
      --progress string          Set type of progress output (auto, plain, tty). Use plain to show container output (default "auto")
      --pull                     Always attempt to pull a newer version of the image
      --push                     Shorthand for --output=type=registry
      --secret stringArray       Secret file to expose to the build: id=mysecret,src=/local/secret
      --ssh stringArray          SSH agent socket or keys to expose to the build (format: default|<id>[=<socket>|<key>[,<key>]])
  -t, --tag stringArray          Name and optionally a tag in the 'name:tag' format
--target string Set the target build stage to build.

The text was updated successfully, but these errors were encountered:

2019-07-08T21:19:09Z

I think I see how this could happen if there are parallel builds that end up building the same image and one ends up finishing with this error during load. Is this case possible in your case?

If not then I need to enable debug logs in buildx cause without them it's very hard to guess what actually happened.

2019-07-09T17:36:27Z

With #102 you can create the builder instance with docker buildx create --buildkitd-flags '--debug' and after this happens use docker logs <buildkit_container> to get the debug logs for the daemon.

2019-07-10T22:00:25Z

I think I see how this could happen if there are parallel builds that end up building the same image and one ends up finishing with this error during load. Is this case possible in your case?

Yes, that is very likely. Both environments where the issue occurred match your description. In fact I am also encountering another issue (issue coming soon) which is definitely related to concurrency.

2019-07-15T17:41:53Z

Thank you!

2020-05-06T11:20:33Z

I think this should be reopen.
I'm having this error quite often when I build. Usually, I just re-run the command until it stop failing. (2-3 times in average).

I'm building for 3 platforms in parallel.

Docker version : 19.03.8, build afacb8b

2020-05-13T09:44:59Z

Same error here:

Screenshot from 2020-05-13 11-38-53

Using docker Docker version 19.03.8, build afacb8b7f0

On a Raspberry Pi with arm32v7 architecture

2020-05-20T13:56:04Z

I think this should be reopen.
I'm having this error quite often when I build. Usually, I just re-run the command until it stop failing. (2-3 times in average).

I'm building for 2 platforms in parallel.

Got the same here https://github.com/eclipse/che-dashboard/actions

2020-05-20T16:21:51Z

Please open a new issue with reproduction steps if you think there is still a way to hit this.

2020-07-19T00:29:34Z

According to https://stackoverflow.com/questions/59868448/rpc-error-code-unknown-desc-failed-to-build-llb this is a resource issue. Indeed, adding another processor and a Gig seems to be working for me. Obviously a better error would be appropriate, at the least.

2020-10-03T00:19:18Z

Just ran into this as well, cross building locally with qemu the docker file was

FROM debian:buster-slim

ENV LANG=C.UTF-8 LC_ALL=C.UTF-8
ENV PATH /opt/conda/bin:$PATH

RUN apt-get update --fix-missing && \
    apt-get install -y wget bzip2 ca-certificates libglib2.0-0 libxext6 libsm6 libxrender1 git mercurial subversion && \
    apt-get clean

COPY setup.sh /setup.sh
RUN /setup.sh
CMD [ "/bin/bash" ]

and the setup file

#!/bin/bash

set -ex
export arch=$(uname -m)
if [ "$arch" == "aarm64" ]; then
  arch="arm64";
fi
wget --quiet https://github.com/conda-forge/miniforge/releases/download/4.8.5-1/Miniforge3-4.8.5-1-Linux-${arch}.sh -O ~/miniforge.sh
chmod a+x ~/miniforge.sh
~/miniforge.sh -b -p /opt/conda
/opt/conda/bin/conda clean -tipsy
ln -s /opt/conda/etc/profile.d/conda.sh /etc/profile.d/conda.sh
echo ". /opt/conda/etc/profile.d/conda.sh" >> ~/.bashrc
echo "conda activate base" >> ~/.bashrc
find /opt/conda/ -follow -type f -name '*.a' -delete
find /opt/conda/ -follow -type f -name '*.js.map' -delete
/opt/conda/bin/conda clean -afy

My build command was: docker buildx build -t holdenk/miniforge3:v0 . --platform linux/amd64,linux/arm64 --push

re-running seems to solve the issue though.

2021-02-13T03:22:05Z

I am getting the same issue too: It happened for arm64

2021-02-13T23:53:49Z

Seeing this as well, building for amd64 and arm64 in parallel

`

ocker versio

In my case, this is failing as a part of a drone build running inside a kubernetes cluster.

2021-02-13T23:57:52Z

This issue has been closed. If you are seeing something similar create a new issue with a reproducer and full version infos.

2021-09-15T03:16:59Z

use docker login you account

2022-02-13T05:30:02Z

I have a Macbook pro with M1 chip.
And I keep getting the same error: failed to solve: rpc error: code = Unknown desc

2022-02-21T11:43:31Z

ERROR [bass-master_ida stage-1 4/24] COPY ida.run /installation/
plase slove thise error

2022-04-20T19:50:36Z

Having same error, im connecting from a different country from where i usually connect so... maybe a vpn related issue?

2022-05-03T16:03:02Z

have the same error on Mac (docker desktop 4.7.1) only arm64 buildx with:

"--load" -> "failed to solve: failed to get reader: content digest sha256:a3...: not found"
"--push" works

2022-11-07T01:01:33Z

I get this error if I use the DigitalOcean "Docker" image, which has an old version of Docker on it. If I use the "Ubuntu" image and install Docker myself, I no longer get this error.

2022-12-09T04:14:21Z

Having the same error randomly...

2023-02-14T00:08:51Z

In case it might help someone else, I ran into the issue because my Dockerfile wasn't in the root of my folder where I was expecting it to be.

2023-02-20T14:43:05Z

I solved this issue by first deleting ~/.docker/config.json then sign in again using sudo docker login. Afterward, I changed the name from Dockerfile to dockerfile and finally tried sudo docker-compose build

2023-07-28T16:27:59Z

Locking this issue. Open a new issue with reproduction steps if you hit this again. Thanks.

shykes changed the title ~~[bug] Error: failed to solve: rpc error: code = Unknown desc~~ [bug] Error: failed to solve: rpc error: code = Unknown desc = content digest sha256:...: not found Jul 10, 2019

tonistiigi added kind/bug Something isn't working buildkit labels Jul 12, 2019

tonistiigi mentioned this issue Jul 12, 2019

exporter: keep lease when exporting images moby/buildkit#1077

Merged

AkihiroSuda closed this as completed in moby/buildkit#1077 Jul 15, 2019

vabene1111 mentioned this issue Apr 13, 2020

Error failed to solve: rpc error: code = Unknown desc = server message: insufficient_scope: authorization failed ilteoood/docker_buildx#7

Closed

tianhaoz95 mentioned this issue Oct 16, 2020

Seems to have failed due to resource issue docker/build-push-action#178

Closed

tamalsaha mentioned this issue Jan 7, 2021

dpkg errors under qemu emulation for arm64 #499

Closed

qinggniq mentioned this issue Feb 6, 2021

docker linux multiarch ci test fails randomly envoyproxy/envoy#14971

Closed

TriplEight mentioned this issue Mar 1, 2021

Overhaul releasing process paritytech/parity-bridges-common#779

Merged

mmorhun mentioned this issue Jul 1, 2021

Build rest-server from source che-dockerfiles/che-backup-server-rest#2

Merged

valeriupredoi mentioned this issue Sep 7, 2021

Automatic builds on DockerHub are failing ESMValGroup/ESMValTool#2276

Closed

juslintek mentioned this issue Sep 9, 2021

[BUG] failed to solve: rpc error: code = Unknown desc = executor failed running #763

Closed

dessalines mentioned this issue Nov 14, 2022

Docker development instructions doesn't work on m1 mac by default LemmyNet/lemmy#2559

Closed

docker locked as resolved and limited conversation to collaborators Jul 28, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[bug] Error: failed to solve: rpc error: code = Unknown desc = content digest sha256:...: not found #101

[bug] Error: failed to solve: rpc error: code = Unknown desc = content digest sha256:...: not found #101

shykes commented Jul 8, 2019 •

edited

tonistiigi commented Jul 8, 2019

tonistiigi commented Jul 9, 2019

shykes commented Jul 10, 2019

shykes commented Jul 15, 2019

kegi commented May 6, 2020 •

edited

MarkCarbonell98 commented May 13, 2020

skabashnyuk commented May 20, 2020

tonistiigi commented May 20, 2020

shaunc commented Jul 19, 2020

holdenk commented Oct 3, 2020

huguesBouvier commented Feb 13, 2021 •

edited

andrewthetechie commented Feb 13, 2021

tonistiigi commented Feb 13, 2021

lei-cheung commented Sep 15, 2021

itspawanhere commented Feb 13, 2022

Amin-asadii commented Feb 21, 2022

cah-iovani-juarezgarcia commented Apr 20, 2022

yvess commented May 3, 2022

alberto56 commented Nov 7, 2022

digitaltim-de commented Dec 9, 2022

sabaimran commented Feb 14, 2023

olahsymbo commented Feb 20, 2023

crazy-max commented Jul 28, 2023

[bug] Error: failed to solve: rpc error: code = Unknown desc = content digest sha256:...: not found #101

[bug] Error: failed to solve: rpc error: code = Unknown desc = content digest sha256:...: not found #101

Comments

shykes commented Jul 8, 2019 • edited

Summary

Environment

How to reproduce

tonistiigi commented Jul 8, 2019

tonistiigi commented Jul 9, 2019

shykes commented Jul 10, 2019

shykes commented Jul 15, 2019

kegi commented May 6, 2020 • edited

MarkCarbonell98 commented May 13, 2020

skabashnyuk commented May 20, 2020

tonistiigi commented May 20, 2020

shaunc commented Jul 19, 2020

holdenk commented Oct 3, 2020

huguesBouvier commented Feb 13, 2021 • edited

andrewthetechie commented Feb 13, 2021

ocker versio

tonistiigi commented Feb 13, 2021

lei-cheung commented Sep 15, 2021

itspawanhere commented Feb 13, 2022

Amin-asadii commented Feb 21, 2022

cah-iovani-juarezgarcia commented Apr 20, 2022

yvess commented May 3, 2022

alberto56 commented Nov 7, 2022

digitaltim-de commented Dec 9, 2022

sabaimran commented Feb 14, 2023

olahsymbo commented Feb 20, 2023

crazy-max commented Jul 28, 2023

shykes commented Jul 8, 2019 •

edited

kegi commented May 6, 2020 •

edited

huguesBouvier commented Feb 13, 2021 •

edited