9

I have these automated builds on Docker Hub:

docker hub automated builds

And for reference, here are both Dockerfiles:

And here's the build log for the arm32v7 build:

Building in Docker Cloud's infrastructure...
Cloning into '.'...
Warning: Permanently added the RSA host key for IP address '192.30.253.113' to the list of known hosts.
Reset branch 'master'
Your branch is up-to-date with 'origin/master'.
Executing build hook...
Sending build context to Docker daemon 88.06kB
Step 1/17 : ARG ALPINE_VERSION="3.8"
Step 2/17 : ARG S6_OVERLAY_VERSION="1.21.7.0"
Step 3/17 : FROM golang:1.11-alpine${ALPINE_VERSION} AS builder
1.11-alpine3.8: Pulling from library/golang
169185f82c45: Pulling fs layer
34c29055ee42: Pulling fs layer
29802c64cdfc: Pulling fs layer
dd82873a5b09: Pulling fs layer
b711937b138a: Pulling fs layer
dd82873a5b09: Waiting
b711937b138a: Waiting
29802c64cdfc: Verifying Checksum
29802c64cdfc: Download complete
34c29055ee42: Verifying Checksum
34c29055ee42: Download complete
b711937b138a: Verifying Checksum
b711937b138a: Download complete
169185f82c45: Verifying Checksum
169185f82c45: Download complete
169185f82c45: Pull complete
34c29055ee42: Pull complete
29802c64cdfc: Pull complete
dd82873a5b09: Verifying Checksum
dd82873a5b09: Download complete
dd82873a5b09: Pull complete
b711937b138a: Pull complete
Digest: sha256:9657ef82d7ead12e0c88c7f4708e78b50c5fd3c1893ac0f2f0924ab98873aad8
Status: Downloaded newer image for golang:1.11-alpine3.8
---> be1230a1b343
Step 4/17 : RUN apk update && apk add --no-cache --virtual build-dependencies git && go get -u github.com/nmrshll/gphotos-uploader-cli/cmd/gphotos-uploader-cli && cd /go/src/github.com/nmrshll && rm -rf gphotos-uploader-cli && git clone https://github.com/rfgamaral/gphotos-uploader-cli.git --branch docker && rm -rf oauth2-noserver && git clone https://github.com/rfgamaral/oauth2-noserver.git --branch docker && cd gphotos-uploader-cli/cmd/gphotos-uploader-cli && GOOS=linux GOARCH=amd64 go build -ldflags='-w -s' -o /go/bin/gphotos-uploader-cli && apk del build-dependencies
---> Running in 79c1d68ad8b0
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/community/x86_64/APKINDEX.tar.gz
v3.8.2-53-g53558ad6fc [http://dl-cdn.alpinelinux.org/alpine/v3.8/main]
v3.8.2-53-g53558ad6fc [http://dl-cdn.alpinelinux.org/alpine/v3.8/community]
OK: 9544 distinct packages available
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/community/x86_64/APKINDEX.tar.gz
(1/7) Installing nghttp2-libs (1.32.0-r0)
(2/7) Installing libssh2 (1.8.0-r3)
(3/7) Installing libcurl (7.61.1-r1)
(4/7) Installing expat (2.2.5-r0)
(5/7) Installing pcre2 (10.31-r0)
(6/7) Installing git (2.18.1-r0)
(7/7) Installing build-dependencies (0)
Executing busybox-1.28.4-r3.trigger
OK: 19 MiB in 21 packages
Cloning into 'gphotos-uploader-cli'...
Cloning into 'oauth2-noserver'...
(1/7) Purging build-dependencies (0)
(2/7) Purging git (2.18.1-r0)
(3/7) Purging libcurl (7.61.1-r1)
(4/7) Purging nghttp2-libs (1.32.0-r0)
(5/7) Purging libssh2 (1.8.0-r3)
(6/7) Purging expat (2.2.5-r0)
(7/7) Purging pcre2 (10.31-r0)
Executing busybox-1.28.4-r3.trigger
OK: 5 MiB in 14 packages
Removing intermediate container 79c1d68ad8b0
---> 17b221a9ee49
Step 5/17 : FROM amd64/alpine:${ALPINE_VERSION}
3.8: Pulling from amd64/alpine
169185f82c45: Already exists
Digest: sha256:616d0d0ff1583933ed10a7b3b4492899942016c0577d43a1c506c0aad8ab4da8
Status: Downloaded newer image for amd64/alpine:3.8
---> 491e0ff7a8d5
Step 6/17 : LABEL maintainer="[email protected]"
---> Running in e58b7fcdb220
Removing intermediate container e58b7fcdb220
---> c525e340a42d
Step 7/17 : ARG BUILD_DATE
---> Running in 0a9417e1adcd
Removing intermediate container 0a9417e1adcd
---> 9f6c69125803
Step 8/17 : ARG S6_OVERLAY_VERSION
---> Running in 93a8cd6996b9
Removing intermediate container 93a8cd6996b9
---> 6034d93430da
Step 9/17 : ARG VCS_REF
---> Running in 8f6fc7d81c71
Removing intermediate container 8f6fc7d81c71
---> 74180d38dbc0
Step 10/17 : LABEL org.label-schema.build-date="${BUILD_DATE}" org.label-schema.description="Mass upload media folders to your Google Photos account with this Docker image." org.label-schema.name="rfgamaral/gphotos-uploader" org.label-schema.schema-version="1.0" org.label-schema.vcs-ref="${VCS_REF}" org.label-schema.vcs-url="https://github.com/rfgamaral/docker-gphotos-uploader.git"
---> Running in 08cf19c6f46a
Removing intermediate container 08cf19c6f46a
---> 106104e2ef17
Step 11/17 : ENV GPU_SCHEDULE="0 */8 * * *"
---> Running in edea63c892b9
Removing intermediate container edea63c892b9
---> d69ae92742d2
Step 12/17 : ADD https://github.com/just-containers/s6-overlay/releases/download/v${S6_OVERLAY_VERSION}/s6-overlay-amd64.tar.gz /tmp/
---> a7448cda217f
Step 13/17 : RUN apk update && apk add --no-cache curl && tar xzf /tmp/s6-overlay-amd64.tar.gz -C / && rm -rf /tmp/*
---> Running in 5d9ee7e3941d
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/community/x86_64/APKINDEX.tar.gz
v3.8.2-53-g53558ad6fc [http://dl-cdn.alpinelinux.org/alpine/v3.8/main]
v3.8.2-53-g53558ad6fc [http://dl-cdn.alpinelinux.org/alpine/v3.8/community]
OK: 9544 distinct packages available
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/community/x86_64/APKINDEX.tar.gz
(1/5) Installing ca-certificates (20171114-r3)
(2/5) Installing nghttp2-libs (1.32.0-r0)
(3/5) Installing libssh2 (1.8.0-r3)
(4/5) Installing libcurl (7.61.1-r1)
(5/5) Installing curl (7.61.1-r1)
Executing busybox-1.28.4-r3.trigger
Executing ca-certificates-20171114-r3.trigger
OK: 6 MiB in 18 packages
Removing intermediate container 5d9ee7e3941d
---> 14fc569893de
Step 14/17 : COPY --from=builder /go/bin/gphotos-uploader-cli /usr/local/bin/gphotos-uploader-cli
---> 32fa657de51c
Step 15/17 : COPY rootfs/ /
---> 1639f6e639b4
Step 16/17 : VOLUME ["/config", "/photos"]
---> Running in 440d1d13cd60
Removing intermediate container 440d1d13cd60
---> fd730f9c1ebb
Step 17/17 : ENTRYPOINT ["/init"]
---> Running in 197c889006b2
Removing intermediate container 197c889006b2
---> 4e66fc7b481d
Successfully built 4e66fc7b481d
Successfully tagged rfgamaral/gphotos-uploader:latest-arm32v7
Pushing index.docker.io/rfgamaral/gphotos-uploader:latest-arm32v7...
Done!
Build finished

As you can see, the log only references amd64 and not arm32v7 or armhf which are clearly there in the Dockerfile.arm32v7 file. Why is Docker Hub changing:

  • arm32v7/alpine:${ALPINE_VERSION} to amd64/alpine:${ALPINE_VERSION}
  • s6-overlay-armhf.tar.gz to s6-overlay-amd64.tar.gz
  • GOARCH=arm GOARM=7 to GOARCH=amd64

It's like it's using Dockerfile instead of Dockerfile.arm32v7 but a) that's not what I've picked for "Dockerfile location" in the automated builds configuration and b) Docker Hub Builds section as a "Dockerfile" tab to show the Dockerfile used for the build and it displays the right one.

Is this a bug on Docker Hub or am I doing something wrong?

1
  • 1
    The Dockerfile.arm32v7 file is unascessible. This breaks the question for others viewers
    – EduMelo
    Commented Dec 29, 2020 at 13:36

3 Answers 3

19

I solved my own issue after a bit of research... First, I was making a stupid mistake and second, I was forgetting a very important thing. Here's how I fixed my issues:

The Stupid Mistake

Although I specified different Dockerfiles for each automated build, I also had a build hook which was overwriting the docker build command and it was defaulting to Dockerfile for all builds instead of picking the right file.

Fixed build hook file:

#!/bin/bash

docker build \
    --file "${DOCKERFILE_PATH}" \
    --build-arg BUILD_DATE="$(date -u +"%Y-%m-%dT%H:%M:%SZ")" \
    --build-arg VCS_REF="$(git rev-parse --short HEAD)" \
    --tag "$IMAGE_NAME" \
    .

The Important Thing

Like @JanGaraj mentioned on his answer, Docker Hub runs on amd64 so it can't run binaries for other architectures. How does one build multi-arch images with Docker Hub Automated Builds? With the help of qemu-user-static and more hooks. I found the answer on this GitHub issue but I'll post here the complete answer to my specific use case:

My sample project tree:

.
├── Dockerfile
├── Dockerfile.aarch64
├── Dockerfile.armhf
└── hooks
    ├── build
    ├── post_checkout
    └── pre_build

The post_checkout hook file:

#!/bin/bash

BUILD_ARCH=$(echo "${DOCKERFILE_PATH}" | cut -d '.' -f 2)

[ "${BUILD_ARCH}" == "Dockerfile" ] && \
    { echo 'qemu-user-static: Download not required for current arch'; exit 0; }

QEMU_USER_STATIC_ARCH=$([ "${BUILD_ARCH}" == "armhf" ] && echo "${BUILD_ARCH::-2}" || echo "${BUILD_ARCH}")
QEMU_USER_STATIC_DOWNLOAD_URL="https://github.com/multiarch/qemu-user-static/releases/download"
QEMU_USER_STATIC_LATEST_TAG=$(curl -s https://api.github.com/repos/multiarch/qemu-user-static/tags \
    | grep 'name.*v[0-9]' \
    | head -n 1 \
    | cut -d '"' -f 4)

curl -SL "${QEMU_USER_STATIC_DOWNLOAD_URL}/${QEMU_USER_STATIC_LATEST_TAG}/x86_64_qemu-${QEMU_USER_STATIC_ARCH}-static.tar.gz" \
    | tar xzv

The pre_build hook file:

#!/bin/bash

BUILD_ARCH=$(echo "${DOCKERFILE_PATH}" | cut -d '.' -f 2)

[ "${BUILD_ARCH}" == "Dockerfile" ] && \
    { echo 'qemu-user-static: Registration not required for current arch'; exit 0; }

docker run --rm --privileged multiarch/qemu-user-static:register --reset

The Dockerfile file:

FROM amd64/alpine:3.8
(...)

The Dockerfile.aarch64 file:

FROM arm64v8/alpine:3.8
COPY qemu-aarch64-static /usr/bin/
(...)

The Dockerfile.armhf file:

FROM arm32v6/alpine:3.8
COPY qemu-arm-static /usr/bin/
(...)

That's it!

2
  • I basically followed your steps to build my .NET CORE app for arch ARM32, but still failed. my Dockerfile.armhf is started as: FROM mcr.microsoft.com/dotnet/core/aspnet:3.1.7-buster-slim-arm32v7 AS base COPY qemu-arm-static /usr/bin/ . From the dock hub build logs, i can see the COPY qemu-arm-static /usr/bin/ has succeed. But the last part is always the: [91mstandard_init_linux.go:211: exec user process caused "no such file or directory" and [0mThe command '/bin/sh -c dotnet restore "MyAppMain/Main.csproj"' returned a non-zero code: 1 build hook failed! (1)
    – Shawn
    Commented Aug 28, 2020 at 8:41
  • Prefixing the architecture in the FROM directive is EXACTLY what I was missing and didn’t realize was possible. Thank you! 🙏🏼
    – Vanna
    Commented Dec 28, 2021 at 23:11
4

Nowadays you can also use docker buildx to build for different architectures without having to maintain a separate Dockerfile for each. Building Multi-Architecture Docker Images With Buildx has a description of how that works. Basically, you

  1. register your QEMU simulator in binfmt_misc on the host with the fix-binary flag so that it can run in the container without having to copy it into the container file system
  2. use docker buildx build --platform linux/arm/v7 ... to instruct the builder to build for an architecture different from your build host's
1
  • Be careful not to be lulled into a false sense of security with buildx. Installing dependencies expecting one architecture and then trying to run them on another may result in nasty runtime errors.
    – Vanna
    Commented Dec 28, 2021 at 23:10
3

Docker image golang:1.11-alpine3.8 is multiarch image. List of available architectures:

$ docker run --rm mplatform/mquery golang:1.11-alpine3.8
Image: golang:1.11-alpine3.8
 * Manifest List: Yes
 * Supported platforms:
   - linux/amd64
   - linux/arm/v6
   - linux/arm64
   - linux/386
   - linux/ppc64le
   - linux/s390x

So first problem: platform arm32/v7 is not available for this Docker image. Second problem: Docker daemon will pull platform image, which is the same as the platform of Docker daemon. I guess Docker Hub runs on amd64, so it will choose amd64.

My recommendation: build static linked binary + cross platform Go compiling (GOARCH=arm GOARM=7) + use SCRATCH base image and you will be able to create arm7 also with amd64 Docker.

4
  • If I'm not mistaken I'm doing exactly what you're proposing, only difference is, I'm using alpine instead of scratch and I've picked proper alpine platform for that. Also, that doesn't really explain why the build is changing GOARCH=arm to GOARCH=amd64. One thing is to pick the proper platform based on the system it is running, but another is to actually change the contents of my Dockerfile. That doesn't make sense.
    – rfgamaral
    Commented Feb 7, 2019 at 18:16
  • You are right. Maybe arm32v7/alpine:3.8 is some special image. I'm not able to pull it to my local machine, it is not available. Maybe Docker Hub has chosen some equivalent image (which is amd64).
    – Jan Garaj
    Commented Feb 7, 2019 at 19:10
  • Try arm32v6/alpine:3.8 (it is available), instead of arm32v7/alpine:3.8 to prove this theory. My guess it will fail, because Docker Hub won't be able to run arm32 binaries on amd63 platform.
    – Jan Garaj
    Commented Feb 7, 2019 at 19:18
  • You're right, but that was not my only problem. See my answer for how I fixed my issues. Thanks for your help :)
    – rfgamaral
    Commented Feb 8, 2019 at 15:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.