Please mirror Docker image to somewhere else but Docker Hub #401

Open
opened 2022-10-15 18:33:30 +00:00 by italypaleale · 5 comments

Thanks for the work on Garage :) I am using it with Docker.

The problem I have is that Docker Hub is severely rate-limiting requests these days, and that impacts being able to pull Garage too. They rate-limit based on IPs (especially bad for those of us behind a carrier-grade NAT) and have strict limits on cloud providers too.

Could you please create a mirror of the Docker images somewhere else? A popular option is GitHub Container Registry, but anywhere else could work!

Thanks for the work on Garage :) I am using it with Docker. The problem I have is that Docker Hub is [severely rate-limiting requests](https://docs.docker.com/docker-hub/download-rate-limit/) these days, and that impacts being able to pull Garage too. They rate-limit based on IPs (especially bad for those of us behind a carrier-grade NAT) and have strict limits on cloud providers too. Could you please create a mirror of the Docker images somewhere else? A popular option is GitHub Container Registry, but anywhere else could work!
Owner

Thanks for sharing this issue with us, we will see what we can do :-)
We could directly host a repository on Garage but it could be too resource intensive for us. We could also host our image on Github but we would prefer promoting independant hosting services.

Thanks for sharing this issue with us, we will see what we can do :-) We could directly host a repository on Garage but it could be too resource intensive for us. We could also host our image on Github but we would prefer promoting independant hosting services.
lx added the
Improvement
CI
labels 2022-10-16 19:10:23 +00:00
Author

@quentin thanks for the quick response.

I know some project mirror their images to Quay.io (owned by Red Hat / IBM so not exactly independent either).

@quentin thanks for the quick response. I know some project mirror their images to Quay.io (owned by Red Hat / IBM so not exactly independent either).
Owner

I did some tests with framagit.org but they deactivated the container registry features some months ago: https://framacolibri.org/t/plus-de-repos-sur-framagit/14321

We might ask tedomum.net if it's ok to use their Gitlab container registry but they plan to migrate to a similar infrastructure as ours, so if it's a problem for us, it will be a problem for them in the future.

We can try to host directly our Garage Docker image, after all, we are already hosting the raw binary. If we do that, I think we should add some rate limiting (sorry ^^) because I am affraid of non-optimized CI and orchestrators that will pull our images every 10 seconds. On the positive side however, our image is very small as it contains only a compressed binary which results in a 19MB file.

I have started patching Docker's container registry to add some support for LDAP authentication here: https://git.deuxfleurs.fr/Deuxfleurs/capitainerie
We could also add a rate limiting module here and finally deploy it.

What's your opinion about that @LX (and the others)?

I did some tests with framagit.org but they deactivated the container registry features some months ago: https://framacolibri.org/t/plus-de-repos-sur-framagit/14321 We might ask tedomum.net if it's ok to use their Gitlab container registry but they plan to migrate to a similar infrastructure as ours, so if it's a problem for us, it will be a problem for them in the future. We can try to host directly our Garage Docker image, after all, we are already hosting the raw binary. If we do that, I think we should add some rate limiting (sorry ^^) because I am affraid of non-optimized CI and orchestrators that will pull our images every 10 seconds. On the positive side however, our image is very small as it contains only a compressed binary which results in a 19MB file. I have started patching Docker's container registry to add some support for LDAP authentication here: https://git.deuxfleurs.fr/Deuxfleurs/capitainerie We could also add a rate limiting module here and finally deploy it. What's your opinion about that @LX (and the others)?
Contributor

Does this work? Apparently it does now... I got a 500 error trying to leave a comment or create a new issue. Anyway, I have a mirror of the dxflrs Docker Hub if anyone wants to use it. Just add registry.bottled.codes as the registry. Interestingly, the backing storage is garage ;)

Does this work? Apparently it does now... I got a 500 error trying to leave a comment or create a new issue. Anyway, I have a mirror of the `dxflrs` Docker Hub if anyone wants to use it. Just add `registry.bottled.codes` as the registry. Interestingly, the backing storage is garage ;)

SUSE runs free Open Build service (https://build.opensuse.org/), part of which is a registry of containers build by this service (https://registry.opensuse.org/cgi-bin/cooverview).

In "Home"" section, you can see images created by individual users. In section "Official" are images for their new linux distro called MicroOS (https://microos.opensuse.org/).

This can be considered as a good alternative for Docker Hub.

MicroOS+garage looks very interesting and I plan to try it out.

SUSE runs free **Open Build service** (https://build.opensuse.org/), part of which is a registry of containers build by this service (https://registry.opensuse.org/cgi-bin/cooverview). In "Home"" section, you can see images created by individual users. In section "Official" are images for their new linux distro called **MicroOS** (https://microos.opensuse.org/). This can be considered as a good alternative for Docker Hub. MicroOS+garage looks very interesting and I plan to try it out.
Sign in to join this conversation.
No Milestone
No Assignees
4 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: Deuxfleurs/garage#401
No description provided.