S3-compatible object store for small self-hosted geo-distributed deployments
Find a file
Alex Auvolat 390a5d97fe nix, ci: build with Crane
This removes our dependency on cargo2nix, which was causing us some
issues. Whereas cargo2nix creates one Nix derivation per crate, Crane
uses only two derivations:

1. Build dependencies only
2. Build the final binary

This means that during the second step, no caching can be done. For
instance, if we do a change in garage_model, we need to recompile all of
the Garage crates including those that do not depend on garage_model.
On the upside, this allows all of the Garage crates to be built at once
using cargo build logic, which is optimized for high parallelism and
better pipelining between all of the steps of the build. All in all,
this makes most builds faster than cargo2nix.

A few other changes have been made to the build scripts and CI:

- Unit tests are now run within a Nix derivation. In fact, we have
  different derivations to run the tests using LMDB and Sqlite as
  metadata db engines.

- For debug builds, most CI steps now run in parallel (with the notable
  exception of the smoke test that runs after the build, which is
  inevitable).

- We no longer pass the GIT_VERSION argument when building debug builds
  and running the tests. This means that dev binaries and test
  binaries don't know the exact version of Garage they are from. That
  shouldn't be an issue in most cases.

- The not-dynamic.sh scripts has been fixed to fail if the file does not
  exist.
2025-02-03 16:39:50 +01:00
.woodpecker nix, ci: build with Crane 2025-02-03 16:39:50 +01:00
doc Update doc/book/operations/multi-hdd.md 2025-01-29 13:40:41 +00:00
nix nix, ci: build with Crane 2025-02-03 16:39:50 +01:00
script nix, ci: build with Crane 2025-02-03 16:39:50 +01:00
src nix, ci: build with Crane 2025-02-03 16:39:50 +01:00
.dockerignore Build Docker image 2020-06-30 17:18:42 +02:00
.envrc Implement rpc_secret_file 2023-01-04 18:35:10 +01:00
.gitignore Implement rpc_secret_file 2023-01-04 18:35:10 +01:00
Cargo.lock fix tests 2025-01-31 19:12:51 +01:00
Cargo.toml use cargo-shear to remove many unused dependencies between crates 2025-01-31 18:47:30 +01:00
default.nix nix, ci: build with Crane 2025-02-03 16:39:50 +01:00
Dockerfile nix, ci: build with Crane 2025-02-03 16:39:50 +01:00
flake.lock nix, ci: build with Crane 2025-02-03 16:39:50 +01:00
flake.nix nix, ci: build with Crane 2025-02-03 16:39:50 +01:00
LICENSE Switch to AGPL 2021-03-16 16:35:46 +01:00
Makefile nix, ci: build with Crane 2025-02-03 16:39:50 +01:00
README.md [woodpecker] convert drone pipelines to woodpecker 2024-02-08 18:24:52 +01:00
rustfmt.toml Fix the Sync issue. Details: 2020-04-10 22:01:48 +02:00
shell.nix nix, ci: build with Crane 2025-02-03 16:39:50 +01:00

Garage status-badge

Garage logo

[ Website and documentation | Binary releases | Git repository | Matrix channel ]

Garage is an S3-compatible distributed object storage service designed for self-hosting at a small-to-medium scale.

Garage is designed for storage clusters composed of nodes running at different physical locations, in order to easily provide a storage service that replicates data at these different locations and stays available even when some servers are unreachable. Garage also focuses on being lightweight, easy to operate, and highly resilient to machine failures.

Garage is built by Deuxfleurs, an experimental small-scale self hosted service provider, which has been using it in production since its first release in 2020.

Learn more on our dedicated documentation pages:

Garage is entirely free software released under the terms of the AGPLv3.