47e87c8739
Merge pull request 'upgrade Rust compiler and Cargo dependencies' ( #951 ) from nix-crane into main
...
Reviewed-on: Deuxfleurs/garage#951
2025-02-03 17:49:00 +00:00
34599bff51
update all Cargo dependencies except AWS crates and their dependencies
2025-02-03 17:46:54 +01:00
ec1a475923
build with rust 1.82.0
2025-02-03 17:46:48 +01:00
b9df2d1ad1
Merge pull request 'compile with crane' ( #950 ) from nix-crane into main
...
Reviewed-on: Deuxfleurs/garage#950
2025-02-03 15:54:54 +00:00
390a5d97fe
nix, ci: build with Crane
...
This removes our dependency on cargo2nix, which was causing us some
issues. Whereas cargo2nix creates one Nix derivation per crate, Crane
uses only two derivations:
1. Build dependencies only
2. Build the final binary
This means that during the second step, no caching can be done. For
instance, if we do a change in garage_model, we need to recompile all of
the Garage crates including those that do not depend on garage_model.
On the upside, this allows all of the Garage crates to be built at once
using cargo build logic, which is optimized for high parallelism and
better pipelining between all of the steps of the build. All in all,
this makes most builds faster than cargo2nix.
A few other changes have been made to the build scripts and CI:
- Unit tests are now run within a Nix derivation. In fact, we have
different derivations to run the tests using LMDB and Sqlite as
metadata db engines.
- For debug builds, most CI steps now run in parallel (with the notable
exception of the smoke test that runs after the build, which is
inevitable).
- We no longer pass the GIT_VERSION argument when building debug builds
and running the tests. This means that dev binaries and test
binaries don't know the exact version of Garage they are from. That
shouldn't be an issue in most cases.
- The not-dynamic.sh scripts has been fixed to fail if the file does not
exist.
2025-02-03 16:39:50 +01:00
4dc2bc337f
Merge pull request 'woodpecker: use parallel nix-build in debug builds' ( #949 ) from nix-parallel into main
...
Reviewed-on: Deuxfleurs/garage#949
2025-02-01 18:58:15 +00:00
5dd2791981
woodpecker: use parallel nix-build in debug builds
2025-02-01 19:48:01 +01:00
d601f31186
Merge pull request 'split garage_api in garage_api_{common,s3,k2v,admin}' ( #947 ) from split-garage-api into main
...
Reviewed-on: Deuxfleurs/garage#947
2025-02-01 17:48:25 +00:00
e4de7bdfd5
fix ci for more test crates
2025-01-31 19:21:36 +01:00
d18c5ad0ff
fix tests
2025-01-31 19:12:51 +01:00
3d5e9a027e
cargo defs: simplify and fix descriptions
2025-01-31 18:54:29 +01:00
f4ca7758b4
update cargo.nix
2025-01-31 18:48:07 +01:00
4563313f87
use cargo-shear to remove many unused dependencies between crates
2025-01-31 18:47:30 +01:00
afa28706e5
split s3/cors.rs into also common/cors.rs
2025-01-31 18:42:14 +01:00
84f1db91c4
fix things up
2025-01-31 18:34:57 +01:00
9fa20d45be
wip: split garage_api into garage_api_{common,s3,k2v,admin}
2025-01-31 18:18:29 +01:00
9330fd79d3
Merge pull request 'table::insert_many: avoid failure with zero items ( fix #915 )' ( #946 ) from fix-915 into main
...
Reviewed-on: Deuxfleurs/garage#946
2025-01-31 13:10:54 +00:00
83f6928ff7
table::insert_many: avoid failure with zero items ( fix #915 )
2025-01-30 18:06:47 +01:00
ab71544499
Merge pull request 'api: better handling of helper errors to distinguish error codes' ( #942 ) from fix-getkeyinfo-404 into main
...
Reviewed-on: Deuxfleurs/garage#942
2025-01-29 18:25:44 +00:00
991edbe02c
Merge pull request 'Update doc/book/connect/repositories.md' ( #941 ) from yatesco/garage:main into main
...
Reviewed-on: Deuxfleurs/garage#941
2025-01-29 18:18:59 +00:00
9f3c7c3720
api: better handling of helper errors to distinguish error codes
2025-01-29 19:14:34 +01:00
bfde9152b8
Update doc/book/operations/multi-hdd.md
...
trivial spelling mistake
2025-01-29 13:40:41 +00:00
7bb042f0b7
Update doc/book/connect/repositories.md
...
trivial spelling mistake
2025-01-29 13:34:35 +00:00
a1d081ee84
Merge pull request 's3 api: make x-amz-meta-* headers lowercase ( fix #844 )' ( #938 ) from fix-844 into main
...
Reviewed-on: Deuxfleurs/garage#938
2025-01-27 19:32:19 +00:00
e8fa89e834
s3 api: make x-amz-meta-* headers lowercase ( fix #844 )
2025-01-27 19:58:06 +01:00
beedc9fd11
Merge pull request 'snapshot: sqlite: use a subdirectory for consistency with LMDB' ( #932 ) from baptiste/garage:snapshot_consistency_sqlite into main
...
Reviewed-on: Deuxfleurs/garage#932
2025-01-27 18:50:11 +00:00
d4e3e60920
Merge pull request 'update nix crate to 0.29 and libc to 0.2.169' ( #931 ) from neuschaefer/garage:nix into main
...
Reviewed-on: Deuxfleurs/garage#931
2025-01-27 18:09:51 +00:00
Baptiste Jonglez
43402c9619
snapshot: sqlite: use a subdirectory for consistency with LMDB
...
Currently, taking a snapshot of the metadata database with sqlite creates
a sqlite file without extension with the following format:
snapshots/2025-01-26T15:29:17Z
This makes it hard to understand what kind of data this is, and is not
consistent with LMDB:
snapshots/2025-01-26T15:29:17Z/data.mdb
With this change, we now get a directory with a single db.sqlite file:
snapshots/2025-01-26T15:29:17Z/db.sqlite
2025-01-27 19:06:52 +01:00
efa6f3d85e
Merge pull request 'db-snapshot: allow to set directory where snapshots are stored' ( #933 ) from baptiste/garage:configure_metadata_snapshots_dir into main
...
Reviewed-on: Deuxfleurs/garage#933
2025-01-27 18:04:05 +00:00
74a1b49b13
Update Cargo.nix
2025-01-27 18:37:05 +01:00
23d57b89dc
update nix crate to 0.29 and libc to 0.2.169
2025-01-27 18:37:05 +01:00
5e3e1f4453
Merge pull request 'fix problems with CI doing work multiple times' ( #936 ) from woodpecker-simplify into main
...
Reviewed-on: Deuxfleurs/garage#936
2025-01-27 17:36:27 +00:00
Baptiste Jonglez
59c153d280
db-snapshot: allow to set directory where snapshots are stored
...
Fix #926
2025-01-27 18:33:55 +01:00
bb3e0f7d22
nix CI: reduce redundant work
2025-01-27 18:09:51 +01:00
0156e40c9d
Merge pull request 'ci: fix woodpecker definitions to comply with woodpecker 3' ( #935 ) from woodpecker3 into main
...
Reviewed-on: Deuxfleurs/garage#935
Reviewed-by: maximilien <me@mricher.fr>
2025-01-27 12:03:46 +00:00
f6f88065ad
ci: fix woodpecker definitions to comply with woodpecker 3
2025-01-27 12:06:31 +01:00
591bd808ec
Merge pull request 'doc: Fix Nix devenv setup' ( #927 ) from fix_devenv into main
...
Reviewed-on: Deuxfleurs/garage#927
2025-01-23 10:20:04 +00:00
294cb99409
Merge pull request 'Fix all typos' ( #928 ) from majst01/garage:fix-typos into main
...
Reviewed-on: Deuxfleurs/garage#928
Reviewed-by: maximilien <me@mricher.fr>
2025-01-17 06:06:14 +00:00
Stefan Majer
2eb9fcae20
Fix all typos
2025-01-16 13:22:00 +01:00
Baptiste Jonglez
58b9eb46fc
doc: Fix Nix devenv setup
...
This is a hotfix to fix the doc for the current setup, see #868 for
possible future directions.
2025-01-16 10:00:12 +01:00
255b01b626
Merge pull request 'Helm chart: Add garage.existingConfigmap and replace garage.garage.toml with garage.garageTomlString' ( #923 ) from jessebot/garage:allow-existing-configmap into main
...
Reviewed-on: Deuxfleurs/garage#923
Reviewed-by: maximilien <me@mricher.fr>
2025-01-15 23:53:25 +00:00
58a765c51f
Minor rewording, add some more hints
2025-01-15 23:51:07 +00:00
1c431b8457
Add garage.existingConfigmap and replace garage.garage.toml with garage.garageTomlString
...
also moves all gotemplating back to configmap
and adds autogenerated docs via helm-docs
Signed-off-by: jessebot <jessebot@linux.com>
2025-01-15 23:51:07 +00:00
39ac034de5
Merge pull request 'update toolchain' ( #924 ) from nix-update into main
...
Reviewed-on: Deuxfleurs/garage#924
2025-01-13 10:19:53 +00:00
8ddb0dd485
nix build: switch to upstream cargo2nix (branch release-0.11.0)
2025-01-12 18:16:23 +01:00
83887a8519
nix build: remove clippy build env that doesn't work
2025-01-12 17:51:33 +01:00
0a15db6960
nix build: update rustc to v1.78
2025-01-12 17:37:36 +01:00
295237476e
fix formatting to comply with latest rustfmt
2025-01-12 17:36:25 +01:00
9d83605736
flake: update versions of nixpkgs and rust-overlay
2025-01-12 17:34:04 +01:00
4b1a7fb5e3
Merge pull request 'The version flag is required when applying a layout' ( #921 ) from update-quickstart-docs-layout-apply into main
...
Reviewed-on: Deuxfleurs/garage#921
2025-01-09 00:41:35 +00:00