3ecc17f8c5
new layout: use deterministic randomness for reproducible results
2023-09-21 11:21:35 +02:00
0088599f52
new layout: fix clippy lints
2023-09-18 12:17:07 +02:00
749b4865d0
new layout: improve display and fix comments
2023-09-18 12:07:45 +02:00
015ccb39aa
new layout: make zone_redundancy optionnal (if not set, is maximum)
2023-09-18 11:59:08 +02:00
2e229d4430
new layout: improve output display
2023-09-12 17:24:51 +02:00
91e764a2bf
fix hang on shutdown
2023-09-12 14:35:48 +02:00
aa79810596
Fix error when none of S3/K2V/WEB/ADMIN server is started ( fix #613 )
2023-09-12 14:35:19 +02:00
fd7d8fec59
Merge branch 'main' into next
2023-09-11 23:09:20 +02:00
9cfe55ab60
fix 32-bit build
2023-09-11 20:01:29 +02:00
51abbb02d8
Merge branch 'main' into next
2023-09-11 20:00:02 +02:00
d5bb50d738
use statvfs instead of mount list to determine free data/meta space ( fix #611 )
2023-09-11 19:08:24 +02:00
f8b3883611
config: make block_size and sled_cache_capacity expressable as strings
2023-09-11 18:34:59 +02:00
51b9731a08
make lmdb's map_size configurable ( fix #628 )
2023-09-11 18:03:44 +02:00
ad6b1cc0be
Merge branch 'main' into next
2023-09-11 13:14:18 +02:00
ba7ac52c19
block repair: simpler/more robust iterator progress calculation
2023-09-11 12:31:34 +02:00
9526328d38
scrub: clear saved checkpoint when canceling scrub
2023-09-11 12:10:48 +02:00
7f9ba49c71
block manager: remove data_dir field
2023-09-11 11:57:36 +02:00
de5d792181
block manager: fix indentation (why not detected by cargo fmt?)
2023-09-11 11:52:57 +02:00
be91ef6294
block manager: fix bug where rebalance didn't delete old copies
2023-09-07 16:04:03 +02:00
2657b5c1b9
block manager: fix bugs
2023-09-07 15:30:56 +02:00
2f112ac682
correct free data space accounting for multiple data dirs on same fs
2023-09-07 14:42:20 +02:00
6b008b5bd3
block manager: add rebalance operation to rebalance multi-hdd setups
2023-09-07 13:44:11 +02:00
99ed18350f
block manager: refactor and fix monitoring/statistics
2023-09-07 12:41:36 +02:00
f38a31b330
block manager: avoid incorrect data_dir configs and avoid losing files
2023-09-06 17:49:30 +02:00
e30865984a
block manager: scrub checkpointing
2023-09-06 16:35:28 +02:00
55c514999e
block manager: fixes in layout
2023-09-06 16:35:28 +02:00
a44f486931
block manager: refactoring & increase max worker count to 8
2023-09-06 16:35:28 +02:00
3a74844df0
block manager: fix dir_not_empty
2023-09-06 16:35:28 +02:00
93114a9747
block manager: refactoring
2023-09-06 16:35:28 +02:00
fd00a47ddc
table queue: increase batch size
2023-09-06 16:35:28 +02:00
1b8c265c14
block manager: get rid of check_block_status
2023-09-06 16:35:28 +02:00
a09f86729c
block manager: move blocks in write_block if necessary
2023-09-06 16:35:28 +02:00
887b3233f4
block manager: use data paths from layout
2023-09-06 16:35:28 +02:00
6c420c0880
block manager: multi-directory layout computation
2023-09-06 16:35:28 +02:00
71c0188055
block manager: skeleton for multi-hdd support
2023-09-06 16:35:28 +02:00
4b4f2000f4
lifecycle: fix SkipBucket bug
2023-09-06 16:34:07 +02:00
51eac97260
update version to 0.8.4
2023-09-05 23:28:12 +02:00
e78566591b
Revert netapp update, hold to version 0.5.2 that uses rmp-serde 0.15
2023-09-05 23:23:23 +02:00
8e0c020bb9
lifecycle worker: correct small clippy lints
2023-09-04 11:33:44 +02:00
1cdc321e28
lifecycle worker: don't get stuck on non-existent bucket
2023-08-31 11:36:30 +02:00
f579d6d9b4
lifecycle worker: fix potential inifinite loop
2023-08-31 11:29:54 +02:00
a00a52633f
lifecycle worker: add log message when starting
2023-08-31 11:25:14 +02:00
adbf5925de
lifecycle worker: use queue_insert and process objects in batches
2023-08-31 11:19:26 +02:00
1cfcc61de8
lifecycle worker: mitigate potential bugs + refactoring
2023-08-31 00:28:37 +02:00
be03a4610f
s3api: remove redundant serde rename attribute
2023-08-31 00:00:26 +02:00
b2f679675e
lifecycle worker: take into account disabled rules
2023-08-30 23:52:09 +02:00
01c327a07a
lifecycle worker: avoid building chrono's serde feature
2023-08-30 23:46:15 +02:00
f0a395e2e5
s3 bucket apis: remove redundant call
2023-08-30 23:39:28 +02:00
a1d57283c0
bucket_table: bucketparams::new doesn't need to be pub
2023-08-30 20:07:14 +02:00
d2e94e36d6
lifecycle config: add missing line in merge() and remove tracing
2023-08-30 20:05:53 +02:00
75ccc5a95c
lifecycle config: store date as given, try to debug
2023-08-30 20:02:07 +02:00
7200954318
lifecycle worker: add logging
2023-08-30 14:54:52 +02:00
0f1849e1ac
lifecycle worker: launch with the rest of Garage
2023-08-30 14:51:08 +02:00
da8b224e24
lifecycle worker: skip entire bucket when no lifecycle config is set
2023-08-30 14:38:19 +02:00
2996dc875f
lifecycle worker: implement main functionality
2023-08-30 14:29:03 +02:00
a2e0e34db5
lifecycle: skeleton for lifecycle worker
2023-08-30 12:41:11 +02:00
f7b409f114
use a NaiveDate in data model, it serializes to string (iso 8601 format)
2023-08-30 11:24:01 +02:00
abf011c290
lifecycle: implement validation into garage's internal data structure
2023-08-29 18:22:03 +02:00
8041d9a827
s3: add xml structures to serialize/deserialize lifecycle configs
2023-08-29 17:44:17 +02:00
0b83e0558e
bucket_table: data model for lifecycle configuration
2023-08-29 17:00:41 +02:00
2e90e1c124
Merge branch 'main' into next
2023-08-29 11:32:42 +02:00
06369c8f4a
add garage_db dependency in garage_rpc
2023-08-28 17:08:21 +02:00
cece1be1bb
bump version to 0.8.3
2023-08-28 13:17:26 +02:00
769b6fe054
fix test_website_check_domain
2023-08-28 12:40:28 +02:00
e66c78d6ea
integration test: move json_body to root of crate
2023-08-28 12:32:57 +02:00
9b4ce4a8ad
admin api: refactor caddy check api code
2023-08-28 12:17:10 +02:00
2bbe2da5ad
Merge pull request 'support index on path missing a trailing slash' ( #612 ) from compat/index-without-trailing-slash into main
...
Reviewed-on: Deuxfleurs/garage#612
2023-08-28 10:15:01 +00:00
c5cafa0000
web_server.rs: handle error properly and refactor
2023-08-28 12:05:14 +02:00
Jonathan Davies
d66d81ae2d
cargo: Updated gethostname v0.2.3 -> v0.4.3.
2023-08-28 09:30:27 +00:00
Jonathan Davies
7d8296ec59
cargo: Updated pretty_env_logger v0.4.0 -> v0.5.0.
2023-08-28 09:30:27 +00:00
Jonathan Davies
f607ac6792
garage/api: cargo: Updated idna dependency to 0.4.
2023-08-28 09:30:27 +00:00
Jonathan Davies
96d1d81ab7
garage/db: cargo: Updated rusqlite to 0.29.
2023-08-28 09:30:27 +00:00
Jonathan Davies
5185701aa8
cargo: Updated:
...
* addr2line v0.19.0 -> v0.20.0
* async-compression v0.4.0 -> v0.4.1
* clap v4.3.8 -> v4.3.19
* hyper v0.14.26 -> v0.14.27
* ipnet v2.7.2 -> v2.8.0
* rmp v0.8.11 -> v0.8.12
* serde v1.0.164 -> v1.0.188
* tokio v1.29.0 -> v1.31.0
* zstd v0.12.3+zstd.1.5.2 -> v0.12.4
* Others in `cargo update`
2023-08-28 09:30:27 +00:00
63da1d2443
support index on path missing a trailing slash
2023-08-08 15:28:57 +02:00
24e533f262
support {s3,web}.root_domains in /check endpoint
2023-08-08 11:05:42 +02:00
Jonathan Davies
59bfc68f2e
post_object.rs: Fixed typos / grammar.
2023-08-01 15:31:39 +01:00
c855284760
src/util: fix typo
2023-07-14 14:25:40 +03:00
b1ca1784a1
src/garage/cli: fix typo
2023-07-14 14:25:33 +03:00
Jonathan Davies
aee0d97f22
cargo: Updated async-compression to 0.4.
2023-06-28 11:17:16 +01:00
e716320b0a
Merge pull request 'cargo: roxmltree-0.18 and aws-sdk-s3-0.28 bump' ( #591 ) from jpds/garage:roxmltree-0.18 into main
...
Reviewed-on: Deuxfleurs/garage#591
2023-06-27 17:20:58 +00:00
e466edbaec
Merge pull request 'introduce dedicated return type for PollRange' ( #590 ) from trinity-1686a/garage:k2v-client-poll-range-result into main
...
Reviewed-on: Deuxfleurs/garage#590
2023-06-27 08:28:26 +00:00
Jonathan Davies
a6da7e588f
tests/bucket.rs: Adjusted as previously used function is now private.
2023-06-26 18:03:43 +01:00
e5835704b7
don't build sqlite by default
...
`bundled-libs` is enabled by default, and causes sqlite to be built too,
even if the sqlite backend isn't enabled.
2023-06-26 11:15:11 +02:00
Jonathan Davies
7f8bf2d801
src/garage/tests: Updated types for aws-sdk-s3 bump.
2023-06-25 21:31:35 +01:00
Jonathan Davies
4297233d3e
garage/Cargo.toml: Updated aws-sdk-s3 to 0.28, added aws-config.
2023-06-25 21:17:15 +01:00
Jonathan Davies
b94ba47f29
api/Cargo.toml: Updated roxmltree to 0.18.
2023-06-24 14:15:26 +01:00
33b3cf8e22
introduce dedicated return type for PollRange
2023-06-24 10:17:20 +02:00
8ef42c9609
admin docs: reformatting, key admin: add check
2023-06-14 17:19:25 +02:00
a83a092c03
admin: uniformize layout api and improve code
2023-06-14 17:12:37 +02:00
7895f99d3a
admin and cli: hide secret keys unless asked
2023-06-14 16:56:15 +02:00
4a82f6380e
admin api: move all endpoints to v1/ by default (v0/ still supported)
2023-06-14 14:15:51 +02:00
28cc9f178a
admin api: make name optionnal for CreateKey
2023-06-14 13:56:37 +02:00
35c108b85d
admin api: switch GetClusterHealth to camelcase ( fix #381 again)
2023-06-14 13:53:19 +02:00
52376d47ca
admin api: change cluster status/layout to use lists and not maps ( fix #377 )
2023-06-14 13:45:27 +02:00
5670367126
multipartupload in test: add forgotten timestamp
2023-06-13 23:10:46 +02:00
cda957b4b1
update netapp's rmp-serde dependency to v1.1
2023-06-13 17:34:49 +02:00
90b2d43eb4
Merge branch 'main' into next
2023-06-13 17:14:11 +02:00
eb9cecf05c
Split garage/admin.rs into smaller files
2023-06-13 16:46:28 +02:00
802ed75721
move admin.rs to admin/mod.rs, before splitting
2023-06-13 16:42:14 +02:00
bf19a44fd9
admin API: add missing camelCase conversions ( fix #381 )
2023-06-13 16:15:50 +02:00
7126f3e1d1
garage key import: add checks and --yes CLI flag ( fix #278 )
2023-06-13 15:56:48 +02:00
942c1f1bfe
multipart uploads: save timestamp
2023-06-13 10:48:22 +02:00
1ea4937c8b
fix timestamps wrapping around in garage block list-errors ( fix #584 )
2023-06-12 20:07:33 +02:00
3d477906d4
properly delete multipart uploads after completion
2023-06-09 17:13:27 +02:00
a6cc563bdd
UploadPart: automatic cleanup of version (and reference blocked) when interrupted
2023-06-09 16:23:37 +02:00
c14d3735e5
Add test for multipart uploads and fix part renumbering
2023-06-09 16:23:37 +02:00
53bf2f070c
undo sort_key() returning Cow
2023-06-09 16:23:37 +02:00
412ab77b08
comments and clippy lint fixes
2023-06-09 16:23:37 +02:00
511e07ecd4
fix mpu counter (add missing workers) and report info at appropriate places
2023-06-09 16:23:37 +02:00
4ea53dc759
Add multipart upload repair
2023-06-09 16:23:37 +02:00
058518c22b
refactor repair workers with a trait
2023-06-09 16:23:37 +02:00
8644376ac2
fix test; simplify code
2023-06-09 16:23:37 +02:00
7ad7dae5d4
fix s3 list test
2023-06-09 16:23:37 +02:00
75a0e01372
fix online repair
2023-06-09 16:23:37 +02:00
bb176ebcb8
cargo fmt
2023-06-09 16:23:37 +02:00
87be8eeb93
updaet block admin for new multipartupload models
2023-06-09 16:23:37 +02:00
82e75c0e29
Adapt S3 API code to use new multipart upload models
...
- Create and PutPart
- completemultipartupload
- upload part copy
- list_parts
2023-06-09 16:23:37 +02:00
38d6ac4295
New multipart upload table layout
2023-06-09 16:23:37 +02:00
6005491cd8
Use Cow<[u8]> for sort keys
2023-06-09 16:23:37 +02:00
e7e164a280
Make fsync an option for meta and data
2023-06-09 16:23:21 +02:00
1e466b11eb
Revert integration tests to using Sled as LMDB causes failures
2023-06-09 13:23:08 +02:00
Jonathan Davies
8a945ee996
payload.rs: Surround / in inverted commas.
2023-06-06 16:26:06 +01:00
Jonathan Davies
180992d0f1
payload.rs: Fixed typo in error message.
2023-06-06 16:25:29 +01:00
8a74e1c2bd
Split garage/admin.rs into smaller files
2023-06-06 15:39:15 +02:00
Roberto Hidalgo
ef8a7add08
set default for [consul-services] api
2023-05-22 08:57:15 -06:00
Roberto Hidalgo
b770504126
simplify code according to feedback
2023-05-22 08:57:15 -06:00
Roberto Hidalgo
6b69404f1a
rename mode to consul_http_api
2023-05-22 08:57:15 -06:00
Roberto Hidalgo
011f473048
revert rpc/Cargo.toml
2023-05-22 08:57:15 -06:00
Roberto Hidalgo
fd7dbea5b8
follow feedback, fold into existing feature
2023-05-22 08:57:15 -06:00
Roberto Hidalgo
bd6485565e
allow additional ServiceMeta, docs
2023-05-22 08:57:15 -06:00
Roberto Hidalgo
4d6e6fc155
cargo fmt
2023-05-22 08:57:15 -06:00
Roberto Hidalgo
02ba9016ab
register consul services against local agent instead of catalog api
2023-05-22 08:57:15 -06:00
c3d3b837eb
bump k2v-client to v0.0.4
2023-05-22 10:47:15 +02:00
130e01505b
Fix k2v_client with unicode in partition keys
2023-05-22 10:45:09 +02:00
e2ce5970c6
Add basic k2v_client integration tests
2023-05-22 10:45:06 +02:00
644e872264
Port k2v-client to aws-sigv4 since rusoto_signature is deprecated
2023-05-19 12:08:29 +02:00
4420db7310
add tracing to k2v-client
2023-05-18 11:18:21 +02:00
746b0090e4
k2v signature verification: double urlencoding (see comment in source code)
2023-05-18 11:18:06 +02:00
19639705e6
Mark sled as deprecated, make lmdb default, and improve sqlite and lmdb defaults
2023-05-17 14:30:53 +02:00
217d429937
fix clippy lint in format-table crate
2023-05-17 13:06:37 +02:00
a1cec2cd60
Split format_table into separate crate and reduce k2v-client dependencies
2023-05-17 13:01:37 +02:00
16f2a32bb7
cargo fmt
2023-05-16 19:46:57 +02:00
472444ed8e
k2v-client 0.0.2
2023-05-16 19:46:57 +02:00
bb03805b58
k2v-cli: fix sort_key being partition_key and specify which key
2023-05-16 19:46:57 +02:00
e4f955d672
fix base64 uses
2023-05-16 19:46:56 +02:00
ea9b15f669
Merge pull request 'cargo: tokio-1.28 and hyper-0.14.26 update' ( #569 ) from jpds/garage:tokio-1.28 into main
...
Reviewed-on: Deuxfleurs/garage#569
2023-05-11 10:16:33 +00:00
Jonathan Davies
c783194e8b
*: apply clippy recommendations.
2023-05-09 20:49:34 +01:00
Jonathan Davies
0f0795103d
block/Cargo.toml: Bump tokio-util to 0.7.
2023-05-09 14:33:21 +01:00
Jonathan Davies
c9d26e8c50
k2v-client/Cargo.toml: Make tokio dep match other packages.
2023-05-09 14:33:00 +01:00
351d734e6c
Merge branch 'main' into next
2023-05-09 12:40:08 +02:00
b925f53dc3
Merge pull request 'move git-version dependency to main crate to reduce rebuilds' ( #568 ) from move-git-version into main
...
Reviewed-on: Deuxfleurs/garage#568
2023-05-09 09:53:33 +00:00
2f495575d8
Merge pull request 'block/manager.rs: Prioritize raw blocks when no compression configured' ( #566 ) from jpds/garage:skip-compressed-blocks-scrub-no-compression into main
...
Reviewed-on: Deuxfleurs/garage#566
2023-05-09 09:39:48 +00:00
9e0a9c1c15
move git-version dependency to main crate to reduce rebuilds
2023-05-09 11:35:32 +02:00
Jonathan Davies
9c788059e2
block/manager.rs: In is_block_compressed - check which compression_level
...
is configured on a node and check for raw block first if compression is
disabled (to help reduce syscalls during a scrub).
2023-05-09 10:28:19 +01:00
5684e1990c
Merge pull request 'Really allow to disable sled feature' ( #563 ) from jirutka/garage:workspace-deps into main
...
Reviewed-on: Deuxfleurs/garage#563
2023-05-09 09:08:35 +00:00
14c50f2f84
Merge pull request 'Fix undefined macro warn! on 32-bit' ( #562 ) from jirutka/garage:fix-undefined-warn into main
...
Reviewed-on: Deuxfleurs/garage#562
2023-05-09 08:52:11 +00:00
d2deee0b8b
Declare garage crates using workspace.dependencies
...
This will allow to really disable "sled" feature without declaring
`default-features = false` in every Cargo.toml where garage_db and
garage_model is used.
See https://doc.rust-lang.org/cargo/reference/workspaces.html#the-dependencies-table
2023-05-09 08:46:15 +00:00
6d3ace1ea9
Fix undefined macro warn! on 32-bit
...
Compiling garage_db v0.8.2 (garage-0.8.2/src/db)
error: cannot find macro `warn` in this scope
--> src/db/lmdb_adapter.rs:352:2
|
352 | warn!("LMDB is not recommended on 32-bit systems, database size will be limited");
| ^^^^
|
= help: consider importing this macro:
tracing::warn
= note: `warn` is in scope, but it is an attribute: `#[warn]`
error: could not compile `garage_db` due to previous error
2023-05-07 17:01:44 +02:00
833cf082da
Remove unnecessary/unused "timeago" features
...
To decrease dependency bloat and binary size.
2023-05-07 01:03:54 +02:00
fa78d806e3
Merge branch 'main' into next
2023-04-25 12:34:26 +02:00
a16eb7e4b8
Merge pull request 'api/Cargo.toml: Bumped quick-xml to version 0.26.' ( #552 ) from jpds/garage:quick-xml-0.26 into main
...
Reviewed-on: Deuxfleurs/garage#552
2023-04-24 09:00:00 +00:00
Jonathan Davies
fb3bd11dce
block/repair.rs: Added log entries for scrub start/finish.
2023-04-23 22:22:26 +01:00
Jonathan Davies
c168383113
api/Cargo.toml: Bumped quick-xml to version 0.26.
2023-04-23 20:14:28 +01:00
000006d689
obsolete clippy lints
2023-03-13 18:50:07 +01:00
0a1ddcf630
Prepare for v0.8.2
2023-03-13 18:46:31 +01:00
d6ffa57f40
Merge pull request 'Increase Garage tests robustness' ( #526 ) from tests/increase-robustness into main
...
Reviewed-on: Deuxfleurs/garage#526
Reviewed-by: Alex <alex@adnab.me>
Reviewed-by: trinity-1686a <trinity.pointard@gmail.com>
2023-03-13 17:26:21 +00:00
f37ec584b6
Merge branch 'main' into rustversion-label
2023-03-13 16:14:13 +01:00
70b5424b99
use one key per context to isolate tests
2023-03-13 15:06:05 +01:00
2687fb7fa8
do not assume Garage boots in 2sec during tests
2023-03-13 15:06:05 +01:00
teutat3s
8ad6efb338
Merge branch 'main' into pnet_datalink-0.33.0
2023-03-13 13:59:42 +01:00
Jonathan Davies
9ea154ae9c
admin/cluster.rs: Added rust_version.
2023-03-10 14:46:54 +00:00
Jonathan Davies
4421378023
garage/admin.rs: Display Rust version in stats output.
2023-03-10 14:46:54 +00:00
Jonathan Davies
25f2a46fc3
rpc/system_metrics.rs: Added rustversion label to garage_build_info metric.
2023-03-10 14:46:44 +00:00
Jonathan Davies
d218f475cb
block/manager.rs: Set defaults for scrub_persister.
2023-03-09 17:08:47 +00:00
Jonathan Davies
7b65dd24e2
block/repair.rs: Added a timestamp argument to
...
randomize_next_scrub_run_time().
2023-03-09 16:38:41 +00:00
Jonathan Davies
b70cc0a940
block/repair.rs: Added migration for ScrubWorkerPersisted's time_next_run_scrub.
...
Fixes : #520 .
2023-03-09 16:38:36 +00:00
2dc80abbb1
Merge pull request 'block/repair.rs: Added a random element of 10 days to SCRUB_INTERVAL' ( #516 ) from jpds/garage:scrub-randomize-window into main
...
Reviewed-on: Deuxfleurs/garage#516
2023-03-06 14:11:25 +00:00
Jonathan Davies
148b66b843
block/manager.rs: Display scrub-next-run.
2023-03-06 13:43:09 +00:00
Jonathan Davies
53d09eb00f
block/repair.rs: Added function and time_next_run_scrub with a random element of
...
10 days to SCRUB_INTERVAL to help balance scrub load across cluster.
2023-03-06 13:43:04 +00:00
00dcfc97a5
Merge pull request 'web_server.rs: Log X-Forwarded-For IP' ( #504 ) from jpds/garage:web_server-log-x-forwarded-for into main
...
Reviewed-on: Deuxfleurs/garage#504
2023-03-06 12:33:06 +00:00
Jonathan Davies
4e0fc3d6c9
web/web_server.rs: Handle X-Forwarded-For here too.
2023-03-06 11:43:54 +00:00
Jonathan Davies
e4e5196066
api/generic_server.rs: Use new handle_forwarded_for_headers() function.
2023-03-06 11:43:35 +00:00
b8123fb6cd
Clearer error message when LMDB has oom error ( fix #517 )
2023-03-06 11:38:49 +01:00
Jonathan Davies
ff70e09aa0
util/forwarded_headers.rs: Generalized handle_forwarded_for_headers()
...
here.
2023-03-03 19:17:40 +00:00
teutat3s
f0717dd169
Bump pnet_datalink 0.28 -> 0.33
...
Motivation: building garage on illumos is only possible since
pnet_datalink version 0.30
Changelog: https://github.com/libpnet/libpnet/compare/v0.28.0...v0.33.0
2023-02-28 16:06:43 +01:00
8b4d0adc75
Merge pull request 'generic_server.rs: Added support for logging X-Forwarded-For header.' ( #500 ) from jpds/garage:generic_server-log-x-forwarded-for into main
...
Reviewed-on: Deuxfleurs/garage#500
2023-02-06 14:20:12 +00:00
d14678e0ac
Merge pull request 'Secrets can be passed directly in config, as file, or as env' ( #499 ) from config-files-env into main
...
Reviewed-on: Deuxfleurs/garage#499
2023-02-06 14:18:58 +00:00
80e2326998
fixes for pr 499
2023-02-06 12:23:55 +01:00
Jonathan Davies
94d70bec69
generic_server.rs: Added support for logging X-Forwarded-For header.
...
Fixes : #460
2023-02-04 15:19:21 +00:00
656b8d42de
secrets can be passed directly in config, as file, or as env
2023-02-03 15:27:39 +01:00
Jonathan Davies
1b6ec74748
error.rs: Corrected error messages to say unexpected scope.
2023-02-02 16:20:31 +00:00
f9573b6912
Merge pull request 'Fix duplicated content-type in error document' ( #493 ) from baptiste/garage:fix_error_document_content_type into main
...
Reviewed-on: Deuxfleurs/garage#493
2023-01-30 10:56:35 +00:00
Baptiste Jonglez
e85a200189
Fix duplicated content-type in error document
...
Fixes #492
2023-01-29 22:51:23 +01:00
Jonathan Davies
9c354f0a8f
Improved bucket authorization response strings.
2023-01-29 20:34:41 +00:00
Jonathan Davies
004bb5b4f1
api_server.rs: Adapted to use query string per Caddy upstream change.
2023-01-29 20:34:37 +00:00
d6af95d205
fix cli display bug
2023-01-26 17:50:50 +01:00
c56794655e
Fix fmt
2023-01-26 17:27:03 +01:00
8e93d69974
More clippy fixes
2023-01-26 17:26:32 +01:00
3113f6b5f2
more fixes
2023-01-26 17:14:17 +01:00
1dff62564f
fix clippy
2023-01-26 17:05:31 +01:00
590a0a8450
Merge branch 'main' into k2v-watch-range-2
2023-01-26 16:46:40 +01:00
94d559ae00
Merge branch 'main' into report-disk-usage
2023-01-26 16:20:41 +01:00
c7d0ad0aa0
Add local disk usage to exported prometheus metrics
2023-01-26 15:30:36 +01:00
efb6b6e868
Disk space report
...
Report available disk space on nodes and calculate cluster-wide available space in `garage stats` (fix #479 )
2023-01-26 15:04:32 +01:00
Jonathan Davies
3dc655095f
db/Cargo.toml: Updated rusqlite from 0.27 to 0.28.
2023-01-26 11:13:11 +00:00
Jonathan Davies
20c1cdf662
Cargo.toml: Loosen tracing dependency to just 0.1.
2023-01-26 11:13:11 +00:00
Jonathan Davies
f952e37ba7
{model,util}/Cargo.toml: Updated blake2 from 0.9 to 0.10.
2023-01-26 11:13:11 +00:00
Jonathan Davies
fbafa76284
{db,util}/Cargo.toml: Updated mktemp from 0.4 to 0.5.
2023-01-26 11:13:11 +00:00
Jonathan Davies
63e22e71f2
api/Cargo.toml: Updated idna from 0.2 to 0.3.
2023-01-26 11:13:11 +00:00
Jonathan Davies
f6eaf3661c
garage/Cargo.toml: Updated timeage from 0.3 to 0.4.
2023-01-26 11:13:11 +00:00
Jonathan Davies
d3b2a68988
{garage,util}/Cargo.toml: Updated toml from 0.5 to 0.6.
2023-01-26 11:13:11 +00:00
Jonathan Davies
b4a1a6a32f
util/time.rs: Updated deprecated associated function to timestamp_opt().
2023-01-26 11:13:11 +00:00
Jonathan Davies
bcac889f9a
Cargo.toml: Updated clap from 3.1.18 to 4.1.
2023-01-26 11:13:11 +00:00
Jonathan Davies
9e08a05e69
k2v-client/Cargo.toml: Loosen dependencies.
2023-01-26 11:13:11 +00:00
Jonathan Davies
36944f1839
Cargo.toml: Updated base64 from 0.13 to 0.21.
2023-01-26 11:13:07 +00:00
Jonathan Davies
db56d4658f
util/Cargo.toml: Updated rmp-serde from 0.15 to 1.1.
2023-01-26 11:03:43 +00:00
Jonathan Davies
93c3f8fc8c
api/Cargo.toml: Updated url from 2.1 to 2.3.
2023-01-23 19:16:58 +00:00
Jonathan Davies
1c435fce09
api/Cargo.toml: Updated httpdate from 0.3 to 1.0.
2023-01-23 19:16:54 +00:00
Jonathan Davies
dead123892
api/Cargo.toml: Updated pin-project to 1.0.12.
2023-01-23 18:39:35 +00:00
Jonathan Davies
5c3075fe01
Cargo.toml: Updated zstd from 0.9 to 0.12.
2023-01-23 18:08:14 +00:00
Jonathan Davies
4962b88f8b
tests/s3/website.rs: Added website hosting authorization check tests.
2023-01-13 09:39:02 +00:00
Jonathan Davies
100b01e859
Implemented website hosting authorization endpoint.
...
Fixes : #468
2023-01-13 09:38:58 +00:00
84b4a868e3
Migration of cluster layout from v0.8 to v0.9
2023-01-11 17:47:46 +01:00
dac254a6e7
Merge branch 'main' into k2v-watch-range-2
2023-01-11 17:09:37 +01:00
94d723f27c
Merge pull request 'Implement rpc_secret_file' ( #466 ) from felix.scheinost/garage:feature/implement-rpc-secret-file into main
...
Reviewed-on: Deuxfleurs/garage#466
2023-01-11 16:04:35 +00:00
638c5a3ce0
PollRange: add extra RPC delay after quorum is achieved,
...
to give a chance to the 3rd node to respond
2023-01-11 16:12:07 +01:00
5b5ca63cf6
Poll cleanup
2023-01-11 15:17:27 +01:00
cbfae673e8
PollRange & PollItem: min timeout = 1 sec
2023-01-11 15:03:08 +01:00
bba13f40fc
Correctly return bad requests when seeh marker is invalid
2023-01-11 12:27:19 +01:00
ba384e61c0
PollRange: return immediately if no seen marker is provided
2023-01-11 12:03:17 +01:00
09a3dad0f2
Lock once for insert_many
2023-01-11 11:35:36 +01:00
32aab06929
k2v-client libary poll_range and CLI poll-range
2023-01-11 11:14:29 +01:00
de1111076b
PollRange integration test
2023-01-11 10:04:41 +01:00
b83517d521
Implement PollRange API endpoint
2023-01-10 15:22:25 +01:00
43fd6c1526
PollRange RPC
2023-01-10 12:54:24 +01:00
789540ca37
Type definition for range seen marker
2023-01-10 11:59:57 +01:00
Jonathan Davies
4cfb469d2b
block/metrics.rs: Added compression_level metric.
2023-01-10 10:40:03 +00:00
Jonathan Davies
df1d9a9873
system.rs: Integrated SystemMetrics into System implementation.
2023-01-10 10:39:50 +00:00
Jonathan Davies
aac348fe93
Added system_metrics.rs file.
2023-01-10 10:38:50 +00:00
9f5419f465
Make K2V item timestamps globally increasing on each node
2023-01-10 11:03:52 +01:00
a48e2e0cb2
K2V: Subscription to ranges of items
2023-01-10 10:30:59 +01:00
d6ea0cbefa
Add tests for rpc_secret_file
2023-01-07 14:19:36 +01:00
7b62fe3f0b
Error on both rpc_secret and rpc_secret_file
2023-01-07 13:49:03 +01:00
Jonathan Davies
cb07e6145c
Changed all instances of assignation to assignment.
2023-01-05 11:09:25 +00:00
f2106c2733
Implement rpc_secret_file
2023-01-04 18:35:10 +01:00
02e8eb167e
Merge pull request 'PutObject: better cleanup when request is interrupted in the middle' ( #462 ) from interrupted-cleanup into main
...
Reviewed-on: Deuxfleurs/garage#462
2023-01-04 14:43:45 +00:00
29dbcb8278
bg var operation on all nodes at once
2023-01-04 13:25:57 +01:00
f3f27293df
Uniform framework for bg variable management
2023-01-04 13:07:13 +01:00
13c5549886
Remove token_bucket.rs
2023-01-04 11:47:56 +01:00
80e4abb98d
Merge pull request 'Changed all instances of 'key new' to 'key create' to make it the same as the bucket commands.' ( #459 ) from jpds/garage:key-create-standardize into next
...
Reviewed-on: Deuxfleurs/garage#459
2023-01-04 10:35:49 +00:00
