|
|
c6cde1f143
|
remove now-unused key parameter in check_quotas
|
2023-10-20 13:20:47 +02:00 |
|
|
|
ac04934dae
|
s3 api: add missing CORS headers to PostObject responses (fix #609)
|
2023-10-20 10:37:48 +02:00 |
|
|
|
58b0ee1b1a
|
list objects: prettyness and add asserts
|
2023-10-19 15:26:17 +02:00 |
|
|
|
158dc17a06
|
listobjects: fix panic if continuation token is an empty string
|
2023-10-19 15:08:47 +02:00 |
|
|
|
0215b11402
|
Merge pull request 'Add support for specifying rpc_secret_file, metrics_token_file and admin_token_file using environment variables' (#643) from networkException/garage:token-file-env into main-0.8.x
Reviewed-on: Deuxfleurs/garage#643
|
2023-10-19 09:33:12 +00:00 |
|
|
|
8599051c49
|
garage: support specifying token / secret as environment variables
this patch adds support for specifying the `rpc_secret_file`,
`metrics_token_file` and `admin_token_file` as environment variables.
|
2023-10-19 03:39:02 +02:00 |
|
|
|
4a19ee94bb
|
garage: fix admin-token description
|
2023-10-19 03:31:50 +02:00 |
|
|
|
c99cb58d71
|
util: move reading secret file into seperate helper
this patch moves the logic to read a secret file (and check for correct
permissions) from `secret_from_file` into a new `read_secret_file`
helper.
|
2023-10-19 03:29:48 +02:00 |
|
|
|
d146cdd5b6
|
cargo fmt
|
2023-10-18 16:38:26 +02:00 |
|
|
|
3d6ed63824
|
check_quotas: avoid re-fetching object from object table
|
2023-10-18 16:36:48 +02:00 |
|
|
|
45b0453d0f
|
Ensure increasing version timestamps in PutObject
|
2023-10-18 16:31:50 +02:00 |
|
|
|
c7f5dcd953
|
fix compilation on macos
fsblkcnt_t is ony 32b there, so we have to do an additional cast
|
2023-10-15 17:57:27 +02:00 |
|
|
|
952c9570c4
|
bump version to v0.9.0
|
2023-10-10 14:08:11 +02:00 |
|
|
|
3d7892477d
|
convert_db: fix build
|
2023-10-10 14:06:25 +02:00 |
|
|
|
d4932c31ea
|
Merge branch 'main' into next
|
2023-10-10 13:57:21 +02:00 |
|
|
|
2d5d7a7031
|
Move convert_db command into main garage binary
|
2023-10-10 12:13:15 +02:00 |
|
|
|
0c431b0c03
|
admin api: increased compatibility for v0/ endpoints
|
2023-10-05 16:56:13 +02:00 |
|
|
|
1c13135f25
|
admin api: remove broken GET /v0/key router rule
|
2023-10-05 16:27:29 +02:00 |
|
|
|
920dec393a
|
cli: more precise doc comment
|
2023-10-04 10:44:42 +02:00 |
|
|
|
2e656b541b
|
Merge branch 'main' into next
|
2023-10-03 18:40:37 +02:00 |
|
|
|
7907a09acc
|
api: allow custom unix bind mode and use 0o220 for admin server
|
2023-10-03 17:31:40 +02:00 |
|
|
|
8ec6a53b35
|
everywhere: support unix sockets when binding in various places
this patch implements binding to paths as a unix socket for generic
server and web server.
|
2023-09-29 18:57:44 +02:00 |
|
|
|
7353038a64
|
config: allow using paths for unix domain sockets in various places
this patch updates the config format to also allow paths in bind
addresses for unix domain sockets.
this has been added to all apis except rpc.
|
2023-09-29 18:38:30 +02:00 |
|
|
|
10195f1567
|
util: add helper sum type for unix and tcp socket addresses
this patch introduces a new sum type that can represent either a
tcp socket address or a unix domain socket path.
|
2023-09-29 18:37:36 +02:00 |
|
|
|
6086a3fa07
|
cargo: add hyperlocal as a dependency
|
2023-09-29 18:37:12 +02:00 |
|
|
|
897cbf2c27
|
actually update rmp-serde to 1.1.2 for both garage and netapp dependency (fix #629)
|
2023-09-27 13:13:00 +02:00 |
|
|
|
ad82035b98
|
Merge branch 'main' into next
|
2023-09-27 13:11:52 +02:00 |
|
|
|
aa7eadc799
|
Merge pull request 'New layout: fixes and UX improvements' (#634) from new-layout-ux into next
Reviewed-on: Deuxfleurs/garage#634
|
2023-09-27 09:04:32 +00:00 |
|
|
|
0635250b2b
|
garage_table/queue_insert: delay worker notification to after transaction commit (fix #583)
|
2023-09-21 15:37:28 +02:00 |
|
|
|
f97168f805
|
garage_db: refactor transactions and add on_commit mechanism
|
2023-09-21 15:35:31 +02:00 |
|
|
|
3ecc17f8c5
|
new layout: use deterministic randomness for reproducible results
|
2023-09-21 11:21:35 +02:00 |
|
|
|
0088599f52
|
new layout: fix clippy lints
|
2023-09-18 12:17:07 +02:00 |
|
|
|
749b4865d0
|
new layout: improve display and fix comments
|
2023-09-18 12:07:45 +02:00 |
|
|
|
015ccb39aa
|
new layout: make zone_redundancy optionnal (if not set, is maximum)
|
2023-09-18 11:59:08 +02:00 |
|
|
|
2e229d4430
|
new layout: improve output display
|
2023-09-12 17:24:51 +02:00 |
|
|
|
91e764a2bf
|
fix hang on shutdown
|
2023-09-12 14:35:48 +02:00 |
|
|
|
aa79810596
|
Fix error when none of S3/K2V/WEB/ADMIN server is started (fix #613)
|
2023-09-12 14:35:19 +02:00 |
|
|
|
fd7d8fec59
|
Merge branch 'main' into next
|
2023-09-11 23:09:20 +02:00 |
|
|
|
9cfe55ab60
|
fix 32-bit build
|
2023-09-11 20:01:29 +02:00 |
|
|
|
51abbb02d8
|
Merge branch 'main' into next
|
2023-09-11 20:00:02 +02:00 |
|
|
|
d5bb50d738
|
use statvfs instead of mount list to determine free data/meta space (fix #611)
|
2023-09-11 19:08:24 +02:00 |
|
|
|
f8b3883611
|
config: make block_size and sled_cache_capacity expressable as strings
|
2023-09-11 18:34:59 +02:00 |
|
|
|
51b9731a08
|
make lmdb's map_size configurable (fix #628)
|
2023-09-11 18:03:44 +02:00 |
|
|
|
ad6b1cc0be
|
Merge branch 'main' into next
|
2023-09-11 13:14:18 +02:00 |
|
|
|
ba7ac52c19
|
block repair: simpler/more robust iterator progress calculation
|
2023-09-11 12:31:34 +02:00 |
|
|
|
9526328d38
|
scrub: clear saved checkpoint when canceling scrub
|
2023-09-11 12:10:48 +02:00 |
|
|
|
7f9ba49c71
|
block manager: remove data_dir field
|
2023-09-11 11:57:36 +02:00 |
|
|
|
de5d792181
|
block manager: fix indentation (why not detected by cargo fmt?)
|
2023-09-11 11:52:57 +02:00 |
|
|
|
be91ef6294
|
block manager: fix bug where rebalance didn't delete old copies
|
2023-09-07 16:04:03 +02:00 |
|
|
|
2657b5c1b9
|
block manager: fix bugs
|
2023-09-07 15:30:56 +02:00 |
|
|
|
2f112ac682
|
correct free data space accounting for multiple data dirs on same fs
|
2023-09-07 14:42:20 +02:00 |
|
|
|
6b008b5bd3
|
block manager: add rebalance operation to rebalance multi-hdd setups
|
2023-09-07 13:44:11 +02:00 |
|
|
|
99ed18350f
|
block manager: refactor and fix monitoring/statistics
|
2023-09-07 12:41:36 +02:00 |
|
|
|
f38a31b330
|
block manager: avoid incorrect data_dir configs and avoid losing files
|
2023-09-06 17:49:30 +02:00 |
|
|
|
e30865984a
|
block manager: scrub checkpointing
|
2023-09-06 16:35:28 +02:00 |
|
|
|
55c514999e
|
block manager: fixes in layout
|
2023-09-06 16:35:28 +02:00 |
|
|
|
a44f486931
|
block manager: refactoring & increase max worker count to 8
|
2023-09-06 16:35:28 +02:00 |
|
|
|
3a74844df0
|
block manager: fix dir_not_empty
|
2023-09-06 16:35:28 +02:00 |
|
|
|
93114a9747
|
block manager: refactoring
|
2023-09-06 16:35:28 +02:00 |
|
|
|
fd00a47ddc
|
table queue: increase batch size
|
2023-09-06 16:35:28 +02:00 |
|
|
|
1b8c265c14
|
block manager: get rid of check_block_status
|
2023-09-06 16:35:28 +02:00 |
|
|
|
a09f86729c
|
block manager: move blocks in write_block if necessary
|
2023-09-06 16:35:28 +02:00 |
|
|
|
887b3233f4
|
block manager: use data paths from layout
|
2023-09-06 16:35:28 +02:00 |
|
|
|
6c420c0880
|
block manager: multi-directory layout computation
|
2023-09-06 16:35:28 +02:00 |
|
|
|
71c0188055
|
block manager: skeleton for multi-hdd support
|
2023-09-06 16:35:28 +02:00 |
|
|
|
4b4f2000f4
|
lifecycle: fix SkipBucket bug
|
2023-09-06 16:34:07 +02:00 |
|
|
|
51eac97260
|
update version to 0.8.4
|
2023-09-05 23:28:12 +02:00 |
|
|
|
e78566591b
|
Revert netapp update, hold to version 0.5.2 that uses rmp-serde 0.15
|
2023-09-05 23:23:23 +02:00 |
|
|
|
8e0c020bb9
|
lifecycle worker: correct small clippy lints
|
2023-09-04 11:33:44 +02:00 |
|
|
|
1cdc321e28
|
lifecycle worker: don't get stuck on non-existent bucket
|
2023-08-31 11:36:30 +02:00 |
|
|
|
f579d6d9b4
|
lifecycle worker: fix potential inifinite loop
|
2023-08-31 11:29:54 +02:00 |
|
|
|
a00a52633f
|
lifecycle worker: add log message when starting
|
2023-08-31 11:25:14 +02:00 |
|
|
|
adbf5925de
|
lifecycle worker: use queue_insert and process objects in batches
|
2023-08-31 11:19:26 +02:00 |
|
|
|
1cfcc61de8
|
lifecycle worker: mitigate potential bugs + refactoring
|
2023-08-31 00:28:37 +02:00 |
|
|
|
be03a4610f
|
s3api: remove redundant serde rename attribute
|
2023-08-31 00:00:26 +02:00 |
|
|
|
b2f679675e
|
lifecycle worker: take into account disabled rules
|
2023-08-30 23:52:09 +02:00 |
|
|
|
01c327a07a
|
lifecycle worker: avoid building chrono's serde feature
|
2023-08-30 23:46:15 +02:00 |
|
|
|
f0a395e2e5
|
s3 bucket apis: remove redundant call
|
2023-08-30 23:39:28 +02:00 |
|
|
|
a1d57283c0
|
bucket_table: bucketparams::new doesn't need to be pub
|
2023-08-30 20:07:14 +02:00 |
|
|
|
d2e94e36d6
|
lifecycle config: add missing line in merge() and remove tracing
|
2023-08-30 20:05:53 +02:00 |
|
|
|
75ccc5a95c
|
lifecycle config: store date as given, try to debug
|
2023-08-30 20:02:07 +02:00 |
|
|
|
7200954318
|
lifecycle worker: add logging
|
2023-08-30 14:54:52 +02:00 |
|
|
|
0f1849e1ac
|
lifecycle worker: launch with the rest of Garage
|
2023-08-30 14:51:08 +02:00 |
|
|
|
da8b224e24
|
lifecycle worker: skip entire bucket when no lifecycle config is set
|
2023-08-30 14:38:19 +02:00 |
|
|
|
2996dc875f
|
lifecycle worker: implement main functionality
|
2023-08-30 14:29:03 +02:00 |
|
|
|
a2e0e34db5
|
lifecycle: skeleton for lifecycle worker
|
2023-08-30 12:41:11 +02:00 |
|
|
|
f7b409f114
|
use a NaiveDate in data model, it serializes to string (iso 8601 format)
|
2023-08-30 11:24:01 +02:00 |
|
|
|
abf011c290
|
lifecycle: implement validation into garage's internal data structure
|
2023-08-29 18:22:03 +02:00 |
|
|
|
8041d9a827
|
s3: add xml structures to serialize/deserialize lifecycle configs
|
2023-08-29 17:44:17 +02:00 |
|
|
|
0b83e0558e
|
bucket_table: data model for lifecycle configuration
|
2023-08-29 17:00:41 +02:00 |
|
|
|
2e90e1c124
|
Merge branch 'main' into next
|
2023-08-29 11:32:42 +02:00 |
|
|
|
06369c8f4a
|
add garage_db dependency in garage_rpc
|
2023-08-28 17:08:21 +02:00 |
|
|
|
cece1be1bb
|
bump version to 0.8.3
|
2023-08-28 13:17:26 +02:00 |
|
|
|
769b6fe054
|
fix test_website_check_domain
|
2023-08-28 12:40:28 +02:00 |
|
|
|
e66c78d6ea
|
integration test: move json_body to root of crate
|
2023-08-28 12:32:57 +02:00 |
|
|
|
9b4ce4a8ad
|
admin api: refactor caddy check api code
|
2023-08-28 12:17:10 +02:00 |
|
|
|
2bbe2da5ad
|
Merge pull request 'support index on path missing a trailing slash' (#612) from compat/index-without-trailing-slash into main
Reviewed-on: Deuxfleurs/garage#612
|
2023-08-28 10:15:01 +00:00 |
|
|
|
c5cafa0000
|
web_server.rs: handle error properly and refactor
|
2023-08-28 12:05:14 +02:00 |
|
Jonathan Davies
|
d66d81ae2d
|
cargo: Updated gethostname v0.2.3 -> v0.4.3.
|
2023-08-28 09:30:27 +00:00 |
|
Jonathan Davies
|
7d8296ec59
|
cargo: Updated pretty_env_logger v0.4.0 -> v0.5.0.
|
2023-08-28 09:30:27 +00:00 |
|
Jonathan Davies
|
f607ac6792
|
garage/api: cargo: Updated idna dependency to 0.4.
|
2023-08-28 09:30:27 +00:00 |
|
Jonathan Davies
|
96d1d81ab7
|
garage/db: cargo: Updated rusqlite to 0.29.
|
2023-08-28 09:30:27 +00:00 |
|
Jonathan Davies
|
5185701aa8
|
cargo: Updated:
* addr2line v0.19.0 -> v0.20.0
* async-compression v0.4.0 -> v0.4.1
* clap v4.3.8 -> v4.3.19
* hyper v0.14.26 -> v0.14.27
* ipnet v2.7.2 -> v2.8.0
* rmp v0.8.11 -> v0.8.12
* serde v1.0.164 -> v1.0.188
* tokio v1.29.0 -> v1.31.0
* zstd v0.12.3+zstd.1.5.2 -> v0.12.4
* Others in `cargo update`
|
2023-08-28 09:30:27 +00:00 |
|
|
|
63da1d2443
|
support index on path missing a trailing slash
|
2023-08-08 15:28:57 +02:00 |
|
|
|
24e533f262
|
support {s3,web}.root_domains in /check endpoint
|
2023-08-08 11:05:42 +02:00 |
|
Jonathan Davies
|
59bfc68f2e
|
post_object.rs: Fixed typos / grammar.
|
2023-08-01 15:31:39 +01:00 |
|
|
|
c855284760
|
src/util: fix typo
|
2023-07-14 14:25:40 +03:00 |
|
|
|
b1ca1784a1
|
src/garage/cli: fix typo
|
2023-07-14 14:25:33 +03:00 |
|
Jonathan Davies
|
aee0d97f22
|
cargo: Updated async-compression to 0.4.
|
2023-06-28 11:17:16 +01:00 |
|
|
|
e716320b0a
|
Merge pull request 'cargo: roxmltree-0.18 and aws-sdk-s3-0.28 bump' (#591) from jpds/garage:roxmltree-0.18 into main
Reviewed-on: Deuxfleurs/garage#591
|
2023-06-27 17:20:58 +00:00 |
|
|
|
e466edbaec
|
Merge pull request 'introduce dedicated return type for PollRange' (#590) from trinity-1686a/garage:k2v-client-poll-range-result into main
Reviewed-on: Deuxfleurs/garage#590
|
2023-06-27 08:28:26 +00:00 |
|
Jonathan Davies
|
a6da7e588f
|
tests/bucket.rs: Adjusted as previously used function is now private.
|
2023-06-26 18:03:43 +01:00 |
|
|
|
e5835704b7
|
don't build sqlite by default
`bundled-libs` is enabled by default, and causes sqlite to be built too,
even if the sqlite backend isn't enabled.
|
2023-06-26 11:15:11 +02:00 |
|
Jonathan Davies
|
7f8bf2d801
|
src/garage/tests: Updated types for aws-sdk-s3 bump.
|
2023-06-25 21:31:35 +01:00 |
|
Jonathan Davies
|
4297233d3e
|
garage/Cargo.toml: Updated aws-sdk-s3 to 0.28, added aws-config.
|
2023-06-25 21:17:15 +01:00 |
|
Jonathan Davies
|
b94ba47f29
|
api/Cargo.toml: Updated roxmltree to 0.18.
|
2023-06-24 14:15:26 +01:00 |
|
|
|
33b3cf8e22
|
introduce dedicated return type for PollRange
|
2023-06-24 10:17:20 +02:00 |
|
|
|
8ef42c9609
|
admin docs: reformatting, key admin: add check
|
2023-06-14 17:19:25 +02:00 |
|
|
|
a83a092c03
|
admin: uniformize layout api and improve code
|
2023-06-14 17:12:37 +02:00 |
|
|
|
7895f99d3a
|
admin and cli: hide secret keys unless asked
|
2023-06-14 16:56:15 +02:00 |
|
|
|
4a82f6380e
|
admin api: move all endpoints to v1/ by default (v0/ still supported)
|
2023-06-14 14:15:51 +02:00 |
|
|
|
28cc9f178a
|
admin api: make name optionnal for CreateKey
|
2023-06-14 13:56:37 +02:00 |
|
|
|
35c108b85d
|
admin api: switch GetClusterHealth to camelcase (fix #381 again)
|
2023-06-14 13:53:19 +02:00 |
|
|
|
52376d47ca
|
admin api: change cluster status/layout to use lists and not maps (fix #377)
|
2023-06-14 13:45:27 +02:00 |
|
|
|
5670367126
|
multipartupload in test: add forgotten timestamp
|
2023-06-13 23:10:46 +02:00 |
|
|
|
cda957b4b1
|
update netapp's rmp-serde dependency to v1.1
|
2023-06-13 17:34:49 +02:00 |
|
|
|
90b2d43eb4
|
Merge branch 'main' into next
|
2023-06-13 17:14:11 +02:00 |
|
|
|
eb9cecf05c
|
Split garage/admin.rs into smaller files
|
2023-06-13 16:46:28 +02:00 |
|
|
|
802ed75721
|
move admin.rs to admin/mod.rs, before splitting
|
2023-06-13 16:42:14 +02:00 |
|
|
|
bf19a44fd9
|
admin API: add missing camelCase conversions (fix #381)
|
2023-06-13 16:15:50 +02:00 |
|
|
|
7126f3e1d1
|
garage key import: add checks and --yes CLI flag (fix #278)
|
2023-06-13 15:56:48 +02:00 |
|
|
|
942c1f1bfe
|
multipart uploads: save timestamp
|
2023-06-13 10:48:22 +02:00 |
|
|
|
1ea4937c8b
|
fix timestamps wrapping around in garage block list-errors (fix #584)
|
2023-06-12 20:07:33 +02:00 |
|
|
|
3d477906d4
|
properly delete multipart uploads after completion
|
2023-06-09 17:13:27 +02:00 |
|
|
|
a6cc563bdd
|
UploadPart: automatic cleanup of version (and reference blocked) when interrupted
|
2023-06-09 16:23:37 +02:00 |
|
|
|
c14d3735e5
|
Add test for multipart uploads and fix part renumbering
|
2023-06-09 16:23:37 +02:00 |
|
|
|
53bf2f070c
|
undo sort_key() returning Cow
|
2023-06-09 16:23:37 +02:00 |
|
|
|
412ab77b08
|
comments and clippy lint fixes
|
2023-06-09 16:23:37 +02:00 |
|
|
|
511e07ecd4
|
fix mpu counter (add missing workers) and report info at appropriate places
|
2023-06-09 16:23:37 +02:00 |
|
|
|
4ea53dc759
|
Add multipart upload repair
|
2023-06-09 16:23:37 +02:00 |
|
|
|
058518c22b
|
refactor repair workers with a trait
|
2023-06-09 16:23:37 +02:00 |
|
|
|
8644376ac2
|
fix test; simplify code
|
2023-06-09 16:23:37 +02:00 |
|
|
|
7ad7dae5d4
|
fix s3 list test
|
2023-06-09 16:23:37 +02:00 |
|
|
|
75a0e01372
|
fix online repair
|
2023-06-09 16:23:37 +02:00 |
|
|
|
bb176ebcb8
|
cargo fmt
|
2023-06-09 16:23:37 +02:00 |
|
|
|
87be8eeb93
|
updaet block admin for new multipartupload models
|
2023-06-09 16:23:37 +02:00 |
|
|
|
82e75c0e29
|
Adapt S3 API code to use new multipart upload models
- Create and PutPart
- completemultipartupload
- upload part copy
- list_parts
|
2023-06-09 16:23:37 +02:00 |
|
|
|
38d6ac4295
|
New multipart upload table layout
|
2023-06-09 16:23:37 +02:00 |
|
|
|
6005491cd8
|
Use Cow<[u8]> for sort keys
|
2023-06-09 16:23:37 +02:00 |
|
|
|
e7e164a280
|
Make fsync an option for meta and data
|
2023-06-09 16:23:21 +02:00 |
|
