garage

asonix/garage

Fork 0

forked from Deuxfleurs/garage

Commit graph

cb359b4434 doc: update endpoint_url documentation Florian Klink 2023-10-02 15:13:05 +03:00
8ec6a53b35

everywhere: support unix sockets when binding in various places networkException 2023-09-29 18:41:00 +02:00
7353038a64

config: allow using paths for unix domain sockets in various places networkException 2023-09-29 18:38:30 +02:00
10195f1567

util: add helper sum type for unix and tcp socket addresses networkException 2023-09-29 18:37:36 +02:00
6086a3fa07

cargo: add hyperlocal as a dependency networkException 2023-09-29 18:36:50 +02:00
9ac1d5be0e add upgrade test for garage 0.8 -> 0.9 Alex Auvolat 2023-09-27 13:38:17 +02:00
897cbf2c27 actually update rmp-serde to 1.1.2 for both garage and netapp dependency (fix #629) v0.9.0-beta4 Alex Auvolat 2023-09-27 13:12:41 +02:00
ad82035b98 Merge branch 'main' into next Alex Auvolat 2023-09-27 13:11:52 +02:00
aa7eadc799 Merge pull request 'New layout: fixes and UX improvements' (#634) from new-layout-ux into next v0.9.0-beta3 Alex 2023-09-27 09:04:32 +00:00
0e5925fff6 layout doc: reformulate Alex Auvolat 2023-09-22 16:09:17 +02:00
8d07888fa2 layout doc: write explanations for bizarre scenarios Alex Auvolat 2023-09-22 16:07:46 +02:00
405aa42b7d layout doc: update old text Alex Auvolat 2023-09-22 10:00:01 +02:00
b4a0e636d8 new layout doc: add examples of unexpected layout, to explain Alex Auvolat 2023-09-22 09:49:07 +02:00
1d986bd889 Merge pull request 'Refactor db transactions and add on_commit for table.queue_insert' (#637) from k2v-indices-lmdb into next Alex 2023-09-21 14:03:35 +00:00
0635250b2b garage_table/queue_insert: delay worker notification to after transaction commit (fix #583) Alex Auvolat 2023-09-21 15:37:28 +02:00
f97168f805 garage_db: refactor transactions and add on_commit mechanism Alex Auvolat 2023-09-21 15:32:25 +02:00
3ecc17f8c5 new layout: use deterministic randomness for reproducible results Alex Auvolat 2023-09-21 11:21:35 +02:00
3a0e074047 Merge pull request 'prez-ocp' (#636) from prez-ocp into main Alex 2023-09-21 08:15:10 +00:00
95ae09917b add ocp2023 presentation Alex Auvolat 2023-09-19 14:02:07 +02:00
a7ababb5db doc: update sticker Alex Auvolat 2023-09-18 16:39:51 +02:00
013b026d56 update cargo.nix Alex Auvolat 2023-09-18 12:18:56 +02:00
0088599f52 new layout: fix clippy lints Alex Auvolat 2023-09-18 12:17:07 +02:00
749b4865d0 new layout: improve display and fix comments Alex Auvolat 2023-09-18 12:07:45 +02:00
015ccb39aa new layout: make zone_redundancy optionnal (if not set, is maximum) Alex Auvolat 2023-09-18 11:57:36 +02:00
2e229d4430 new layout: improve output display Alex Auvolat 2023-09-12 17:24:51 +02:00
be1a16b42b Merge pull request 'Fix multiple shutdown issues' (#633) from fix-shutdown into main Alex 2023-09-12 12:54:50 +00:00
91e764a2bf fix hang on shutdown Alex Auvolat 2023-09-12 14:35:48 +02:00
aa79810596 Fix error when none of S3/K2V/WEB/ADMIN server is started (fix #613) Alex Auvolat 2023-09-12 14:35:19 +02:00
fd7d8fec59 Merge branch 'main' into next v0.9.0-beta2 Alex Auvolat 2023-09-11 23:09:20 +02:00
143a349f55 Merge pull request 'fix 32-bit build' (#632) from fix-32bit into main Alex 2023-09-11 21:08:26 +00:00
9cfe55ab60 fix 32-bit build Alex Auvolat 2023-09-11 20:01:29 +02:00
51abbb02d8 Merge branch 'main' into next Alex Auvolat 2023-09-11 20:00:02 +02:00
2548a247f2 Merge pull request 'use statvfs instead of mount list to determine free data/meta space (fix #611)' (#631) from fix-free-space into main Alex 2023-09-11 17:29:23 +00:00
d5bb50d738 use statvfs instead of mount list to determine free data/meta space (fix #611) Alex Auvolat 2023-09-11 19:08:24 +02:00
fc635f7072 Merge pull request 'make lmdb's map_size configurable (fix #628)' (#630) from configurable-map-size into main Alex 2023-09-11 16:48:14 +00:00
f8b3883611 config: make block_size and sled_cache_capacity expressable as strings Alex Auvolat 2023-09-11 18:34:59 +02:00
51b9731a08 make lmdb's map_size configurable (fix #628) Alex Auvolat 2023-09-11 18:03:20 +02:00
ad6b1cc0be Merge branch 'main' into next Alex Auvolat 2023-09-11 13:14:18 +02:00
7228fbfd4f Merge pull request 'multi-hdd support (fix #218)' (#625) from multihdd into next Alex 2023-09-11 10:52:01 +00:00
ba7ac52c19 block repair: simpler/more robust iterator progress calculation Alex Auvolat 2023-09-11 12:28:29 +02:00
9526328d38 scrub: clear saved checkpoint when canceling scrub Alex Auvolat 2023-09-11 12:10:48 +02:00
7f9ba49c71 block manager: remove data_dir field Alex Auvolat 2023-09-11 11:57:36 +02:00
de5d792181 block manager: fix indentation (why not detected by cargo fmt?) Alex Auvolat 2023-09-11 11:52:57 +02:00
be91ef6294 block manager: fix bug where rebalance didn't delete old copies Alex Auvolat 2023-09-07 16:04:03 +02:00
2657b5c1b9 block manager: fix bugs Alex Auvolat 2023-09-07 15:30:56 +02:00
eb972a8422 doc: update multi-hdd section Alex Auvolat 2023-09-07 14:48:36 +02:00
2f112ac682 correct free data space accounting for multiple data dirs on same fs Alex Auvolat 2023-09-07 14:42:20 +02:00
6a067e30ee doc: documentation of rebalance repair Alex Auvolat 2023-09-07 13:49:12 +02:00
6b008b5bd3 block manager: add rebalance operation to rebalance multi-hdd setups Alex Auvolat 2023-09-07 13:44:11 +02:00
6595efd82f Document multi-hdd support Alex Auvolat 2023-09-07 13:23:02 +02:00
bca347a1e8 doc: update page on upgradin clusters Alex Auvolat 2023-09-07 12:52:44 +02:00
99ed18350f block manager: refactor and fix monitoring/statistics Alex Auvolat 2023-09-07 12:41:36 +02:00
f38a31b330 block manager: avoid incorrect data_dir configs and avoid losing files Alex Auvolat 2023-09-06 17:49:30 +02:00
e30865984a block manager: scrub checkpointing Alex Auvolat 2023-09-05 17:37:45 +02:00
55c514999e block manager: fixes in layout Alex Auvolat 2023-09-05 17:00:52 +02:00
a44f486931 block manager: refactoring & increase max worker count to 8 Alex Auvolat 2023-09-05 15:57:25 +02:00
3a74844df0 block manager: fix dir_not_empty Alex Auvolat 2023-09-05 15:41:36 +02:00
93114a9747 block manager: refactoring Alex Auvolat 2023-09-05 15:39:21 +02:00
fd00a47ddc table queue: increase batch size Alex Auvolat 2023-09-05 15:07:29 +02:00
1b8c265c14 block manager: get rid of check_block_status Alex Auvolat 2023-09-05 15:04:59 +02:00
3199cab4c8 update cargo.nix Alex Auvolat 2023-09-05 14:45:26 +02:00
a09f86729c block manager: move blocks in write_block if necessary Alex Auvolat 2023-09-05 14:37:10 +02:00
887b3233f4 block manager: use data paths from layout Alex Auvolat 2023-09-05 14:27:39 +02:00
6c420c0880 block manager: multi-directory layout computation Alex Auvolat 2023-09-05 13:43:38 +02:00
71c0188055 block manager: skeleton for multi-hdd support Alex Auvolat 2023-09-04 14:49:49 +02:00
4b4f2000f4 lifecycle: fix SkipBucket bug Alex Auvolat 2023-09-06 16:34:07 +02:00
5f86b48f97 Merge pull request 'Revert netapp to 0.5.2 to avoid rmp-serde upgrade that breaks things' (#627) from hold-netapp-0.5.2 into main Alex 2023-09-05 22:08:40 +00:00
51eac97260 update version to 0.8.4 v0.8.4 Alex Auvolat 2023-09-05 23:28:12 +02:00
e78566591b Revert netapp update, hold to version 0.5.2 that uses rmp-serde 0.15 Alex Auvolat 2023-09-05 23:23:23 +02:00
3f461d8891 Merge pull request 'object lifecycles (fix #309)' (#620) from bucket-lifecycle into next Alex 2023-09-04 09:45:10 +00:00
8e0c020bb9 lifecycle worker: correct small clippy lints Alex Auvolat 2023-08-31 11:45:19 +02:00
1cdc321e28 lifecycle worker: don't get stuck on non-existent bucket Alex Auvolat 2023-08-31 11:36:30 +02:00
f579d6d9b4 lifecycle worker: fix potential inifinite loop Alex Auvolat 2023-08-31 11:29:54 +02:00
a00a52633f lifecycle worker: add log message when starting Alex Auvolat 2023-08-31 11:25:14 +02:00
adbf5925de lifecycle worker: use queue_insert and process objects in batches Alex Auvolat 2023-08-31 11:19:26 +02:00
1cfcc61de8 lifecycle worker: mitigate potential bugs + refactoring Alex Auvolat 2023-08-31 00:28:37 +02:00
be03a4610f s3api: remove redundant serde rename attribute Alex Auvolat 2023-08-31 00:00:26 +02:00
b2f679675e lifecycle worker: take into account disabled rules Alex Auvolat 2023-08-30 23:52:09 +02:00
5fad4c4658 update cargo.nix Alex Auvolat 2023-08-30 23:47:42 +02:00
01c327a07a lifecycle worker: avoid building chrono's serde feature Alex Auvolat 2023-08-30 23:46:15 +02:00
f0a395e2e5 s3 bucket apis: remove redundant call Alex Auvolat 2023-08-30 23:39:28 +02:00
d94f1c9178 reference manual: remove obsolete caveat about multipart uploads Alex Auvolat 2023-08-30 23:27:02 +02:00
5c923d48d7 reference manual: document support for lifecycle configuration Alex Auvolat 2023-08-30 23:24:28 +02:00
a1d57283c0 bucket_table: bucketparams::new doesn't need to be pub Alex Auvolat 2023-08-30 20:07:14 +02:00
d2e94e36d6 lifecycle config: add missing line in merge() and remove tracing Alex Auvolat 2023-08-30 20:05:53 +02:00
75ccc5a95c lifecycle config: store date as given, try to debug Alex Auvolat 2023-08-30 20:02:07 +02:00
7200954318 lifecycle worker: add logging Alex Auvolat 2023-08-30 14:54:52 +02:00
0f1849e1ac lifecycle worker: launch with the rest of Garage Alex Auvolat 2023-08-30 14:51:08 +02:00
da8b224e24 lifecycle worker: skip entire bucket when no lifecycle config is set Alex Auvolat 2023-08-30 14:38:19 +02:00
2996dc875f lifecycle worker: implement main functionality Alex Auvolat 2023-08-30 14:28:48 +02:00
a2e0e34db5 lifecycle: skeleton for lifecycle worker Alex Auvolat 2023-08-30 12:41:11 +02:00
f7b409f114 use a NaiveDate in data model, it serializes to string (iso 8601 format) Alex Auvolat 2023-08-30 11:24:01 +02:00
abf011c290 lifecycle: implement validation into garage's internal data structure Alex Auvolat 2023-08-29 18:22:03 +02:00
8041d9a827 s3: add xml structures to serialize/deserialize lifecycle configs Alex Auvolat 2023-08-29 17:44:17 +02:00
0b83e0558e bucket_table: data model for lifecycle configuration Alex Auvolat 2023-08-29 16:44:27 +02:00
2e90e1c124 Merge branch 'main' into next v0.9.0-beta1 Alex Auvolat 2023-08-29 11:32:42 +02:00
32e5686ad8 Merge pull request 'Garage v0.8.3' (#619) from next-0.8 into main v0.8.3 Alex 2023-08-29 08:55:46 +00:00
06369c8f4a add garage_db dependency in garage_rpc Alex Auvolat 2023-08-28 15:04:18 +02:00
cece1be1bb bump version to 0.8.3 v0.8.3-rc1 Alex Auvolat 2023-08-28 13:17:26 +02:00
769b6fe054 fix test_website_check_domain Alex Auvolat 2023-08-28 12:40:28 +02:00