Deuxfleurs/garage
41
56
Fork 73
Code Issues 100 Pull requests 14 Releases 30 Wiki Activity
S3-compatible object store for small self-hosted geo-distributed deployments https://garagehq.deuxfleurs.fr/
113 commits 27 branches 74 tags 55 MiB
Rust 68.5%
Nix 28.3%
Clojure 1.3%
Shell 1.3%
Python 0.5%
Other 0.1%
Find a file
Alex Auvolat 16fbb32fd3 Rate limit requests a bit more seriously 
droping the slot later (after reading the request response)
means that we aren't freeing our quota slot,
so the maximum number of simultaneous requests now also counts the
response reading phase

TODO next: quotas per rpc destination node, or maybe per datacenter (?)
2020-05-01 19:18:54 +00:00
src Rate limit requests a bit more seriously 2020-05-01 19:18:54 +00:00
.gitignore Work on API 2020-04-28 10:18:14 +00:00
Cargo.lock Implement DeleteObjects 2020-05-01 15:52:35 +00:00
Cargo.toml Split code for modular compilation 2020-04-24 10:10:01 +00:00
genkeys.sh Cleanup 2020-04-12 19:18:31 +02:00
LICENSE First commit: skeleton for something great 2020-04-05 23:33:42 +02:00
Makefile Implement multipart uploads 2020-04-26 20:39:32 +00:00
README.md Make the repair command accept subcommands to not do everything all the time 2020-04-21 16:40:17 +00:00
rustfmt.toml Fix the Sync issue. Details: 2020-04-10 22:01:48 +02:00
test_delete.sh Do not insert deletion marker if there is no object to delete 2020-04-21 14:33:12 +00:00
test_read.sh More aggressive sync timings & improve other stuff 2020-04-19 17:59:59 +00:00
test_write.sh Better concurrency: 2020-04-22 16:51:52 +00:00
TODO update todo 2020-04-26 20:50:23 +00:00

README.md

Garage

THIS IS ALL WORK IN PROGRESS. NOTHING TO SEE YET BUT THANKS FOR YOUR INTEREST.

Garage implements an S3-compatible object store with high resiliency to network failures, machine failure, and sysadmin failure.

To log:

RUST_LOG=garage=debug cargo run --release -- server -c config_file.toml

What to repair

  • tables: to do a full sync of metadata, should not be necessary because it is done every hour by the system
  • versions and block_refs: very time consuming, usefull if deletions have not been propagated, improves garbage collection
  • blocks: very usefull to resync/rebalance blocks betweeen nodes