Deuxfleurs/garage
42
39
Fork 55
Code Issues 71 Pull requests 7 Releases 29 Wiki Activity
1973 commits 23 branches 73 tags 55 MiB
Commit graph

178 commits

Author SHA1 Message Date
Alex b9127dd6f8
Prepare for v0.3.0 and add migration path from v0.2.1.x
Some checks reported errors
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build was killed
Details
2021-05-28 15:29:58 +02:00
Alex b490ebc7f6
Many improvements on ring/replication and its configuration: 
- Explicit "replication_mode" configuration parameters that takes
  either "none", "2" or "3" as values, instead of letting user configure
  replication factor themselves. These are presets whose corresponding
  replication/quorum values can be found in replication/mode.rs

- Explicit support for single-node and two-node deployments
  (number of nodes must be at least "replication_mode", with "none"
  we can have only one node)

- Ring is now stored much more compactly with 256*8 + n*32 bytes,
  instead of 256*32 bytes

- Support for gateway-only nodes that do not store data
  (these nodes still need a metadata_directory to store the list
  of bucket and keys since those are stored on all nodes; it also
  technically needs a data_directory to start but it will stay
  empty unless we have bugs)
 2021-05-28 14:07:36 +02:00
Trinity Pointard e4b9e4e24d
rename types to CamelCase
All checks were successful
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2021-05-03 22:15:09 +02:00
Trinity Pointard f5a0cf0414
fix clippy warnings on table 2021-05-03 22:11:41 +02:00
Trinity Pointard 2812a027ea
change some more comments and revert changes on TableSchema
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-04-27 16:49:07 +02:00
Trinity Pointard 74373aebcf
make most requested changes 2021-04-27 16:47:08 +02:00
Trinity Pointard b437610812
attempt at documenting table crate 2021-04-27 16:37:10 +02:00
Alex 9ced9f78dc
Improve bootstraping: do it regularly; persist peer list 2021-04-27 16:37:08 +02:00
Alex f859d15062 update to v0.2.1
Some checks are pending
continuous-integration/drone/push Build is pending
Details
2021-03-19 13:39:18 +01:00
Alex 4c26a0b9c1 Update Cargo.toml files with AGPL license info
All checks were successful
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/tag Build is passing
Details
2021-03-18 21:59:17 +01:00
Alex dead945c8f Prepare for release 0.2
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-18 19:33:15 +01:00
Alex 390ab02f41 Todo make a test for the Merkle updater
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-16 20:13:07 +01:00
Alex 7b10245dfb Leader-based GC
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-16 18:42:33 +01:00
Alex 3fadc5cbbd Small changes 2021-03-16 16:35:10 +01:00
Alex f4346cc5f4 Update dependencies
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-16 15:58:40 +01:00
Alex 2a41b82384 Simpler Merkle & sync
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-16 12:18:03 +01:00
Alex 0aad2f2e06 some reordering
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-16 11:47:39 +01:00
Alex 515029d026 Refactor code
Some checks reported errors
continuous-integration/drone/push Build was killed
Details
2021-03-16 11:43:58 +01:00
Alex 1d9961e411 Simplify replication logic
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-16 11:14:27 +01:00
Alex 6a8439fd13 Some improvements in background worker but we terminate late
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-15 23:14:12 +01:00
Alex 0cd5b2ae19 WIP migrate to tokio 1
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-15 22:36:41 +01:00
Alex 4d4117f2b4 Refactor block resync loop; make workers infaillible
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-15 20:09:44 +01:00
Alex 667e4e72a8 Small fixes 2021-03-15 19:51:16 +01:00
Alex 537f652fec Tiny things
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-15 18:40:27 +01:00
Alex 0290afe1f8 Make block rc code more understandable 2021-03-15 18:27:26 +01:00
Alex 3bf2df622a Time and metadata improvements
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-15 16:21:41 +01:00
Alex 9b118160a8 Optim & refactor
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-12 22:06:56 +01:00
Alex 831eb35763 cargo fmt
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-12 21:52:19 +01:00
Alex c475471e7a Implement table gc, currently for block_ref and version only
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-12 19:57:37 +01:00
Alex a1442f072a Implement garage stats to get info on node contents
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-12 15:40:54 +01:00
Alex cbe7e1a66a Move table rpc client out of tableaux
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-12 15:07:23 +01:00
Alex 8860aa19b8 Make syncer have its own rpc client/server 2021-03-12 15:05:26 +01:00
Alex 1fea257291 Don't sync at beginning
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-12 14:51:17 +01:00
Alex 7fdaf7aef0 Fix merkle updater not being notified; improved logging
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-12 14:37:46 +01:00
Alex 1ec49980ec whoops
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-11 19:30:24 +01:00
Alex 3f7a496355 More security: don't delete stuff too easily
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-11 19:06:27 +01:00
Alex f7c2cd1cd7 Add comment, and also whoops, this wasn't doing what we expected
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-11 18:56:18 +01:00
Alex fae5104a2c Add a nice warning
Some checks failed
continuous-integration/drone/push Build is failing
Details
2021-03-11 18:50:32 +01:00
Alex db7a9d4948 Tiny changes
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-11 18:45:26 +01:00
Alex 046b649bcc (not well tested) use merkle tree for sync
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-11 18:28:27 +01:00
Alex 94f3d28774 WIP big refactoring
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-11 16:54:15 +01:00
Alex 8d63738cb0 Checkpoint: add merkle tree in data table
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-11 13:47:21 +01:00
Alex 3214dd52dd Very minor changes
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-10 21:50:09 +01:00
Alex 2afd2c81ba Change hash function to blake2 for partition keys based on strings 2021-03-10 16:23:57 +01:00
Alex f319a7d374 Refactor model stuff, including cleaner CRDTs 2021-03-10 16:21:56 +01:00
Alex d7e005251d Not fully tested: new multi-dc MagLev
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-03-05 16:22:29 +01:00
Alex 3882d5ba36 Remove epidemic propagation for fully replicated stuff: write directly to all nodes 2021-03-05 15:09:18 +01:00
Alex 09fd6ea7f0 I was tired yesterday
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-02-24 11:05:59 +01:00
Alex a52ab69640 fix misuse of sled transactions
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-02-23 22:45:36 +01:00
Alex 20e6e9fa20 Update sled & try to debug deadlock (but its in sled...)
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-02-23 21:27:28 +01:00
Alex bf25c95fe2 Make updated() be a sync function that doesn't fail 2021-02-23 20:25:15 +01:00
Alex 28bc967c83 Handle correctly deletion dues to offloading
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-02-23 19:59:43 +01:00
Alex 55156cca9d Several changes in table_sync: 
- separate path for case of offloading a partition we don't store
- use sync::Mutex instead of tokio::Mutex, make less fn's async
 2021-02-23 19:11:02 +01:00
Alex 40763fd749 Cargo fmt 2021-02-23 18:46:25 +01:00
Alex 6e6f7e8555 Replace some checksums where it makes sense 2021-02-23 18:14:37 +01:00
Alex b1b640ae8b rename hash() to sha256sum(), we might want to change it at some places
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-02-21 15:24:30 +01:00
Alex 80892df8cc Some refactoring
All checks were successful
continuous-integration/drone/push Build is passing
Details
2021-02-21 13:11:10 +01:00
Alex 1d1d497e2b Bump everything to 0.1.1 2021-01-15 17:54:48 +01:00
Quentin 1e10c6a61c Doc tests that do not compile/work must be tagged with ignore 2021-01-15 17:03:38 +01:00
Alex 5c6c067b0c More documentation on CRDTs (we should probably extract this to a 
standalone crate!)
 2020-12-12 17:06:40 +01:00
Alex 0b3084ca5f Merge branch 'master' into doc/model 2020-12-12 16:05:28 +01:00
Alex 4a5bbbb810 Propose ETag fix 2020-12-05 19:23:46 +01:00
Quentin cbd10c1b0a Add some doc on LWW 2020-11-23 18:17:48 +01:00
Quentin 8722e27600 CRDT doc 2020-11-23 17:49:21 +01:00
Alex a8b3c8fd58 data hexdump in warning 2020-11-20 23:53:54 +01:00
Alex f9be964c3f Warning when cannot decode entry (data format incompatibilities) 2020-11-20 23:53:54 +01:00
Alex 4f7f1d1cb3 less type bounds 2020-11-20 23:53:54 +01:00
Alex 173f0dbac9 oops 2020-11-20 23:53:54 +01:00
Alex f8a04852a2 Convert bucket table to better CRDT representation 2020-11-20 23:53:54 +01:00
Alex e02e9e035e Begin improve model to use better CRDTs 2020-11-20 23:53:54 +01:00
Alex e9fd265ce6 Slight refactoring to make things clearer with DeletedFilter 2020-11-20 20:11:04 +01:00
Alex a50fa70d45 Refactor error management in API part 2020-11-08 15:05:28 +01:00
Alex 44dba0e53c cargo fmt 2020-07-08 17:34:37 +02:00
Alex 86bf4dedac Add support for model migrations 2020-07-08 16:10:53 +02:00
Alex 3b0b11085e Add versions to dependencies 2020-07-07 14:18:47 +02:00
Alex cc65cdc0fe Add license, description and repository to .toml files 2020-07-07 14:14:58 +02:00
Alex d8f5e643bc Split code for modular compilation 2020-04-24 10:10:01 +00:00
Alex c9c6b0dbd4 Reorganize code 2020-04-23 17:05:46 +00:00