Commit graph

49 commits

Author SHA1 Message Date
Alex ddb2b29bfd
Rename datacenters into zones (doc not yet updated) 2021-05-28 14:07:36 +02:00
Alex b490ebc7f6
Many improvements on ring/replication and its configuration:
- Explicit "replication_mode" configuration parameters that takes
  either "none", "2" or "3" as values, instead of letting user configure
  replication factor themselves. These are presets whose corresponding
  replication/quorum values can be found in replication/mode.rs

- Explicit support for single-node and two-node deployments
  (number of nodes must be at least "replication_mode", with "none"
  we can have only one node)

- Ring is now stored much more compactly with 256*8 + n*32 bytes,
  instead of 256*32 bytes

- Support for gateway-only nodes that do not store data
  (these nodes still need a metadata_directory to store the list
  of bucket and keys since those are stored on all nodes; it also
  technically needs a data_directory to start but it will stay
  empty unless we have bugs)
2021-05-28 14:07:36 +02:00
Trinity Pointard e4b9e4e24d
rename types to CamelCase
All checks were successful
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
2021-05-03 22:15:09 +02:00
Trinity Pointard f05bb111c2
fix clippy warnings on util and rpc 2021-05-03 22:11:41 +02:00
Trinity Pointard 2812a027ea
change some more comments and revert changes on TableSchema
All checks were successful
continuous-integration/drone/push Build is passing
2021-04-27 16:49:07 +02:00
Trinity Pointard 74373aebcf
make most requested changes 2021-04-27 16:47:08 +02:00
Alex 16300bbd89
remove useless comment
All checks were successful
continuous-integration/drone/push Build is passing
2021-04-27 16:44:01 +02:00
Trinity Pointard f871689571
run cargo fmt on util and make missing doc warning 2021-04-27 16:37:10 +02:00
Trinity Pointard 8e0524ae15
document rpc crate 2021-04-27 16:37:10 +02:00
Alex 6b2b400292
small simplify 2021-04-27 16:37:09 +02:00
Alex 8c33d565d6
Merge discovery loop with consul 2021-04-27 16:37:09 +02:00
Alex 948e44a3f6
cargo fmt 2021-04-27 16:37:09 +02:00
Alex 3e2e38c830
Print stats 2021-04-27 16:37:09 +02:00
Alex 2e53e31cdd
Cargo fmt 2021-04-27 16:37:09 +02:00
Alex 64b91c2645
Keep old data 2021-04-27 16:37:09 +02:00
Alex e16077f40a
Persist directly and not in background 2021-04-27 16:37:09 +02:00
Alex 9ced9f78dc
Improve bootstraping: do it regularly; persist peer list 2021-04-27 16:37:08 +02:00
Alex f859d15062 update to v0.2.1
Some checks are pending
continuous-integration/drone/push Build is pending
2021-03-19 13:39:18 +01:00
Alex 4c26a0b9c1 Update Cargo.toml files with AGPL license info
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2021-03-18 21:59:17 +01:00
Alex dead945c8f Prepare for release 0.2
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-18 19:33:15 +01:00
Alex f4346cc5f4 Update dependencies
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-16 15:58:40 +01:00
Alex 2a41b82384 Simpler Merkle & sync
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-16 12:18:03 +01:00
Alex 1d9961e411 Simplify replication logic
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-16 11:14:27 +01:00
Alex 6a8439fd13 Some improvements in background worker but we terminate late
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-15 23:14:12 +01:00
Alex 0cd5b2ae19 WIP migrate to tokio 1
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-15 22:36:41 +01:00
Alex 4d4117f2b4 Refactor block resync loop; make workers infaillible
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-15 20:09:44 +01:00
Alex 537f652fec Tiny things
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-15 18:40:27 +01:00
Alex 3bf2df622a Time and metadata improvements
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-15 16:21:41 +01:00
Alex c475471e7a Implement table gc, currently for block_ref and version only
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-12 19:57:37 +01:00
Alex 046b649bcc (not well tested) use merkle tree for sync
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-11 18:28:27 +01:00
Alex 8d63738cb0 Checkpoint: add merkle tree in data table
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-11 13:47:21 +01:00
Alex 3214dd52dd Very minor changes
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-10 21:50:09 +01:00
Alex 6a3dcf3974 Rename n_tokens into capacity
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-10 14:52:03 +01:00
Alex 7cda917b6b update condition
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-05 17:08:03 +01:00
Alex d7e005251d Not fully tested: new multi-dc MagLev
All checks were successful
continuous-integration/drone/push Build is passing
2021-03-05 16:22:29 +01:00
Alex 20e6e9fa20 Update sled & try to debug deadlock (but its in sled...)
All checks were successful
continuous-integration/drone/push Build is passing
2021-02-23 21:27:28 +01:00
Alex 40763fd749 Cargo fmt 2021-02-23 18:46:25 +01:00
Alex 6e6f7e8555 Replace some checksums where it makes sense 2021-02-23 18:14:37 +01:00
Alex b1b640ae8b rename hash() to sha256sum(), we might want to change it at some places
All checks were successful
continuous-integration/drone/push Build is passing
2021-02-21 15:24:30 +01:00
Alex 80892df8cc Some refactoring
All checks were successful
continuous-integration/drone/push Build is passing
2021-02-21 13:11:10 +01:00
Alex 1d1d497e2b Bump everything to 0.1.1 2021-01-15 17:54:48 +01:00
Alex 8956db2a81 Make less things public 2020-12-12 17:58:19 +01:00
Alex a50fa70d45 Refactor error management in API part 2020-11-08 15:05:28 +01:00
Alex 3b0b11085e Add versions to dependencies 2020-07-07 14:18:47 +02:00
Alex cc65cdc0fe Add license, description and repository to .toml files 2020-07-07 14:14:58 +02:00
Alex fbe8fe81f2 Add automatic peer discovery from Consul 2020-06-30 18:33:14 +02:00
Alex 16fbb32fd3 Rate limit requests a bit more seriously
droping the slot later (after reading the request response)
means that we aren't freeing our quota slot,
so the maximum number of simultaneous requests now also counts the
response reading phase

TODO next: quotas per rpc destination node, or maybe per datacenter (?)
2020-05-01 19:18:54 +00:00
Alex d8f5e643bc Split code for modular compilation 2020-04-24 10:10:01 +00:00
Alex c9c6b0dbd4 Reorganize code 2020-04-23 17:05:46 +00:00