Deuxfleurs
/
garage
42
39
Fork 55
Code Issues 71 Pull Requests 8 Releases 29 Wiki Activity
garage/src/rpc/Cargo.toml

58 lines
1.8 KiB
TOML
Raw Normal View History

Split code for modular compilation
2020-04-24 10:10:01 +00:00
[package]
name = "garage_rpc"
Bump version to 0.7 because of incompatible Netapp
2022-02-24 12:25:28 +00:00
version = "0.7.0"
Split code for modular compilation
2020-04-24 10:10:01 +00:00
authors = ["Alex Auvolat <alex@adnab.me>"]
edition = "2018"
Update Cargo.toml files with AGPL license info
2021-03-18 20:59:17 +00:00
license = "AGPL-3.0"
Add license, description and repository to .toml files
2020-07-07 12:14:58 +00:00
description = "Cluster membership management and RPC protocol for the Garage object store"
repository = "https://git.deuxfleurs.fr/Deuxfleurs/garage"
Improve how node roles are assigned in Garage - change the terminology: the network configuration becomes the role table, the configuration of a nodes becomes a node's role - the modification of the role table takes place in two steps: first, changes are staged in a CRDT data structure. Then, once the user is happy with the changes, they can commit them all at once (or revert them). - update documentation - fix tests - implement smarter partition assignation algorithm This patch breaks the format of the network configuration: when migrating, the cluster will be in a state where no roles are assigned. All roles must be re-assigned and commited at once. This migration should not pose an issue.
2021-11-09 11:24:04 +00:00
readme = "../../README.md"
Split code for modular compilation
2020-04-24 10:10:01 +00:00
[lib]
path = "lib.rs"
# See more keys and their definitions at https://doc.rust-lang.org/cargo/reference/manifest.html
[dependencies]
Bump version to 0.7 because of incompatible Netapp
2022-02-24 12:25:28 +00:00
garage_util = { version = "0.7.0", path = "../util" }
Prepare for v0.3.0 and add migration path from v0.2.1.x
2021-05-28 11:58:47 +00:00
Update dependencies
2021-03-16 14:58:40 +00:00
arc-swap = "1.0"
Update Cargo.toml files with AGPL license info
2021-03-18 20:59:17 +00:00
bytes = "1.0"
Split code for modular compilation
2020-04-24 10:10:01 +00:00
gethostname = "0.2"
First version of admin API (#298) **Spec:** - [x] Start writing - [x] Specify all layout endpoints - [x] Specify all endpoints for operations on keys - [x] Specify all endpoints for operations on key/bucket permissions - [x] Specify all endpoints for operations on buckets - [x] Specify all endpoints for operations on bucket aliases View rendered spec at <https://git.deuxfleurs.fr/Deuxfleurs/garage/src/branch/admin-api/doc/drafts/admin-api.md> **Code:** - [x] Refactor code for admin api to use common api code that was created for K2V **General endpoints:** - [x] Metrics - [x] GetClusterStatus - [x] ConnectClusterNodes - [x] GetClusterLayout - [x] UpdateClusterLayout - [x] ApplyClusterLayout - [x] RevertClusterLayout **Key-related endpoints:** - [x] ListKeys - [x] CreateKey - [x] ImportKey - [x] GetKeyInfo - [x] UpdateKey - [x] DeleteKey **Bucket-related endpoints:** - [x] ListBuckets - [x] CreateBucket - [x] GetBucketInfo - [x] DeleteBucket - [x] PutBucketWebsite - [x] DeleteBucketWebsite **Operations on key/bucket permissions:** - [x] BucketAllowKey - [x] BucketDenyKey **Operations on bucket aliases:** - [x] GlobalAliasBucket - [x] GlobalUnaliasBucket - [x] LocalAliasBucket - [x] LocalUnaliasBucket **And also:** - [x] Separate error type for the admin API (this PR includes a quite big refactoring of error handling) - [x] Add management of website access - [ ] Check that nothing is missing wrt what can be done using the CLI - [ ] Improve formatting of the spec - [x] Make sure everyone is cool with the API design Fix #231 Fix #295 Co-authored-by: Alex Auvolat <alex@adnab.me> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/298 Co-authored-by: Alex <alex@adnab.me> Co-committed-by: Alex <alex@adnab.me>
2022-05-24 10:16:39 +00:00
git-version = "0.3.4"
Update Cargo.toml files with AGPL license info
2021-03-18 20:59:17 +00:00
hex = "0.4"
Add tracing integration with opentelemetry
2022-02-17 22:28:23 +00:00
tracing = "0.1.30"
First port of Garage to Netapp
2021-10-14 09:50:12 +00:00
rand = "0.8"
sodiumoxide = { version = "0.2.5-0", package = "kuska-sodiumoxide" }
Split code for modular compilation
2020-04-24 10:10:01 +00:00
First port of Garage to Netapp
2021-10-14 09:50:12 +00:00
async-trait = "0.1.7"
Update dependencies
2021-03-16 14:58:40 +00:00
rmp-serde = "0.15"
Split code for modular compilation
2020-04-24 10:10:01 +00:00
serde = { version = "1.0", default-features = false, features = ["derive", "rc"] }
Improve how node roles are assigned in Garage - change the terminology: the network configuration becomes the role table, the configuration of a nodes becomes a node's role - the modification of the role table takes place in two steps: first, changes are staged in a CRDT data structure. Then, once the user is happy with the changes, they can commit them all at once (or revert them). - update documentation - fix tests - implement smarter partition assignation algorithm This patch breaks the format of the network configuration: when migrating, the cluster will be in a state where no roles are assigned. All roles must be re-assigned and commited at once. This migration should not pose an issue.
2021-11-09 11:24:04 +00:00
serde_bytes = "0.11"
Add automatic peer discovery from Consul
2020-06-30 16:33:14 +00:00
serde_json = "1.0"
Split code for modular compilation
2020-04-24 10:10:01 +00:00
add support for kubernetes service discovery This commit adds support to discover garage instances running in kubernetes. Once enabled by setting `kubernetes_namespace` and `kubernetes_service_name` garage will create a Custom Resources `garagenodes.deuxfleurs.fr` with nodes public key as the resource name. and IP and Port information as spec in the namespace configured by `kubernetes_namespace`. For discovering nodes the resources are filtered with the optionally set `kubernetes_service_name` which sets a label `garage.deuxfleurs.fr/service` on the resources. This allows to separate multiple garage deployments in a single namespace. the `kubernetes_skip_crd` variable allows to disable the creation of the CRD by garage itself. The user must deploy this manually.
2022-03-06 13:50:00 +00:00
# newer version requires rust edition 2021
Add feature flag for Kubernetes discovery
2022-03-16 11:09:50 +00:00
kube = { version = "0.62", features = ["runtime", "derive"], optional = true }
k8s-openapi = { version = "0.13", features = ["v1_22"], optional = true }
openssl = { version = "0.10", features = ["vendored"], optional = true }
schemars = { version = "0.8", optional = true }
add support for kubernetes service discovery This commit adds support to discover garage instances running in kubernetes. Once enabled by setting `kubernetes_namespace` and `kubernetes_service_name` garage will create a Custom Resources `garagenodes.deuxfleurs.fr` with nodes public key as the resource name. and IP and Port information as spec in the namespace configured by `kubernetes_namespace`. For discovering nodes the resources are filtered with the optionally set `kubernetes_service_name` which sets a label `garage.deuxfleurs.fr/service` on the resources. This allows to separate multiple garage deployments in a single namespace. the `kubernetes_skip_crd` variable allows to disable the creation of the CRD by garage itself. The user must deploy this manually.
2022-03-06 13:50:00 +00:00
# newer version requires rust edition 2021
Add feature flag for Kubernetes discovery
2022-03-16 11:09:50 +00:00
pnet_datalink = "0.28"
add support for kubernetes service discovery This commit adds support to discover garage instances running in kubernetes. Once enabled by setting `kubernetes_namespace` and `kubernetes_service_name` garage will create a Custom Resources `garagenodes.deuxfleurs.fr` with nodes public key as the resource name. and IP and Port information as spec in the namespace configured by `kubernetes_namespace`. For discovering nodes the resources are filtered with the optionally set `kubernetes_service_name` which sets a label `garage.deuxfleurs.fr/service` on the resources. This allows to separate multiple garage deployments in a single namespace. the `kubernetes_skip_crd` variable allows to disable the creation of the CRD by garage itself. The user must deploy this manually.
2022-03-06 13:50:00 +00:00
Split code for modular compilation
2020-04-24 10:10:01 +00:00
futures = "0.3"
futures-util = "0.3"
WIP migrate to tokio 1
2021-03-15 21:36:41 +00:00
tokio = { version = "1.0", default-features = false, features = ["rt", "rt-multi-thread", "io-util", "net", "time", "macros", "sync", "signal", "fs"] }
Update dependencies
2021-03-16 14:58:40 +00:00
tokio-stream = { version = "0.1", features = ["net"] }
Add many metrics in table/ and rpc/
2022-02-16 13:23:04 +00:00
opentelemetry = "0.17"
Split code for modular compilation
2020-04-24 10:10:01 +00:00
Use published netapp crate instead of git repo
2021-10-26 08:36:57 +00:00
#netapp = { version = "0.3.0", git = "https://git.deuxfleurs.fr/lx/netapp" }
Update to Netapp 0.4 which supports distributed tracing
2022-02-18 19:39:55 +00:00
#netapp = { version = "0.4", path = "../../../netapp", features = ["telemetry"] }
Update netapp to 0.4.4, fix #300
2022-05-09 10:08:47 +00:00
netapp = { version = "0.4.4", features = ["telemetry"] }
Update to Netapp 0.4 which supports distributed tracing
2022-02-18 19:39:55 +00:00
Improvements to CLI and various fixes for netapp version Discovery via consul, persist peer list to file
2021-10-15 09:05:09 +00:00
hyper = { version = "0.14", features = ["client", "http1", "runtime", "tcp"] }
Split code for modular compilation
2020-04-24 10:10:01 +00:00
First implementation of K2V (#293) **Specification:** View spec at [this URL](https://git.deuxfleurs.fr/Deuxfleurs/garage/src/branch/k2v/doc/drafts/k2v-spec.md) - [x] Specify the structure of K2V triples - [x] Specify the DVVS format used for causality detection - [x] Specify the K2V index (just a counter of number of values per partition key) - [x] Specify single-item endpoints: ReadItem, InsertItem, DeleteItem - [x] Specify index endpoint: ReadIndex - [x] Specify multi-item endpoints: InsertBatch, ReadBatch, DeleteBatch - [x] Move to JSON objects instead of tuples - [x] Specify endpoints for polling for updates on single values (PollItem) **Implementation:** - [x] Table for K2V items, causal contexts - [x] Indexing mechanism and table for K2V index - [x] Make API handlers a bit more generic - [x] K2V API endpoint - [x] K2V API router - [x] ReadItem - [x] InsertItem - [x] DeleteItem - [x] PollItem - [x] ReadIndex - [x] InsertBatch - [x] ReadBatch - [x] DeleteBatch **Testing:** - [x] Just a simple Python script that does some requests to check visually that things are going right (does not contain parsing of results or assertions on returned values) - [x] Actual tests: - [x] Adapt testing framework - [x] Simple test with InsertItem + ReadItem - [x] Test with several Insert/Read/DeleteItem + ReadIndex - [x] Test all combinations of return formats for ReadItem - [x] Test with ReadBatch, InsertBatch, DeleteBatch - [x] Test with PollItem - [x] Test error codes - [ ] Fix most broken stuff - [x] test PollItem broken randomly - [x] when invalid causality tokens are given, errors should be 4xx not 5xx **Improvements:** - [x] Descending range queries - [x] Specify - [x] Implement - [x] Add test - [x] Batch updates to index counter - [x] Put K2V behind `k2v` feature flag Co-authored-by: Alex Auvolat <alex@adnab.me> Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/293 Co-authored-by: Alex <alex@adnab.me> Co-committed-by: Alex <alex@adnab.me>
2022-05-10 11:16:57 +00:00
Add feature flag for Kubernetes discovery
2022-03-16 11:09:50 +00:00
[features]
kubernetes-discovery = [ "kube", "k8s-openapi", "openssl", "schemars" ]