47 commits

Author	SHA1	Message	Date
Alex	8bfc16ba7d	Merge branch 'main' into next-0.10	2024-03-28 15:01:05 +01:00
Alex	0d3e285d13	[fix-buffering] implement block_ram_buffer_max to avoid excessive RAM usage	2024-03-27 16:22:40 +01:00
Alex	01a0bd5410	[next-0.10] remove impl Deref for LayoutHelper	2024-03-27 13:32:13 +01:00
Alex	eb4a6ce106	Merge branch 'main' into next-0.10	2024-02-15 14:06:34 +01:00
Alex	125c662860	[import-netapp] move and rename FullMeshPeeringSrategy to PeeringManager	2024-02-15 12:15:35 +01:00
Alex	5ea24254a9	[import-netapp] import Netapp code into Garage codebase	2024-02-15 12:15:07 +01:00
Alex	0041b013a4	layout: refactoring and fix in layout helper	2023-12-11 16:09:22 +01:00
Alex	85b5a6bcd1	fix some clippy lints	2023-12-11 15:31:47 +01:00
Alex	64a6e557a4	rpc helper: small refactorings	2023-12-08 12:18:12 +01:00
Alex	5dd200c015	layout: move block_read_nodes_of to rpc_helper to avoid double-locking ... (in theory, this could have caused a deadlock)	2023-12-08 12:02:24 +01:00
Alex	95eb13eb08	rpc: refactor result tracking for quorum sets	2023-12-07 10:57:21 +01:00
Alex	539af6eac4	rpc helper: write comments + small refactoring of tracing	2023-11-28 11:12:39 +01:00
Alex	d6d239fc79	block manager: read_block using old layout versions if necessary	2023-11-27 11:52:57 +01:00
Alex	22f38808e7	rpc_helper: don't use tokio::spawn for individual requests	2023-11-16 16:34:01 +01:00
Alex	393c4d4515	layout: add helper for cached/external values to centralize recomputation	2023-11-15 14:20:50 +01:00
Alex	acd49de9f9	rpc: fix write set quorums	2023-11-15 13:07:42 +01:00
Alex	90e1619b1e	table: take into account multiple write sets in inserts	2023-11-14 15:40:46 +01:00
Alex	bfb1845fdc	layout: refactor to use a RwLock on LayoutHistory	2023-11-09 14:12:05 +01:00
Alex	fe9af1dcaa	WIP: garage_rpc: store layout version history	2023-11-08 17:49:06 +01:00
Alex	12d1dbfc6b	remove Ring and use ClusterLayout everywhere	2023-11-08 15:41:24 +01:00
Alex	638c5a3ce0	PollRange: add extra RPC delay after quorum is achieved, ... to give a chance to the 3rd node to respond	2023-01-11 16:12:07 +01:00
Alex	d56c472712	Refactor background runner and get rid of job worker	2022-12-14 12:51:42 +01:00
Alex	ded444f6c9	Ability to have custom timeouts in request strategy (not used)	2022-09-20 16:01:41 +02:00
Alex	56592e1853	RPC performance changes ... - configurable ping timeout - single, much higher, configurable RPC timeout - no more concurrency semaphore	2022-09-19 20:31:00 +02:00
Alex	1ef87ac4cb	cargo fmt	2022-09-02 13:38:29 +02:00
Alex	99b532b85b	Apply PRIO_SECONDARY to block data transfers	2022-09-01 16:35:43 +02:00
Alex	df094bd807	Less strict timeouts	2022-09-01 16:30:44 +02:00
Alex	bc977f9a7a	Update to Netapp with OrderTag support and exploit OrderTags	2022-09-01 12:58:20 +02:00
Alex	322dafc761	Try to fix clippy	2022-08-29 17:32:45 +02:00
Alex	e935861854	Factor out node request order selection logic & use in manager	2022-07-29 12:25:03 +02:00
Alex	605a630333	Use streaming in block manager	2022-07-29 12:25:02 +02:00
Alex	8e7e680afe	First adaptation to WIP netapp with streaming body	2022-07-29 12:25:02 +02:00
Alex	ba6b56ae68	Fix some new clippy lints	2022-03-14 12:27:49 +01:00
Alex	2377a92f6b	Add wrapper over sled tree to count items (used for big queues)	2022-03-14 10:54:25 +01:00
Alex	f869ca625d	Add spans to table calls, change span names in RPC	2022-03-14 10:54:12 +01:00
Alex	dc8d0496cc	Refactoring: rename config files, make modifications less invasive	2022-03-14 10:53:51 +01:00
Alex	2a5609b292	Add metrics to API endpoint	2022-03-14 10:53:36 +01:00
Alex	818daa5c78	Refactor how durations are measured	2022-03-14 10:53:35 +01:00
Alex	bb04d94fa9	Update to Netapp 0.4 which supports distributed tracing	2022-03-14 10:52:30 +01:00
Alex	8c2fb0c066	Add tracing integration with opentelemetry	2022-03-14 10:52:13 +01:00
Alex	2cab84b1fe	Add many metrics in table/ and rpc/	2022-03-14 10:51:50 +01:00
Alex	c94406f428	Improve how node roles are assigned in Garage ... - change the terminology: the network configuration becomes the role table, the configuration of a nodes becomes a node's role - the modification of the role table takes place in two steps: first, changes are staged in a CRDT data structure. Then, once the user is happy with the changes, they can commit them all at once (or revert them). - update documentation - fix tests - implement smarter partition assignation algorithm This patch breaks the format of the network configuration: when migrating, the cluster will be in a state where no roles are assigned. All roles must be re-assigned and commited at once. This migration should not pose an issue.	2021-11-16 16:05:53 +01:00
Alex	e8811f7c9d	Request strategy: don't launch all 3 requests if not needed	2021-11-04 16:19:27 +01:00
Alex	6f13d083ab	Add semaphore to limit RAM used by buffered outgoing requests	2021-11-03 18:02:57 +01:00
Alex	de4276202a	Improve CLI, adapt tests, update documentation	2021-10-25 14:21:48 +02:00
Alex	1b450c4b49	Improvements to CLI and various fixes for netapp version ... Discovery via consul, persist peer list to file	2021-10-22 16:55:24 +02:00
Alex	4067797d01	First port of Garage to Netapp	2021-10-22 15:55:18 +02:00