NLnet task 3 #667

Merged

lx merged 60 commits from nlnet-task3 into next-0.10 2024-01-11 10:58:08 +00:00

Conversation 0 Commits 60 Files Changed 41 +3284 -1668

60 Commits

Author	SHA1	Message	Date
Alex	0041b013a4	layout: refactoring and fix in layout helper	2023-12-11 16:09:22 +01:00
Alex	adccce1145	layout: refactor/fix bad while loop	2023-12-11 15:45:14 +01:00
Alex	85b5a6bcd1	fix some clippy lints	2023-12-11 15:31:47 +01:00
Alex	e4f493b481	table: remove redundant tracing in insert_many	2023-12-11 14:57:42 +01:00
Alex	f8df90b79b	table: fix insert_many to not send duplicates	2023-12-08 14:54:11 +01:00
Alex	4dbf254512	layout: refactoring, merge two files	2023-12-08 14:15:52 +01:00
Alex	64a6e557a4	rpc helper: small refactorings	2023-12-08 12:18:12 +01:00
Alex	5dd200c015	layout: move block_read_nodes_of to rpc_helper to avoid double-locking ... (in theory, this could have caused a deadlock)	2023-12-08 12:02:24 +01:00
Alex	063294dd56	layout version: refactor get_node_zone	2023-12-08 11:50:58 +01:00
Alex	7f2541101f	cli: improvements to the layout commands when multiple layouts are live	2023-12-08 11:24:23 +01:00
Alex	91b874c4ef	rpc: fix system::health	2023-12-08 10:36:37 +01:00
Alex	431b28e0cf	fix build with discovery features	2023-12-07 15:15:59 +01:00
Alex	9cecea64d4	layout: allow sync update tracker to progress with only quorums	2023-12-07 14:51:20 +01:00
Alex	aa59059a91	layout cli: safer skip-dead-nodes command	2023-12-07 11:56:14 +01:00
Alex	d90de365b3	table sync: use write quorums to report global success or failure of sync	2023-12-07 11:16:10 +01:00
Alex	95eb13eb08	rpc: refactor result tracking for quorum sets	2023-12-07 10:57:21 +01:00
Alex	c8356a91d9	layout updates: fix the set of nodes among which minima are calculated	2023-12-07 10:30:26 +01:00
Alex	c04dd8788a	admin: more info in admin GetClusterStatus	2023-11-28 14:25:04 +01:00
Alex	539af6eac4	rpc helper: write comments + small refactoring of tracing	2023-11-28 11:12:39 +01:00
Alex	c539077d30	cli: remove historic layout info from status	2023-11-27 16:22:27 +01:00
Alex	11e6fef93c	cli: add layout history and layout assume-sync commands	2023-11-27 16:22:25 +01:00
Alex	539a920313	cli: show when nodes are draining metadata	2023-11-27 13:18:59 +01:00
Alex	78362140f5	rpc: update system::health to take into account write sets for all partitions	2023-11-27 12:10:21 +01:00
Alex	d6d239fc79	block manager: read_block using old layout versions if necessary	2023-11-27 11:52:57 +01:00
Alex	3ecd14b9f6	table: implement write sets for insert_many	2023-11-16 16:41:45 +01:00
Alex	22f38808e7	rpc_helper: don't use tokio::spawn for individual requests	2023-11-16 16:34:01 +01:00
Alex	707442f5de	layout: refactor digests and add "!=" assertions before epidemic bcast	2023-11-16 13:51:40 +01:00
Alex	ad5c6f779f	layout: split helper in separate file; more precise difference tracking	2023-11-16 13:26:43 +01:00
Alex	d4df03424f	layout: fix test	2023-11-15 15:56:57 +01:00
Alex	33c8a489b0	layou: implement ack locking	2023-11-15 15:40:44 +01:00
Alex	393c4d4515	layout: add helper for cached/external values to centralize recomputation	2023-11-15 14:20:50 +01:00
Alex	65066c7064	layout: wip cache global mins	2023-11-15 13:28:30 +01:00
Alex	acd49de9f9	rpc: fix write set quorums	2023-11-15 13:07:42 +01:00
Alex	46007bf01d	integration test: print stdout and stderr on subcommand crash	2023-11-15 12:56:52 +01:00
Alex	b3e729f4b8	layout history merge: rm invalid versions when valid versions are added	2023-11-15 12:15:58 +01:00
Alex	7ef2c23120	layout: fix test	2023-11-14 15:45:01 +01:00
Alex	90e1619b1e	table: take into account multiple write sets in inserts	2023-11-14 15:40:46 +01:00
Alex	3b361d2959	layout: prepare for write sets	2023-11-14 14:28:16 +01:00
Alex	866196750f	system: add todo wrt new layout	2023-11-14 13:36:58 +01:00
Alex	83a11374ca	layout: fixes in schema	2023-11-14 13:29:26 +01:00
Alex	1aab1f4e68	layout: refactoring of all_nodes	2023-11-14 13:12:32 +01:00
Alex	8e292e06b3	layout: some refactoring of nongateway nodes	2023-11-14 12:48:38 +01:00
Alex	9a491fa137	layout: fix test	2023-11-11 13:10:59 +01:00
Alex	df24bb806d	layout/sync: fix bugs and add tracing	2023-11-11 12:44:27 +01:00
Alex	ce89d1ddab	table sync: adapt to new layout history	2023-11-11 12:08:32 +01:00
Alex	df36cf3099	layout: add helpers to LayoutHistory and prepare integration with Table	2023-11-09 16:32:31 +01:00
Alex	9d95f6f704	layout: fix tracker bugs	2023-11-09 15:52:45 +01:00
Alex	bad7cc812e	layout admin: add missing calls to update_hash	2023-11-09 15:42:10 +01:00
Alex	03ebf18830	layout: begin managing the update tracker values	2023-11-09 15:31:59 +01:00
Alex	94caf9c0c1	layout: separate code path for synchronizing update trackers only	2023-11-09 14:53:34 +01:00
Alex	bfb1845fdc	layout: refactor to use a RwLock on LayoutHistory	2023-11-09 14:12:05 +01:00
Alex	19ef1ec8e7	layout: more refactoring	2023-11-09 13:34:14 +01:00
Alex	8a2b1dd422	wip: split out layout management from System into separate LayoutManager	2023-11-09 12:55:36 +01:00
Alex	523d2ecb95	layout: use separate CRDT for staged layout changes	2023-11-09 11:19:43 +01:00
Alex	1da0a5676e	bump garage protocol version tag to 0x000A (0.10)	2023-11-08 19:30:58 +01:00
Alex	8dccee3ccf	cluster layout: adapt all uses of ClusterLayout to LayoutHistory	2023-11-08 19:28:36 +01:00
Alex	fe9af1dcaa	WIP: garage_rpc: store layout version history	2023-11-08 17:49:06 +01:00
Alex	4a9c94514f	avoid using layout_watch in System directly	2023-11-08 16:41:00 +01:00
Alex	12d1dbfc6b	remove Ring and use ClusterLayout everywhere	2023-11-08 15:41:24 +01:00
Alex	0962313ebd	garage_rpc: reorder functions in layout.rs	2023-11-08 13:13:04 +01:00