254 commits

Author	SHA1	Message	Date
Alex Auvolat	897cbf2c27	actually update rmp-serde to 1.1.2 for both garage and netapp dependency (fix #629)	2023-09-27 13:13:00 +02:00
Alex Auvolat	ad82035b98	Merge branch 'main' into next	2023-09-27 13:11:52 +02:00
Alex Auvolat	3ecc17f8c5	new layout: use deterministic randomness for reproducible results	2023-09-21 11:21:35 +02:00
Alex Auvolat	0088599f52	new layout: fix clippy lints	2023-09-18 12:17:07 +02:00
Alex Auvolat	749b4865d0	new layout: improve display and fix comments	2023-09-18 12:07:45 +02:00
Alex Auvolat	015ccb39aa	new layout: make zone_redundancy optionnal (if not set, is maximum)	2023-09-18 11:59:08 +02:00
Alex Auvolat	2e229d4430	new layout: improve output display	2023-09-12 17:24:51 +02:00
Alex Auvolat	91e764a2bf	fix hang on shutdown	2023-09-12 14:35:48 +02:00
Alex Auvolat	fd7d8fec59	Merge branch 'main' into next	2023-09-11 23:09:20 +02:00
Alex Auvolat	9cfe55ab60	fix 32-bit build	2023-09-11 20:01:29 +02:00
Alex Auvolat	51abbb02d8	Merge branch 'main' into next	2023-09-11 20:00:02 +02:00
Alex Auvolat	d5bb50d738	use statvfs instead of mount list to determine free data/meta space (fix #611)	2023-09-11 19:08:24 +02:00
Alex Auvolat	ad6b1cc0be	Merge branch 'main' into next	2023-09-11 13:14:18 +02:00
Alex Auvolat	2f112ac682	correct free data space accounting for multiple data dirs on same fs	2023-09-07 14:42:20 +02:00
Alex Auvolat	71c0188055	block manager: skeleton for multi-hdd support	2023-09-06 16:35:28 +02:00
Alex Auvolat	51eac97260	update version to 0.8.4	2023-09-05 23:28:12 +02:00
Alex Auvolat	e78566591b	Revert netapp update, hold to version 0.5.2 that uses rmp-serde 0.15	2023-09-05 23:23:23 +02:00
Alex Auvolat	2e90e1c124	Merge branch 'main' into next	2023-08-29 11:32:42 +02:00
Alex Auvolat	06369c8f4a	add garage_db dependency in garage_rpc	2023-08-28 17:08:21 +02:00
Alex Auvolat	cece1be1bb	bump version to 0.8.3	2023-08-28 13:17:26 +02:00
Jonathan Davies	d66d81ae2d	cargo: Updated gethostname v0.2.3 -> v0.4.3.	2023-08-28 09:30:27 +00:00
Alex Auvolat	35c108b85d	admin api: switch GetClusterHealth to camelcase (fix #381 again)	2023-06-14 13:53:19 +02:00
Alex Auvolat	cda957b4b1	update netapp's rmp-serde dependency to v1.1	2023-06-13 17:34:49 +02:00
Alex Auvolat	90b2d43eb4	Merge branch 'main' into next	2023-06-13 17:14:11 +02:00
Alex Auvolat	38d6ac4295	New multipart upload table layout	2023-06-09 16:23:37 +02:00
Roberto Hidalgo	b770504126	simplify code according to feedback	2023-05-22 08:57:15 -06:00
Roberto Hidalgo	6b69404f1a	rename mode to consul_http_api	2023-05-22 08:57:15 -06:00
Roberto Hidalgo	011f473048	revert rpc/Cargo.toml	2023-05-22 08:57:15 -06:00
Roberto Hidalgo	fd7dbea5b8	follow feedback, fold into existing feature	2023-05-22 08:57:15 -06:00
Roberto Hidalgo	bd6485565e	allow additional ServiceMeta, docs	2023-05-22 08:57:15 -06:00
Roberto Hidalgo	4d6e6fc155	cargo fmt	2023-05-22 08:57:15 -06:00
Roberto Hidalgo	02ba9016ab	register consul services against local agent instead of catalog api	2023-05-22 08:57:15 -06:00
Alex Auvolat	351d734e6c	Merge branch 'main' into next	2023-05-09 12:40:08 +02:00
Jakub Jirutka	d2deee0b8b	Declare garage crates using workspace.dependencies ... This will allow to really disable "sled" feature without declaring `default-features = false` in every Cargo.toml where garage_db and garage_model is used. See https://doc.rust-lang.org/cargo/reference/workspaces.html#the-dependencies-table	2023-05-09 08:46:15 +00:00
Alex Auvolat	fa78d806e3	Merge branch 'main' into next	2023-04-25 12:34:26 +02:00
Alex Auvolat	0a1ddcf630	Prepare for v0.8.2	2023-03-13 18:46:31 +01:00
Alex Auvolat	f37ec584b6	Merge branch 'main' into rustversion-label	2023-03-13 16:14:13 +01:00
Jonathan Davies	25f2a46fc3	rpc/system_metrics.rs: Added rustversion label to garage_build_info metric.	2023-03-10 14:46:44 +00:00
teutat3s	f0717dd169	Bump pnet_datalink 0.28 -> 0.33 ... Motivation: building garage on illumos is only possible since pnet_datalink version 0.30 Changelog: https://github.com/libpnet/libpnet/compare/v0.28.0...v0.33.0	2023-02-28 16:06:43 +01:00
Alex Auvolat	8e93d69974	More clippy fixes	2023-01-26 17:26:32 +01:00
Alex Auvolat	590a0a8450	Merge branch 'main' into k2v-watch-range-2	2023-01-26 16:46:40 +01:00
Alex Auvolat	94d559ae00	Merge branch 'main' into report-disk-usage	2023-01-26 16:20:41 +01:00
Alex Auvolat	c7d0ad0aa0	Add local disk usage to exported prometheus metrics	2023-01-26 15:30:36 +01:00
Alex Auvolat	efb6b6e868	Disk space report ... Report available disk space on nodes and calculate cluster-wide available space in `garage stats` (fix #479)	2023-01-26 15:04:32 +01:00
Jonathan Davies	20c1cdf662	Cargo.toml: Loosen tracing dependency to just 0.1.	2023-01-26 11:13:11 +00:00
Alex Auvolat	84b4a868e3	Migration of cluster layout from v0.8 to v0.9	2023-01-11 17:47:46 +01:00
Alex Auvolat	dac254a6e7	Merge branch 'main' into k2v-watch-range-2	2023-01-11 17:09:37 +01:00
Alex Auvolat	638c5a3ce0	PollRange: add extra RPC delay after quorum is achieved, ... to give a chance to the 3rd node to respond	2023-01-11 16:12:07 +01:00
Jonathan Davies	df1d9a9873	system.rs: Integrated SystemMetrics into System implementation.	2023-01-10 10:39:50 +00:00
Jonathan Davies	aac348fe93	Added system_metrics.rs file.	2023-01-10 10:38:50 +00:00
Jonathan Davies	cb07e6145c	Changed all instances of assignation to assignment.	2023-01-05 11:09:25 +00:00
Alex Auvolat	570e5e5bbb	Merge branch 'main' into next	2023-01-04 11:34:43 +01:00
Alex Auvolat	1fc220886a	Fix Consul & Kubernetes discovery with new way of doing background things	2023-01-03 16:55:59 +01:00
Alex Auvolat	8d5505514f	Make it explicit when using nonversioned encoding	2023-01-03 15:27:36 +01:00
Alex Auvolat	cdb2a591e9	Refactor how things are migrated	2023-01-03 14:44:47 +01:00
Alex Auvolat	939a6d67e8	Merge branch 'main' into internals-rework	2023-01-02 15:07:44 +01:00
Alex Auvolat	6775569525	Bump everything to v0.8.1	2023-01-02 14:15:33 +01:00
Alex Auvolat	e6f14ab5cf	better error message handling	2022-12-14 16:11:19 +01:00
Alex Auvolat	510b620108	Get rid of background::spawn	2022-12-14 16:08:05 +01:00
Alex Auvolat	a19bfef508	Improve error message on rpc connection failure	2022-12-14 12:57:33 +01:00
Alex Auvolat	d56c472712	Refactor background runner and get rid of job worker	2022-12-14 12:51:42 +01:00
Alex	6e44369cbc	Merge pull request 'Optimal layout assignation algorithm' (#296) from optimal-layout into next ... Reviewed-on: #296	2022-12-11 17:41:53 +00:00
Alex Auvolat	2c2e65ad8b	Merge commit 'ec12d6c' into next	2022-12-11 18:41:15 +01:00
Alex Auvolat	9d83364ad9	itertools .unique() doesn't require sorted items	2022-12-11 18:30:02 +01:00
Alex Auvolat	280d1be7b1	Refactor health check and add ability to return it in json	2022-12-05 15:28:57 +01:00
Alex Auvolat	54e800ef8d	Tentative fix for issue #414	2022-11-21 17:13:41 +01:00
Alex Auvolat	ec12d6c8dd	Slightly simplify code at places	2022-11-08 16:15:45 +01:00
Alex Auvolat	d75b37b018	Return more info when layout's .check() fails, fix compilation, fix test	2022-11-08 14:58:39 +01:00
Alex Auvolat	73a4ca8b15	Use bytes as capacity units	2022-11-07 21:12:11 +01:00
Alex Auvolat	fd5bc142b5	Ensure .sort() is called before counting unique items	2022-11-07 20:29:25 +01:00
Alex Auvolat	ea5afc2511	Style improvements	2022-11-07 20:11:30 +01:00
Alex Auvolat	28d7a49f63	Merge branch 'main' into optimal-layout	2022-11-07 12:20:59 +01:00
Alex Auvolat	57b5c2c754	Change reqwest rustls features	2022-10-18 22:11:27 +02:00
Alex Auvolat	8bc5caf7aa	Fix issue with 'http(s)://' prefix	2022-10-18 21:17:11 +02:00
Alex Auvolat	2da8786f54	move things around	2022-10-18 19:13:52 +02:00
Alex Auvolat	5d8d393054	Load TLS certificates only once	2022-10-18 19:11:16 +02:00
Alex Auvolat	002b9fc50c	Add TLS support for Consul discovery + refactoring	2022-10-18 18:38:20 +02:00
Alex Auvolat	fcaee3bea0	definitively expunge openssl from dependencies everywhere	2022-10-14 18:10:36 +02:00
Mendes	bcdd1e0c33	Added some comment	2022-10-11 18:29:21 +02:00
Mendes	e5664c9822	Improved the statistics displayed in layout show ... corrected a few bugs	2022-10-11 17:17:13 +02:00
Mendes	4abab246f1	cargo fmt	2022-10-10 17:21:13 +02:00
Mendes	fcf9ac674a	Tests written in layout.rs ... added staged_parameters to ClusterLayout removed the serde(default) -> will need a migration function	2022-10-10 17:19:25 +02:00
Mendes	911eb17bd9	corrected warnings of cargo clippy	2022-10-06 14:53:57 +02:00
Mendes	9407df60cc	Corrected two bugs: ... - self.node_id_vec was not properly updated when the previous ring was empty - ClusterLayout::merge was not considering changes in the layout parameters	2022-10-06 12:54:51 +02:00
Mendes	ceac3713d6	modifications in several files to : ... - have consistent error return types - store the zone redundancy in a Lww - print the error and message in the CLI (TODO: for the server Api, should msg be returned in the body response?)	2022-10-05 15:29:48 +02:00
Mendes	829f815a89	Merge remote-tracking branch 'origin/main' into optimal-layout	2022-10-04 18:14:49 +02:00
Mendes	99f96b9564	deleted zone_redundancy from System struct	2022-10-04 18:09:24 +02:00
Alex Auvolat	ad917ffd3f	Fix instant substractions that might have panicked	2022-09-29 15:53:54 +02:00
Mendes	bd842e1388	Correction of a few bugs in the tests, modification of ClusterLayout::check	2022-09-22 19:30:01 +02:00
Mendes	7f3249a237	New version of the algorithm that calculate the layout. ... It takes as paramters the replication factor and the zone redundancy, computes the largest partition size reachable with these constraints, and among the possible assignation with this partition size, it computes the one that moves the least number of partitions compared to the previous assignation. This computation uses graph algorithms defined in graph_algo.rs	2022-09-21 14:39:59 +02:00
Alex Auvolat	ded444f6c9	Ability to have custom timeouts in request strategy (not used)	2022-09-20 16:01:41 +02:00
Alex Auvolat	56592e1853	RPC performance changes ... - configurable ping timeout - single, much higher, configurable RPC timeout - no more concurrency semaphore	2022-09-19 20:31:00 +02:00
Alex Auvolat	e46dc2a8ef	Allow for hostnames in bootstrap_peers and rpc_public_addr (fix #353)	2022-09-14 16:09:38 +02:00
Alex Auvolat	ab722cb40f	Add checks on replication_factor of layouts we use (fix #363, fix #364)	2022-09-13 16:22:23 +02:00
Alex Auvolat	44733474bb	Remove/change println! in server code (fix #358)	2022-09-13 16:01:55 +02:00
Alex Auvolat	28a4af73ca	Use netapp 0.5 published from crates.io	2022-09-13 13:11:44 +02:00
Alex Auvolat	7f54706b95	Merge branch 'lx-perf-improvements' into netapp-stream-body	2022-09-08 15:50:56 +02:00
Alex Auvolat	d9d199a6c9	Merge branch 'main' into lx-perf-improvements	2022-09-08 15:49:17 +02:00
Alex Auvolat	db61f41030	Move GIT_VERSION injection later in build chain to reduce build times	2022-09-07 11:59:56 +02:00
Alex Auvolat	6b958979bd	Merge branch 'lx-perf-improvements' into netapp-stream-body	2022-09-06 22:13:01 +02:00