244 Commits

Author	SHA1	Message	Date
Jonathan Davies	f607ac6792	garage/api: cargo: Updated idna dependency to 0.4.	2023-08-28 09:30:27 +00:00
Jonathan Davies	96d1d81ab7	garage/db: cargo: Updated rusqlite to 0.29.	2023-08-28 09:30:27 +00:00
Jonathan Davies	5185701aa8	cargo: Updated: ... * addr2line v0.19.0 -> v0.20.0 * async-compression v0.4.0 -> v0.4.1 * clap v4.3.8 -> v4.3.19 * hyper v0.14.26 -> v0.14.27 * ipnet v2.7.2 -> v2.8.0 * rmp v0.8.11 -> v0.8.12 * serde v1.0.164 -> v1.0.188 * tokio v1.29.0 -> v1.31.0 * zstd v0.12.3+zstd.1.5.2 -> v0.12.4 * Others in `cargo update`	2023-08-28 09:30:27 +00:00
Jonathan Davies	aee0d97f22	cargo: Updated async-compression to 0.4.	2023-06-28 11:17:16 +01:00
Jonathan Davies	098c388f1b	cargo: Updated tokio to 1.29.	2023-06-28 11:16:41 +01:00
Jonathan Davies	f31d98097a	Cargo.lock: Updated.	2023-06-26 18:03:47 +01:00
Alex	cda957b4b1	update netapp's rmp-serde dependency to v1.1	2023-06-13 17:34:49 +02:00
Alex	90b2d43eb4	Merge branch 'main' into next	2023-06-13 17:14:11 +02:00
Alex	c1e1764f17	move git-version dependency to main crate to reduce rebuilds	2023-06-09 16:23:37 +02:00
Alex	c3d3b837eb	bump k2v-client to v0.0.4	2023-05-22 10:47:15 +02:00
Alex	e2ce5970c6	Add basic k2v_client integration tests	2023-05-22 10:45:06 +02:00
Alex	644e872264	Port k2v-client to aws-sigv4 since rusoto_signature is deprecated	2023-05-19 12:08:29 +02:00
Alex	4420db7310	add tracing to k2v-client	2023-05-18 11:18:21 +02:00
Alex	217d429937	fix clippy lint in format-table crate	2023-05-17 13:06:37 +02:00
Alex	a1cec2cd60	Split format_table into separate crate and reduce k2v-client dependencies	2023-05-17 13:01:37 +02:00
Alex	e4f955d672	fix base64 uses	2023-05-16 19:46:56 +02:00
Jonathan Davies	fdcd7dee5a	Cargo.lock: Updated for: ... * tokio 1.28 * hyper 0.14.26	2023-05-09 14:43:52 +01:00
Alex	351d734e6c	Merge branch 'main' into next	2023-05-09 12:40:08 +02:00
Alex	9e0a9c1c15	move git-version dependency to main crate to reduce rebuilds	2023-05-09 11:35:32 +02:00
Jakub Jirutka	833cf082da	Remove unnecessary/unused "timeago" features ... To decrease dependency bloat and binary size.	2023-05-07 01:03:54 +02:00
Alex	fa78d806e3	Merge branch 'main' into next	2023-04-25 12:34:26 +02:00
Jonathan Davies	c168383113	api/Cargo.toml: Bumped quick-xml to version 0.26.	2023-04-23 20:14:28 +01:00
Alex	0a1ddcf630	Prepare for v0.8.2	2023-03-13 18:46:31 +01:00
Alex	f37ec584b6	Merge branch 'main' into rustversion-label	2023-03-13 16:14:13 +01:00
Jonathan Davies	25f2a46fc3	rpc/system_metrics.rs: Added rustversion label to garage_build_info metric.	2023-03-10 14:46:44 +00:00
teutat3s	f0717dd169	Bump pnet_datalink 0.28 -> 0.33 ... Motivation: building garage on illumos is only possible since pnet_datalink version 0.30 Changelog: https://github.com/libpnet/libpnet/compare/v0.28.0...v0.33.0	2023-02-28 16:06:43 +01:00
Jonathan Davies	9e0567dce4	Cargo.lock: Bump for tokio 1.25.0.	2023-01-30 00:14:03 +00:00
Alex	590a0a8450	Merge branch 'main' into k2v-watch-range-2	2023-01-26 16:46:40 +01:00
Alex	94d559ae00	Merge branch 'main' into report-disk-usage	2023-01-26 16:20:41 +01:00
Alex	654999e254	Update Cargo.nix	2023-01-26 15:50:54 +01:00
Alex	efb6b6e868	Disk space report ... Report available disk space on nodes and calculate cluster-wide available space in `garage stats` (fix #479)	2023-01-26 15:04:32 +01:00
Jonathan Davies	3dc655095f	db/Cargo.toml: Updated rusqlite from 0.27 to 0.28.	2023-01-26 11:13:11 +00:00
Jonathan Davies	f952e37ba7	{model,util}/Cargo.toml: Updated blake2 from 0.9 to 0.10.	2023-01-26 11:13:11 +00:00
Jonathan Davies	fbafa76284	{db,util}/Cargo.toml: Updated mktemp from 0.4 to 0.5.	2023-01-26 11:13:11 +00:00
Jonathan Davies	63e22e71f2	api/Cargo.toml: Updated idna from 0.2 to 0.3.	2023-01-26 11:13:11 +00:00
Jonathan Davies	f6eaf3661c	garage/Cargo.toml: Updated timeage from 0.3 to 0.4.	2023-01-26 11:13:11 +00:00
Jonathan Davies	d3b2a68988	{garage,util}/Cargo.toml: Updated toml from 0.5 to 0.6.	2023-01-26 11:13:11 +00:00
Jonathan Davies	bcac889f9a	Cargo.toml: Updated clap from 3.1.18 to 4.1.	2023-01-26 11:13:11 +00:00
Jonathan Davies	69497be5c6	Cargo.lock: Ran cargo update.	2023-01-26 11:13:11 +00:00
Jonathan Davies	36944f1839	Cargo.toml: Updated base64 from 0.13 to 0.21.	2023-01-26 11:13:07 +00:00
Jonathan Davies	db56d4658f	util/Cargo.toml: Updated rmp-serde from 0.15 to 1.1.	2023-01-26 11:03:43 +00:00
Jonathan Davies	93c3f8fc8c	api/Cargo.toml: Updated url from 2.1 to 2.3.	2023-01-23 19:16:58 +00:00
Jonathan Davies	1c435fce09	api/Cargo.toml: Updated httpdate from 0.3 to 1.0.	2023-01-23 19:16:54 +00:00
Jonathan Davies	5c3075fe01	Cargo.toml: Updated zstd from 0.9 to 0.12.	2023-01-23 18:08:14 +00:00
Alex	dac254a6e7	Merge branch 'main' into k2v-watch-range-2	2023-01-11 17:09:37 +01:00
Alex	32aab06929	k2v-client libary poll_range and CLI poll-range	2023-01-11 11:14:29 +01:00
Felix Scheinost	d6ea0cbefa	Add tests for `rpc_secret_file`	2023-01-07 14:19:36 +01:00
Alex	570e5e5bbb	Merge branch 'main' into next	2023-01-04 11:34:43 +01:00
Alex	8d5505514f	Make it explicit when using nonversioned encoding	2023-01-03 15:27:36 +01:00
Alex	cdb2a591e9	Refactor how things are migrated	2023-01-03 14:44:47 +01:00
Alex	939a6d67e8	Merge branch 'main' into internals-rework	2023-01-02 15:07:44 +01:00
Alex	6775569525	Bump everything to v0.8.1	2023-01-02 14:15:33 +01:00
Alex	2183518edc	Spawn all background workers in a separate step	2022-12-14 12:28:07 +01:00
Alex	73a4ca8b15	Use bytes as capacity units	2022-11-07 21:12:11 +01:00
Alex	28d7a49f63	Merge branch 'main' into optimal-layout	2022-11-07 12:20:59 +01:00
Alex	e03d9062f7	Show a nice message and a backtrace when Garage panics	2022-11-04 16:39:02 +01:00
Alex	5b18fd8201	Add garage bucket cleanup-incomplete-uploads command	2022-11-04 11:55:59 +01:00
Alex	57b5c2c754	Change reqwest rustls features	2022-10-18 22:11:27 +02:00
Alex	002b9fc50c	Add TLS support for Consul discovery + refactoring	2022-10-18 18:38:20 +02:00
Alex	fcaee3bea0	definitively expunge openssl from dependencies everywhere	2022-10-14 18:10:36 +02:00
Alex	8d04ae7014	cargo2nix unstable (patched), rust 1.63.0, nixpkgs 22.05 (32-bit builds are broken)	2022-10-14 14:30:48 +02:00
Mendes	829f815a89	Merge remote-tracking branch 'origin/main' into optimal-layout	2022-10-04 18:14:49 +02:00
Alex	357b72f4ff	Merge branch 'main' into configurable-timeouts	2022-09-20 15:19:58 +02:00
Alex	1f7b050b7d	Change a warn! into a debug!	2022-09-20 11:49:48 +02:00
Alex	56592e1853	RPC performance changes ... - configurable ping timeout - single, much higher, configurable RPC timeout - no more concurrency semaphore	2022-09-19 20:31:00 +02:00
Alex	5d4b6f2173	Faster GetObject workflow for getting entire objects	2022-09-19 12:19:59 +02:00
Alex	e46dc2a8ef	Allow for hostnames in bootstrap_peers and rpc_public_addr (fix #353)	2022-09-14 16:09:38 +02:00
Alex	28a4af73ca	Use netapp 0.5 published from crates.io	2022-09-13 13:11:44 +02:00
Alex	7f54706b95	Merge branch 'lx-perf-improvements' into netapp-stream-body	2022-09-08 15:50:56 +02:00
Alex	d9d199a6c9	Merge branch 'main' into lx-perf-improvements	2022-09-08 15:49:17 +02:00
Alex	ceb1f0229a	Move version back into util	2022-09-07 18:36:46 +02:00
Alex	28d86e7602	Report build features in garage --help	2022-09-07 17:05:21 +02:00
Alex	db61f41030	Move GIT_VERSION injection later in build chain to reduce build times	2022-09-07 11:59:56 +02:00
Alex	4024822585	Update netapp to lastest git version with LAS scheduling	2022-09-06 19:45:00 +02:00
Alex	0f5689c169	Include code from v0.5.1 directly to remove dependencies	2022-09-06 17:52:50 +02:00
Alex	431dee050f	Remove opentelemetry-otlp dep in api/	2022-09-06 17:25:44 +02:00
Alex	48ffaaadfc	Bump versions to 0.8.0 (compatibility is broken already)	2022-09-06 16:47:56 +02:00
Alex	729a910e14	Remove Heed default features	2022-09-05 16:40:13 +02:00
Jakub Jirutka	a6e40b75ea	Add feature "system-libs" to enable linking against system libraries ... If this feature is enabled, libsodium-sys and zstd-sys will link dynamically against system-provided libraries instead of building and linking statically the bundled (possibly outdated and vulnerable) copies of them. This feature is intended mainly for linux package maintainers.	2022-09-03 18:44:34 +02:00
Alex	6226f5ceca	Update to netapp 0.4.5 - fixed ping	2022-09-02 14:33:12 +02:00
Alex	df094bd807	Less strict timeouts	2022-09-01 16:30:44 +02:00
Alex	f3bf34b6a1	update netapp: straming + fix-ping	2022-09-01 14:23:54 +02:00
Alex	bc977f9a7a	Update to Netapp with OrderTag support and exploit OrderTags	2022-09-01 12:58:20 +02:00
Alex	4b726b0941	netapp recv with unbounded channel removes deadlock	2022-09-01 09:47:28 +02:00
Alex	e598231ca4	update netapp git commit	2022-08-31 19:27:25 +02:00
Alex	c9bc9d89de	Merge branch 'lx-perf-improvements' into netapp-stream-body	2022-08-31 17:42:31 +02:00
Alex	efbca67ce4	Add env filter to tracing subscriber	2022-08-31 14:39:12 +02:00
Alex	dd5304f6fc	Replace logging crate pretty_env_logger by tracing_subscriber::fmt	2022-08-31 14:24:41 +02:00
Alex	1921f4f7e6	Merge branch 'lx-perf-improvements' into netapp-stream-body	2022-08-29 16:45:05 +02:00
Alex	ebc20a8798	Merge branch 'main' into lx-perf-improvements	2022-08-29 16:44:13 +02:00
Quentin	2c7bae935a	Configure structopt to report the right version ... By default, structopt reports the value provided by the env var CARGO_PKG_VERSION, feeded by Cargo when reading Cargo.toml. However for Garage we use a versioning based on git, so we often report a version that is behind the real version. In this commit, we create garage_util::version::garage() that reports the right version and configure all structopt subcommands to call this function instead of using the env var.	2022-08-11 10:21:45 +02:00
Alex	e935861854	Factor out node request order selection logic & use in manager	2022-07-29 12:25:03 +02:00
Alex	126b037307	update netapp	2022-07-29 12:25:03 +02:00
Alex	605a630333	Use streaming in block manager	2022-07-29 12:25:02 +02:00
Alex	a35d4da721	update netapp to 0.5	2022-07-29 12:25:02 +02:00
Alex	8e7e680afe	First adaptation to WIP netapp with streaming body	2022-07-29 12:25:02 +02:00
Alex	381eb9a5a1	Fix tests	2022-07-29 12:24:48 +02:00
Alex	1b2e1296eb	Compute hashes on dedicated threads	2022-07-29 12:24:44 +02:00
Alex	4f38cadf6e	Background task manager (#332) ... - [x] New background worker trait - [x] Adapt all current workers to use new API - [x] Command to list currently running workers, and whether they are active, idle, or dead - [x] Error reporting - Optimizations - [x] Merkle updater: several items per iteration - [ ] Use `tokio::task::spawn_blocking` where appropriate so that CPU-intensive tasks don't block other things going on - scrub: - [x] have only one worker with a channel to start/pause/cancel - [x] automatic scrub - [x] ability to view and change tranquility from CLI - [x] persistence of a few info - [ ] Testing Co-authored-by: Alex Auvolat <alex@adnab.me> Reviewed-on: #332 Co-authored-by: Alex <alex@adnab.me> Co-committed-by: Alex <alex@adnab.me>	2022-07-08 13:30:26 +02:00
Alex	77e3fd6db2	improve internal item counter mechanisms and implement bucket quotas (#326) ... - [x] Refactoring of internal counting API - [x] Repair procedure for counters (it's an offline procedure!!!) - [x] New counter for objects in buckets - [x] Add quotas to buckets struct - [x] Add CLI to manage bucket quotas - [x] Add admin API to manage bucket quotas - [x] Apply quotas by adding checks on put operations - [x] Proof-read Co-authored-by: Alex Auvolat <alex@adnab.me> Reviewed-on: #326 Co-authored-by: Alex <alex@adnab.me> Co-committed-by: Alex <alex@adnab.me>	2022-06-15 20:20:28 +02:00