394 commits

Author	SHA1	Message	Date
Alex	4c5be79b80	Garage v0.8.5 ... This minor release includes the following improvements and fixes: New features: - Configuration: make LMDB's `map_size` configurable and make `block_size` and `sled_cache_capacity` expressable as strings (such as `10M`) (#628, #630) - Add support for binding to Unix sockets for the S3, K2V, Admin and Web API servers (#640) - Move the `convert_db` command into the main Garage binary (#645) - Add support for specifying RPC secret and admin tokens as environment variables (#643) - Add `allow_world_readable_secrets` option to config file (#663, #685) Bug fixes: - Use `statvfs` instead of mount list to determine free space in metadata/data directories (#611, #631) - Add missing casts to fix 32-bit build (#632) - Fix error when none of the HTTP servers (S3/K2V/Admin/Web) is started and fix shutdown hang (#613, #633) - Add missing CORS headers to PostObject response (#609, #656) - Monitoring: finer histogram boundaries in Prometheus exported metrics (#531, #686) Other: - Documentation improvements (#641) -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEwhSWp0+ubv79TiqUDkltFQljdr4FAmWmWvsACgkQDkltFQlj dr59rRAAiMGQpDUK0QqiCgrp1rcUhvtj3DsQEpT7F14Jo3I7bFDmONZolPbO8YAs VE4S4CBQogNH0lMQ6EvJYiBCxDWkxdVibKqDWOYJmUw3bZ6Ypn1eZIF0+Uf1TDI+ C6CxYbyDQtqvm330K2Du2uOoGiIgm83b6jktK/0FtbAE2GWhtYmQwoelprAGH20i baaSfkZbBl8toUscakyhPVVSQ86BcVQ2jqL6Ofu4eQknjMRqCeAIQhMB2ikpiwBz hbTZ3x0EfJJqiHocfkTE3B3cPnDKuHDzxPRhLMB/olEpzoxaLJ2+tc0ziQdl06/F 1c8nHM57L1IaDGKAkpcANnj3yVf3jfPqq9SEUNi+xSIWbvln91RvXU4RIB8hiZqa rqAHjDuys++3DoAUr/L4X233MWufVAEYT4B+jaPAv6ys35xhQwPAMJrA0OZEr+hE HQMPIG9uMDVjZ2QCgFYgC02kEqvxbsRSVnb0wjI7eoNOk0LKo154eJh1cOGd4Ibs yBTiIi1+Y7RCXNxcIHKlj5vMUHPBr2D8DVFj21kfZKUtMQ/8yScoiRC14ZR4J2xF IYe3aDm80l3tYgnPRVj4fOGiIPsqnZd4iazYKwj2cifB8tzYfyh5/9fv2aio8K5y 0GAw4AoTtgg1hLMadbc3om7wy64IRaZzXjv59eYPEotZYdreVpM= =RVm8 -----END PGP SIGNATURE----- gpgsig -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEwhSWp0+ubv79TiqUDkltFQljdr4FAmWmZKIACgkQDkltFQlj dr6wZRAA1XuOBax/7YsIix3ag0kjnwnGAx8wYaA+Jiojw2yv/+ePL6yGHcKA93lI SL8l5G06fTDgpbpfdVbgyRzGT2tmjrXvkygRWf2WMDZ9I+8WxUA2q8aWaEMiNmvd 0cfzYi14TgX+O0wEbKeeqrXG0473/yThk5U1FNbdJd7rkJ4JzaOTthdk0LJLiEUG zQ/YIYx3FVFoVI0rdORb3HKzqYHjMAvpzNhEIeqkrpDEzplQ3jKvY+rYWQL3S9zE bHbkZPoT62OpJGMr04/1FUkB+ctsvUrM0CskruaSKWyD2M1xTo/Ug4jh5muVIcdJ hJis1/k5rV8JDTIkb6eAxKqfVzI+56yDxofT8rVF4JhvlzvXDLOa0uyDVyA8/6un ylWRzs2Mlj6/TbscmPjrdH8v2Lb0zjWxvXe2iYnHHfldWUlYuBtI6FZiG3uNjBCs 7ns3xr4VOw13RM5auVkEQksIO6lru0kvH18GB3h6Msx67w2JUzl+PaNv8PdRtnmV 0SfLUl1Nh8yT2h9qG6/3cDE9E1G/mjg8SgljoEe6ahs/BUZmLuTHTyBjf+P22ZbO DCITM3CwrV+y/aKnRdLvd6LOWFinUqMS8YvVSVqJh9vo9R+dt33LdBMdWjP4IYHF MbACe4FzeG3AXUcHB/mDCm7a2H2BFwzAovFy0SE639PfWBxNue0= =gzWq -----END PGP SIGNATURE----- Merge tag 'v0.8.5' into sync-08-09 Garage v0.8.5 This minor release includes the following improvements and fixes: New features: - Configuration: make LMDB's `map_size` configurable and make `block_size` and `sled_cache_capacity` expressable as strings (such as `10M`) (#628, #630) - Add support for binding to Unix sockets for the S3, K2V, Admin and Web API servers (#640) - Move the `convert_db` command into the main Garage binary (#645) - Add support for specifying RPC secret and admin tokens as environment variables (#643) - Add `allow_world_readable_secrets` option to config file (#663, #685) Bug fixes: - Use `statvfs` instead of mount list to determine free space in metadata/data directories (#611, #631) - Add missing casts to fix 32-bit build (#632) - Fix error when none of the HTTP servers (S3/K2V/Admin/Web) is started and fix shutdown hang (#613, #633) - Add missing CORS headers to PostObject response (#609, #656) - Monitoring: finer histogram boundaries in Prometheus exported metrics (#531, #686) Other: - Documentation improvements (#641)	2024-01-16 12:12:27 +01:00
Alex	50643e61bf	Bump version to 0.8.5	2024-01-16 10:47:33 +01:00
Alex	a6421ee5a5	Merge pull request 'monitoring: finer histogram boundaries in prometheus metrics (fix #531)' (#686) from fix-531 into main-0.8.x ... Reviewed-on: #686	2024-01-15 16:44:58 +00:00
Alex	f512609123	monitoring: finer histogram boundaries in prometheus metrics (fix #531)	2024-01-15 17:33:35 +01:00
Alex	97bae7213a	config: additional tests for secret sourcing	2024-01-15 17:30:30 +01:00
Alex	7228695ee2	config: refactor secret sourcing	2024-01-15 17:18:46 +01:00
Alex	db48dd3d6c	bump crate versions to 0.10.0	2024-01-11 12:05:51 +01:00
Alex	7f2541101f	cli: improvements to the layout commands when multiple layouts are live	2023-12-08 11:24:23 +01:00
Alex	9cecea64d4	layout: allow sync update tracker to progress with only quorums	2023-12-07 14:51:20 +01:00
Alex	aa59059a91	layout cli: safer skip-dead-nodes command	2023-12-07 11:56:14 +01:00
Alex	c04dd8788a	admin: more info in admin GetClusterStatus	2023-11-28 14:25:04 +01:00
Alex	c539077d30	cli: remove historic layout info from status	2023-11-27 16:22:27 +01:00
Alex	11e6fef93c	cli: add layout history and layout assume-sync commands	2023-11-27 16:22:25 +01:00
Alex	539a920313	cli: show when nodes are draining metadata	2023-11-27 13:18:59 +01:00
Alex	33c8a489b0	layou: implement ack locking	2023-11-15 15:40:44 +01:00
Alex	393c4d4515	layout: add helper for cached/external values to centralize recomputation	2023-11-15 14:20:50 +01:00
Alex	46007bf01d	integration test: print stdout and stderr on subcommand crash	2023-11-15 12:56:52 +01:00
Alex	1aab1f4e68	layout: refactoring of all_nodes	2023-11-14 13:12:32 +01:00
Alex	bad7cc812e	layout admin: add missing calls to update_hash	2023-11-09 15:42:10 +01:00
Alex	bfb1845fdc	layout: refactor to use a RwLock on LayoutHistory	2023-11-09 14:12:05 +01:00
Alex	19ef1ec8e7	layout: more refactoring	2023-11-09 13:34:14 +01:00
Alex	523d2ecb95	layout: use separate CRDT for staged layout changes	2023-11-09 11:19:43 +01:00
Alex	8dccee3ccf	cluster layout: adapt all uses of ClusterLayout to LayoutHistory	2023-11-08 19:28:36 +01:00
Alex	4a9c94514f	avoid using layout_watch in System directly	2023-11-08 16:41:00 +01:00
Alex	12d1dbfc6b	remove Ring and use ClusterLayout everywhere	2023-11-08 15:41:24 +01:00
Alex	0215b11402	Merge pull request 'Add support for specifying rpc_secret_file, metrics_token_file and admin_token_file using environment variables' (#643) from networkException/garage:token-file-env into main-0.8.x ... Reviewed-on: #643	2023-10-19 09:33:12 +00:00
networkException	8599051c49	garage: support specifying token / secret as environment variables ... this patch adds support for specifying the `rpc_secret_file`, `metrics_token_file` and `admin_token_file` as environment variables.	2023-10-19 03:39:02 +02:00
networkException	4a19ee94bb	garage: fix admin-token description	2023-10-19 03:31:50 +02:00
Alex	952c9570c4	bump version to v0.9.0	2023-10-10 14:08:11 +02:00
Alex	3d7892477d	convert_db: fix build	2023-10-10 14:06:25 +02:00
Alex	d4932c31ea	Merge branch 'main' into next	2023-10-10 13:57:21 +02:00
Alex	2d5d7a7031	Move convert_db command into main garage binary	2023-10-10 12:13:15 +02:00
Alex	920dec393a	cli: more precise doc comment	2023-10-04 10:44:42 +02:00
Alex	2e656b541b	Merge branch 'main' into next	2023-10-03 18:40:37 +02:00
networkException	8ec6a53b35	everywhere: support unix sockets when binding in various places ... this patch implements binding to paths as a unix socket for generic server and web server.	2023-09-29 18:57:44 +02:00
Alex	897cbf2c27	actually update rmp-serde to 1.1.2 for both garage and netapp dependency (fix #629)	2023-09-27 13:13:00 +02:00
Alex	ad82035b98	Merge branch 'main' into next	2023-09-27 13:11:52 +02:00
Alex	aa7eadc799	Merge pull request 'New layout: fixes and UX improvements' (#634) from new-layout-ux into next ... Reviewed-on: #634	2023-09-27 09:04:32 +00:00
Alex	f97168f805	garage_db: refactor transactions and add on_commit mechanism	2023-09-21 15:35:31 +02:00
Alex	749b4865d0	new layout: improve display and fix comments	2023-09-18 12:07:45 +02:00
Alex	015ccb39aa	new layout: make zone_redundancy optionnal (if not set, is maximum)	2023-09-18 11:59:08 +02:00
Alex	2e229d4430	new layout: improve output display	2023-09-12 17:24:51 +02:00
Alex	aa79810596	Fix error when none of S3/K2V/WEB/ADMIN server is started (fix #613)	2023-09-12 14:35:19 +02:00
Alex	ad6b1cc0be	Merge branch 'main' into next	2023-09-11 13:14:18 +02:00
Alex	6b008b5bd3	block manager: add rebalance operation to rebalance multi-hdd setups	2023-09-07 13:44:11 +02:00
Alex	51eac97260	update version to 0.8.4	2023-09-05 23:28:12 +02:00
Alex	2e90e1c124	Merge branch 'main' into next	2023-08-29 11:32:42 +02:00
Alex	cece1be1bb	bump version to 0.8.3	2023-08-28 13:17:26 +02:00
Alex	769b6fe054	fix test_website_check_domain	2023-08-28 12:40:28 +02:00
Alex	e66c78d6ea	integration test: move json_body to root of crate	2023-08-28 12:32:57 +02:00
Jonathan Davies	5185701aa8	cargo: Updated: ... * addr2line v0.19.0 -> v0.20.0 * async-compression v0.4.0 -> v0.4.1 * clap v4.3.8 -> v4.3.19 * hyper v0.14.26 -> v0.14.27 * ipnet v2.7.2 -> v2.8.0 * rmp v0.8.11 -> v0.8.12 * serde v1.0.164 -> v1.0.188 * tokio v1.29.0 -> v1.31.0 * zstd v0.12.3+zstd.1.5.2 -> v0.12.4 * Others in `cargo update`	2023-08-28 09:30:27 +00:00
Quentin	24e533f262	support {s3,web}.root_domains in /check endpoint	2023-08-08 11:05:42 +02:00
Florian Klink	b1ca1784a1	src/garage/cli: fix typo	2023-07-14 14:25:33 +03:00
Jonathan Davies	a6da7e588f	tests/bucket.rs: Adjusted as previously used function is now private.	2023-06-26 18:03:43 +01:00
Jonathan Davies	7f8bf2d801	src/garage/tests: Updated types for aws-sdk-s3 bump.	2023-06-25 21:31:35 +01:00
Jonathan Davies	4297233d3e	garage/Cargo.toml: Updated aws-sdk-s3 to 0.28, added aws-config.	2023-06-25 21:17:15 +01:00
Alex	8ef42c9609	admin docs: reformatting, key admin: add check	2023-06-14 17:19:25 +02:00
Alex	7895f99d3a	admin and cli: hide secret keys unless asked	2023-06-14 16:56:15 +02:00
Alex	90b2d43eb4	Merge branch 'main' into next	2023-06-13 17:14:11 +02:00
Alex	eb9cecf05c	Split garage/admin.rs into smaller files	2023-06-13 16:46:28 +02:00
Alex	802ed75721	move admin.rs to admin/mod.rs, before splitting	2023-06-13 16:42:14 +02:00
Alex	7126f3e1d1	garage key import: add checks and --yes CLI flag (fix #278)	2023-06-13 15:56:48 +02:00
Alex	1ea4937c8b	fix timestamps wrapping around in garage block list-errors (fix #584)	2023-06-12 20:07:33 +02:00
Alex	c14d3735e5	Add test for multipart uploads and fix part renumbering	2023-06-09 16:23:37 +02:00
Alex	412ab77b08	comments and clippy lint fixes	2023-06-09 16:23:37 +02:00
Alex	511e07ecd4	fix mpu counter (add missing workers) and report info at appropriate places	2023-06-09 16:23:37 +02:00
Alex	4ea53dc759	Add multipart upload repair	2023-06-09 16:23:37 +02:00
Alex	058518c22b	refactor repair workers with a trait	2023-06-09 16:23:37 +02:00
Alex	8644376ac2	fix test; simplify code	2023-06-09 16:23:37 +02:00
Alex	75a0e01372	fix online repair	2023-06-09 16:23:37 +02:00
Alex	bb176ebcb8	cargo fmt	2023-06-09 16:23:37 +02:00
Alex	87be8eeb93	updaet block admin for new multipartupload models	2023-06-09 16:23:37 +02:00
Alex	1e466b11eb	Revert integration tests to using Sled as LMDB causes failures	2023-06-09 13:23:08 +02:00
Alex	8a74e1c2bd	Split garage/admin.rs into smaller files	2023-06-06 15:39:15 +02:00
Alex	e2ce5970c6	Add basic k2v_client integration tests	2023-05-22 10:45:06 +02:00
Alex	746b0090e4	k2v signature verification: double urlencoding (see comment in source code)	2023-05-18 11:18:06 +02:00
Alex	19639705e6	Mark sled as deprecated, make lmdb default, and improve sqlite and lmdb defaults	2023-05-17 14:30:53 +02:00
Alex	a1cec2cd60	Split format_table into separate crate and reduce k2v-client dependencies	2023-05-17 13:01:37 +02:00
Alex	351d734e6c	Merge branch 'main' into next	2023-05-09 12:40:08 +02:00
Alex	9e0a9c1c15	move git-version dependency to main crate to reduce rebuilds	2023-05-09 11:35:32 +02:00
Jakub Jirutka	d2deee0b8b	Declare garage crates using workspace.dependencies ... This will allow to really disable "sled" feature without declaring `default-features = false` in every Cargo.toml where garage_db and garage_model is used. See https://doc.rust-lang.org/cargo/reference/workspaces.html#the-dependencies-table	2023-05-09 08:46:15 +00:00
Jakub Jirutka	833cf082da	Remove unnecessary/unused "timeago" features ... To decrease dependency bloat and binary size.	2023-05-07 01:03:54 +02:00
Alex	fa78d806e3	Merge branch 'main' into next	2023-04-25 12:34:26 +02:00
Alex	0a1ddcf630	Prepare for v0.8.2	2023-03-13 18:46:31 +01:00
Alex	d6ffa57f40	Merge pull request 'Increase Garage tests robustness' (#526) from tests/increase-robustness into main ... Reviewed-on: #526 Reviewed-by: Alex <alex@adnab.me> Reviewed-by: trinity-1686a <trinity.pointard@gmail.com>	2023-03-13 17:26:21 +00:00
Quentin	70b5424b99	use one key per context to isolate tests	2023-03-13 15:06:05 +01:00
Quentin	2687fb7fa8	do not assume Garage boots in 2sec during tests	2023-03-13 15:06:05 +01:00
Jonathan Davies	4421378023	garage/admin.rs: Display Rust version in stats output.	2023-03-10 14:46:54 +00:00
Alex	80e2326998	fixes for pr 499	2023-02-06 12:23:55 +01:00
Alex	656b8d42de	secrets can be passed directly in config, as file, or as env	2023-02-03 15:27:39 +01:00
Jonathan Davies	9c354f0a8f	Improved bucket authorization response strings.	2023-01-29 20:34:41 +00:00
Jonathan Davies	004bb5b4f1	api_server.rs: Adapted to use query string per Caddy upstream change.	2023-01-29 20:34:37 +00:00
Alex	d6af95d205	fix cli display bug	2023-01-26 17:50:50 +01:00
Alex	3113f6b5f2	more fixes	2023-01-26 17:14:17 +01:00
Alex	1dff62564f	fix clippy	2023-01-26 17:05:31 +01:00
Alex	590a0a8450	Merge branch 'main' into k2v-watch-range-2	2023-01-26 16:46:40 +01:00
Alex	94d559ae00	Merge branch 'main' into report-disk-usage	2023-01-26 16:20:41 +01:00
Alex	efb6b6e868	Disk space report ... Report available disk space on nodes and calculate cluster-wide available space in `garage stats` (fix #479)	2023-01-26 15:04:32 +01:00
Jonathan Davies	20c1cdf662	Cargo.toml: Loosen tracing dependency to just 0.1.	2023-01-26 11:13:11 +00:00
Jonathan Davies	f6eaf3661c	garage/Cargo.toml: Updated timeage from 0.3 to 0.4.	2023-01-26 11:13:11 +00:00