1303 commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Alex	e645bbd3ce	smoke test: add multipart upload test with part re-upload	2023-06-09 16:23:37 +02:00
Alex	58563ed700	Add multipart upload using aws s3api	2023-06-09 16:23:37 +02:00
Alex	a6cc563bdd	UploadPart: automatic cleanup of version (and reference blocked) when interrupted	2023-06-09 16:23:37 +02:00
Alex	c14d3735e5	Add test for multipart uploads and fix part renumbering	2023-06-09 16:23:37 +02:00
Alex	53bf2f070c	undo sort_key() returning Cow	2023-06-09 16:23:37 +02:00
Alex	412ab77b08	comments and clippy lint fixes	2023-06-09 16:23:37 +02:00
Alex	511e07ecd4	fix mpu counter (add missing workers) and report info at appropriate places	2023-06-09 16:23:37 +02:00
Alex	4ea53dc759	Add multipart upload repair	2023-06-09 16:23:37 +02:00
Alex	058518c22b	refactor repair workers with a trait	2023-06-09 16:23:37 +02:00
Alex	8644376ac2	fix test; simplify code	2023-06-09 16:23:37 +02:00
Alex	7ad7dae5d4	fix s3 list test	2023-06-09 16:23:37 +02:00
Alex	75a0e01372	fix online repair	2023-06-09 16:23:37 +02:00
Alex	bb176ebcb8	cargo fmt	2023-06-09 16:23:37 +02:00
Alex	c1e1764f17	move git-version dependency to main crate to reduce rebuilds	2023-06-09 16:23:37 +02:00
Alex	87be8eeb93	updaet block admin for new multipartupload models	2023-06-09 16:23:37 +02:00
Alex	82e75c0e29	Adapt S3 API code to use new multipart upload models ... - Create and PutPart - completemultipartupload - upload part copy - list_parts	2023-06-09 16:23:37 +02:00
Alex	38d6ac4295	New multipart upload table layout	2023-06-09 16:23:37 +02:00
Alex	6005491cd8	Use Cow<[u8]> for sort keys	2023-06-09 16:23:37 +02:00
Alex	ea3bfd2ab1	Minio tests for multipart upload behaviour: ... - upload part renumbering test - part skipping test	2023-06-09 16:23:37 +02:00
Alex	e7e164a280	Make fsync an option for meta and data	2023-06-09 16:23:21 +02:00
Alex	1e466b11eb	Revert integration tests to using Sled as LMDB causes failures	2023-06-09 13:23:08 +02:00
Alex	865f0c7d0c	Add LMDB to debug builds	2023-06-09 12:04:28 +02:00
Alex	906fe78b24	Integration tests: print logs when fails	2023-06-09 12:03:44 +02:00
Alex	8a74e1c2bd	Split garage/admin.rs into smaller files	2023-06-06 15:39:15 +02:00
Alex	19639705e6	Mark sled as deprecated, make lmdb default, and improve sqlite and lmdb defaults	2023-05-17 14:30:53 +02:00
Alex	351d734e6c	Merge branch 'main' into next	2023-05-09 12:40:08 +02:00
Alex	b925f53dc3	Merge pull request 'move git-version dependency to main crate to reduce rebuilds' (#568) from move-git-version into main ... Reviewed-on: #568	2023-05-09 09:53:33 +00:00
Alex	2f495575d8	Merge pull request 'block/manager.rs: Prioritize raw blocks when no compression configured' (#566) from jpds/garage:skip-compressed-blocks-scrub-no-compression into main ... Reviewed-on: #566	2023-05-09 09:39:48 +00:00
Alex	9e0a9c1c15	move git-version dependency to main crate to reduce rebuilds	2023-05-09 11:35:32 +02:00
Jonathan Davies	9c788059e2	block/manager.rs: In is_block_compressed - check which compression_level ... is configured on a node and check for raw block first if compression is disabled (to help reduce syscalls during a scrub).	2023-05-09 10:28:19 +01:00
Alex	5684e1990c	Merge pull request 'Really allow to disable sled feature' (#563) from jirutka/garage:workspace-deps into main ... Reviewed-on: #563	2023-05-09 09:08:35 +00:00
Alex	14c50f2f84	Merge pull request 'Fix undefined macro warn! on 32-bit' (#562) from jirutka/garage:fix-undefined-warn into main ... Reviewed-on: #562	2023-05-09 08:52:11 +00:00
Alex	0fab9c3b8c	Merge pull request 'Helm: Include newer config parameters as values' (#565) from jonatan/garage:main into main ... Reviewed-on: #565	2023-05-09 08:49:00 +00:00
Jakub Jirutka	75759a163c	Allow to really disable sled feature	2023-05-09 08:46:15 +00:00
Jakub Jirutka	d2deee0b8b	Declare garage crates using workspace.dependencies ... This will allow to really disable "sled" feature without declaring `default-features = false` in every Cargo.toml where garage_db and garage_model is used. See https://doc.rust-lang.org/cargo/reference/workspaces.html#the-dependencies-table	2023-05-09 08:46:15 +00:00
Alex	8499cd5c21	Merge pull request 'Remove unnecessary/unused "timeago" features' (#559) from jirutka/garage:timeago-features into main ... Reviewed-on: #559	2023-05-09 08:44:22 +00:00
Jonatan Steuernagel	4ea7983093	Helm: Increment patch version	2023-05-08 08:03:21 +02:00
Jonatan Steuernagel	d5e39d11eb	Helm: Include newer config parameters as values ... Add all missing parameters from the reference manual. Primarily to enable the use of the new lmdb engine	2023-05-08 07:47:31 +02:00
Jakub Jirutka	6d3ace1ea9	Fix undefined macro warn! on 32-bit ... Compiling garage_db v0.8.2 (garage-0.8.2/src/db) error: cannot find macro `warn` in this scope --> src/db/lmdb_adapter.rs:352:2 | 352 | warn!("LMDB is not recommended on 32-bit systems, database size will be limited"); | ^^^^ | = help: consider importing this macro: tracing::warn = note: `warn` is in scope, but it is an attribute: `#[warn]` error: could not compile `garage_db` due to previous error	2023-05-07 17:01:44 +02:00
Jakub Jirutka	833cf082da	Remove unnecessary/unused "timeago" features ... To decrease dependency bloat and binary size.	2023-05-07 01:03:54 +02:00
Alex	a1fcf1b175	Merge branch 'main' into next	2023-04-25 16:58:57 +02:00
Alex	1ecd88c01f	Merge pull request 'Update rust toolchain to 1.68 and simplify Nix stuff' (#554) from nix-update-simplify into main ... Reviewed-on: #554	2023-04-25 14:56:49 +00:00
Alex	5efcdc0de3	Update rust toolchain to 1.68 and simplify Nix stuff	2023-04-25 14:46:47 +02:00
Alex	fa78d806e3	Merge branch 'main' into next	2023-04-25 12:34:26 +02:00
Alex	a16eb7e4b8	Merge pull request 'api/Cargo.toml: Bumped quick-xml to version 0.26.' (#552) from jpds/garage:quick-xml-0.26 into main ... Reviewed-on: #552	2023-04-24 09:00:00 +00:00
Alex	6742070517	Merge pull request 'block/repair.rs: Added log entries for scrub start/finish.' (#551) from jpds/garage:scrub-log into main ... Reviewed-on: #551	2023-04-24 08:29:36 +00:00
Alex	6894878146	update cargo.nix	2023-04-24 10:26:14 +02:00
Alex	02b0ba5f44	Merge pull request 'cookbook/real-world: fix typo' (#549) from yuka/garage:main into main ... Reviewed-on: #549	2023-04-24 08:24:55 +00:00
Jonathan Davies	fb3bd11dce	block/repair.rs: Added log entries for scrub start/finish.	2023-04-23 22:22:26 +01:00
Jonathan Davies	c168383113	api/Cargo.toml: Bumped quick-xml to version 0.26.	2023-04-23 20:14:28 +01:00