406 commits

Author	SHA1	Message	Date
Alex Auvolat	cfe8e8d45c	api: PutObject: save trailer checksum in metadata	2025-02-18 21:56:32 +01:00
Alex Auvolat	f6e805e7db	api: various fixes	2025-02-18 21:47:53 +01:00
Alex Auvolat	45e10e55f9	update aws-sdk-s3 in tests and fix wrong checksumming behavior in GetObject	2025-02-18 15:33:42 +01:00
Alex Auvolat	730bfee753	api: validate trailing checksum + add test for unsigned-paylad-trailer	2025-02-18 15:33:42 +01:00
Alex Auvolat	ccab0e4ae5	api: fix optional \n after trailer checksum header	2025-02-18 15:33:42 +01:00
Alex Auvolat	abb60dcf7e	api: remove content-encoding: aws-chunked for streaming payload	2025-02-18 15:33:42 +01:00
Alex Auvolat	f8b0817ddc	api: streaming signature: fix trailer parsing	2025-02-18 12:00:41 +01:00
Alex Auvolat	21c0dda16a	api: refactor: move checksumming code around again	2025-02-17 20:11:06 +01:00
Alex Auvolat	658541d812	api: use checksumming in api_common::signature for put/putpart	2025-02-17 19:54:25 +01:00
Alex Auvolat	c5df820e2c	api: start refactor of signature to calculate checksums earlier	2025-02-17 18:47:06 +01:00
Alex Auvolat	a04d6cd5b8	api: streaming: parse unsigned streaming bodies and payload trailers	2025-02-17 16:23:24 +01:00
Alex Auvolat	44a896f9b5	api: add logic to parse x-amz-content-sha256	2025-02-16 18:25:35 +01:00
Alex Auvolat	cee7560fc1	api: refactor: move checksum algorithms to common	2025-02-16 17:25:55 +01:00
Alex Auvolat	2f0c5ca220	signature: refactor: move constant defs to mod.rs	2025-02-16 16:34:18 +01:00
Alex	859b38b0d2	Merge pull request 'fix compilation warnings' (#959) from fixes into main ... Reviewed-on: #959	2025-02-14 17:32:30 +00:00
Alex Auvolat	c9d00f5f7b	garage_api_s3: remove unused field in ListPartsQuery	2025-02-14 18:25:23 +01:00
Alex Auvolat	165f9316e2	s3api: return Location in CompleteMultipartUpload (fix #852) ... NB. The location returned is not guaranteed to work in all cases. This already fixes the parse issue in #852.	2025-02-14 18:05:07 +01:00
Alex Auvolat	c1b39d9ba1	s3 api: parse x-id query parameter and warn of any inconsistency (fix #822)	2025-02-14 14:30:58 +01:00
Alex Auvolat	5475da8ea8	remove async_trait used in generic_server.rs	2025-02-05 20:31:34 +01:00
Alex Auvolat	d18c5ad0ff	fix tests	2025-01-31 19:12:51 +01:00
Alex Auvolat	3d5e9a027e	cargo defs: simplify and fix descriptions	2025-01-31 18:54:29 +01:00
Alex Auvolat	4563313f87	use cargo-shear to remove many unused dependencies between crates	2025-01-31 18:47:30 +01:00
Alex Auvolat	afa28706e5	split s3/cors.rs into also common/cors.rs	2025-01-31 18:42:14 +01:00
Alex Auvolat	84f1db91c4	fix things up	2025-01-31 18:34:57 +01:00
Alex Auvolat	9fa20d45be	wip: split garage_api into garage_api_{common,s3,k2v,admin}	2025-01-31 18:18:29 +01:00
Alex Auvolat	9f3c7c3720	api: better handling of helper errors to distinguish error codes	2025-01-29 19:14:34 +01:00
Alex Auvolat	e8fa89e834	s3 api: make x-amz-meta-* headers lowercase (fix #844)	2025-01-27 19:58:06 +01:00
Stefan Majer	2eb9fcae20	Fix all typos	2025-01-16 13:22:00 +01:00
Alex Auvolat	7a143f46fc	Bump to version 1.0.1	2024-09-22 14:25:32 +02:00
Alex Auvolat	baf32c9575	api servers: kill opened connections after SIGINT after 10s deadline (fix #806)	2024-08-25 20:04:56 +02:00
trinity-1686a	f190032589	don't modify postobject request before validating policy	2024-08-10 20:10:47 +02:00
Alex Auvolat	afad62939e	[next-0.10] bump version number to 1.0	2024-03-28 15:19:44 +01:00
Alex Auvolat	25c196f34d	[next-0.10] admin api: fix logic in get cluster status	2024-03-27 13:55:49 +01:00
Alex Auvolat	01a0bd5410	[next-0.10] remove impl Deref for LayoutHelper	2024-03-27 13:32:13 +01:00
Alex Auvolat	74949c69cb	[s3-checksum] implement x-amz-checksum-* headers	2024-03-26 15:01:34 +01:00
Alex Auvolat	961b4f9af3	[net-fixes] fix issues with local peer address (fix #761)	2024-03-21 10:45:34 +01:00
Alex Auvolat	3fcb54e3cf	[sse-c] Remove special case for Content-Type header	2024-03-07 15:43:48 +01:00
Alex Auvolat	57acc60082	[sse-c] Implement SSE-C encryption	2024-03-07 15:43:47 +01:00
Alex Auvolat	fe2dc5d51c	Merge branch 'main' into next-0.10	2024-03-07 14:00:34 +01:00
Alex Auvolat	eab2b81be2	[unicode-headers] allow utf-8 in headers + add test for object metadata	2024-03-07 13:42:01 +01:00
Alex Auvolat	bbde9bc912	Merge branch 'main' into next-0.10	2024-03-04 15:56:10 +01:00
Alex	3168bb34a0	Merge pull request 'add request context helper' (#751) from yuka/garage:req-ctx into main ... Reviewed-on: #751	2024-03-04 14:51:05 +00:00
Alex Auvolat	8670140358	[rel-0.9.3] Bump version to 0.9.3	2024-03-04 14:00:55 +01:00
Alex Auvolat	c8e416aaa5	[test-presigned] Use a HeaderMap type for QueryMap	2024-03-04 13:33:14 +01:00
Yureka	fb55682c66	add request context helper	2024-03-04 13:26:39 +01:00
asonix	c94bf45cba	Store original-cased query keys alongside query values	2024-03-04 13:03:27 +01:00
asonix	7c4f3473af	Lowercase query parameter keys when parsing	2024-03-04 13:03:16 +01:00
Alex Auvolat	6a7623e90d	[rel-0.9.2] Bump version to v0.9.2	2024-03-01 16:54:39 +01:00
Alex Auvolat	a36248a169	[fix-signed-headers] aws signatures v4: don't actually check Content-Type is signed ... This page of the AWS docs indicate that Content-Type should be part of the CanonicalHeaders (and therefore SignedHeaders) strings in signature calculation: https://docs.aws.amazon.com/AmazonS3/latest/API/sig-v4-header-based-auth.html However, testing with Minio Client revealed that it did not sign the Content-Type header, and therefore we broke CI by expecting it to be signed. With this commit, we don't mandate Content-Type to be signed anymore, for better compatibility with the ecosystem. Testing against the official behavior of S3 on AWS has not been done.	2024-03-01 13:12:18 +01:00
Alex Auvolat	6d33e721c4	[fix-auth-ct-eq] use consant time comparison for awsv4 signature verification	2024-02-29 13:07:18 +01:00