cleanup-incomplete-uploads fails with "Could not reach quorum of 2" #915

New issue

Open

opened 2024-12-26 06:31:01 +00:00 by vk · 0 comments

vk commented

2024-12-26 06:31:01 +00:00

Contributor

Hello,

I have a tiny website bucket with lots of incomplete multipart uploads, due to middleware (sftpgo) aborting a 1Gb upload multiple times after going out of disk space.
Attempting to clear them up using command-line fails unconditionally.

$ garage bucket info xxxxxx.net
Bucket: 799e87722ffbd6b32c7ea90efcc662c5602e50dab566e21580b7824a34db0d6f

Size: 1.4 MiB (1.5 MB)
Objects: 5
Unfinished uploads (multipart and non-multipart): 5
Unfinished multipart uploads: 5
Size of unfinished multipart uploads: 4.4 GiB (4.8 GB)

This fails from any node:

$ garage bucket cleanup-incomplete-uploads xxxxxx.net
Error: Internal error: Remote error: Could not reach quorum of 2 (sets=Some(0)). 0 of 0 request succeeded, others returned errors: []

Nothing related to this operation appears in logs (except the garage cli connecting and disconnecting).

All nodes are interconnected as per garage status, and, besides this, all operations work.

garage cargo:1.0.1 [features: k2v, lmdb, sqlite, metrics, bundled-libs]

Hello, I have a tiny website bucket with lots of incomplete multipart uploads, due to middleware (sftpgo) aborting a 1Gb upload multiple times after going out of disk space. Attempting to clear them up using command-line fails unconditionally. ``` $ garage bucket info xxxxxx.net Bucket: 799e87722ffbd6b32c7ea90efcc662c5602e50dab566e21580b7824a34db0d6f Size: 1.4 MiB (1.5 MB) Objects: 5 Unfinished uploads (multipart and non-multipart): 5 Unfinished multipart uploads: 5 Size of unfinished multipart uploads: 4.4 GiB (4.8 GB) ``` This fails from any node: ``` $ garage bucket cleanup-incomplete-uploads xxxxxx.net Error: Internal error: Remote error: Could not reach quorum of 2 (sets=Some(0)). 0 of 0 request succeeded, others returned errors: [] ``` Nothing related to this operation appears in logs (except the `garage` cli connecting and disconnecting). All nodes are interconnected as per `garage status`, and, besides this, all operations work. `garage cargo:1.0.1 [features: k2v, lmdb, sqlite, metrics, bundled-libs]`

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Deuxfleurs/garage#915

No description provided.