Deuxfleurs/garage

avoid writing blocks to draining nodes ? #815

New issue

Open

opened 2024-04-22 15:52:43 +00:00 by lx · 1 comment

lx commented

2024-04-22 15:52:43 +00:00

Owner

Currently, when nodes are being removed from the layout, they continue receiving writes for metadata as per the consistency protocol. This means also that they will continue receiving the block_ref entries and the data blocks for the partitions they were responsible of. This is an issue as it can cause nodes to fill up quickly, which is especially problematic when we are removing nodes that are full to replace them with bigger nodes. We should probably find a way to avoid storing blocks on draining nodes, as long as we have a quorum of writes on other nodes.

Currently, when nodes are being removed from the layout, they continue receiving writes for metadata as per the consistency protocol. This means also that they will continue receiving the block_ref entries and the data blocks for the partitions they were responsible of. This is an issue as it can cause nodes to fill up quickly, which is especially problematic when we are removing nodes that are full to replace them with bigger nodes. We should probably find a way to avoid storing blocks on draining nodes, as long as we have a quorum of writes on other nodes.

lx added the

label 2024-04-22 15:52:43 +00:00

lx added

and removed

labels 2024-04-22 15:57:15 +00:00

lx commented

2024-05-24 16:49:33 +00:00

Author

Owner

Algorithm: try to have a quorum only on the current nodes. If we can not, use older nodes to achieve a quorum

Algorithm: try to have a quorum only on the current nodes. If we can not, use older nodes to achieve a quorum

lx added this to the v1.1 milestone 2024-05-24 17:10:15 +00:00

Sign in to join this conversation.

No labels

S3 Compatibility

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Deuxfleurs/garage#815

No description provided.