Deuxfleurs
/
garage
43
37
Fork 55
Code Issues 69 Pull Requests 4 Releases 29 Wiki Activity

Work on the partition assignation algorithm #266

Merged
lx merged 4 commits from bug/layout into main 2022-03-24 14:30:08 +00:00
Conversation 1 Commits 4 Files Changed 3 +99 -60
lx commented 2022-03-15 10:40:19 +00:00
Owner
Copy Link

Initially, this PR proposes a small change that helps ensure that nodes for each partition are spread over all datacenters, a property that wasn't ensured previously when going from a 2 DC deployment to a 3 DC deployment. That code was used to fix Deuxfleurs' production cluster which had this exact issue. However, the whole partition assignation algorithm is wanky and needs deep thought to be fixed.

Initially, this PR proposes a small change that helps ensure that nodes for each partition are spread over all datacenters, a property that wasn't ensured previously when going from a 2 DC deployment to a 3 DC deployment. That code was used to fix Deuxfleurs' production cluster which had this exact issue. However, the whole partition assignation algorithm is wanky and needs deep thought to be fixed.
lx added 1 commit 2022-03-15 10:40:28 +00:00
continuous-integration/drone/push Build is passing Details
continuous-integration/drone/pr Build is passing Details
a0ec6c49be
Small change to partition assignation algorithm 
This change helps ensure that nodes for each partition are spread
over all datacenters, a property that wasn't ensured previously
when going from a 2 DC deployment to a 3 DC deployment
lx added 2 commits 2022-03-16 13:43:29 +00:00
continuous-integration/drone/push Build is passing Details
continuous-integration/drone/pr Build is passing Details
b19dd1a3a2
Allow `garage layout assign` to assign to several nodes at once
lx force-pushed bug/layout from 73e891cf5c to a74b6baa3b 2022-03-17 15:44:40 +00:00 Compare
lx force-pushed bug/layout from a74b6baa3b to 509d256c58 2022-03-24 14:27:19 +00:00 Compare
lx commented 2022-03-24 14:30:00 +00:00
Author
Owner
Copy Link

We will probably soon have an algorithm with a perfect optimization solution for the partition assignation problem. In the meantime, this PR helps the current algorithm better equilibrate the number of partitions assigned to nodes within a zone.

We will probably soon have an algorithm with a perfect optimization solution for the partition assignation problem. In the meantime, this PR helps the current algorithm better equilibrate the number of partitions assigned to nodes within a zone.
lx changed title from WIP: Work on the partition assignation algorithm to Work on the partition assignation algorithm 2022-03-24 14:30:03 +00:00
lx merged commit 509d256c58 into main 2022-03-24 14:30:08 +00:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
AdminAPI

Issues concerning the administration API

  
Bug

   
Check AWS

The behaviour should be checked against AWS S3

  
CI

Issues with Nix, Drone, Rust Compiler, etc.

  
Correctness

Issues of theoretical correctness that may impact edge-case scenarios

  
Critical

   
Documentation

   
Ideas

For abstract ideas/proposal to make Garage better, to better communicate our not yet achieved aims

  
Improvement

   
Low priority

For issues that we don't want to spend time on until made absolutely necessary

  
Newcomer

A bug that should be newcomer friendly.

  
Performance

   
S3 Compatibility

   
Testing

   
Usability

Propositions to make Garage easier to operate, by improving error reporting, CLI, etc.

No Label
AdminAPI
Bug
Check AWS
CI
Correctness
Critical
Documentation
Ideas
Improvement
Low priority
Newcomer
Performance
S3 Compatibility
Testing
Usability
Milestone
Clear milestone
No items
No Milestone
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: Deuxfleurs/garage#266
No description provided.
Delete Branch "bug/layout"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?