Alex
952c9570c4
bump version to v0.9.0
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone Build is passing
Details
2023-10-10 14:08:11 +02:00
Alex
3d7892477d
convert_db: fix build
2023-10-10 14:06:25 +02:00
Alex
d4932c31ea
Merge branch 'main' into next
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-10-10 13:57:21 +02:00
Alex
0c431b0c03
admin api: increased compatibility for v0/ endpoints
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/tag Build is passing
Details
continuous-integration/drone Build is passing
Details
2023-10-05 16:56:13 +02:00
Alex
1c13135f25
admin api: remove broken GET /v0/key router rule
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-10-05 16:27:29 +02:00
Alex
2448eb7713
upgrade doc: fixes and precisions
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-10-05 15:29:55 +02:00
Alex
6790e24f5a
Add migration to v0.9 guide
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-10-05 15:20:48 +02:00
Alex
9ccc1d6f4a
move upgrade test to release build
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone Build is passing
Details
2023-10-05 10:42:10 +02:00
Alex
920dec393a
cli: more precise doc comment
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-10-04 10:44:42 +02:00
Alex
2e656b541b
Merge branch 'main' into next
continuous-integration/drone/tag Build is passing
Details
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone Build is passing
Details
2023-10-03 18:40:37 +02:00
Alex
9ac1d5be0e
add upgrade test for garage 0.8 -> 0.9
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-27 14:57:37 +02:00
Alex
897cbf2c27
actually update rmp-serde to 1.1.2 for both garage and netapp dependency ( fix #629 )
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/tag Build is passing
Details
continuous-integration/drone Build was killed
Details
2023-09-27 13:13:00 +02:00
Alex
ad82035b98
Merge branch 'main' into next
2023-09-27 13:11:52 +02:00
Alex
aa7eadc799
Merge pull request 'New layout: fixes and UX improvements' ( #634 ) from new-layout-ux into next
...
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/tag Build is passing
Details
continuous-integration/drone Build is passing
Details
Reviewed-on: #634
2023-09-27 09:04:32 +00:00
Alex
0e5925fff6
layout doc: reformulate
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-22 16:14:47 +02:00
Alex
8d07888fa2
layout doc: write explanations for bizarre scenarios
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-22 16:07:46 +02:00
Alex
405aa42b7d
layout doc: update old text
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-22 10:06:31 +02:00
Alex
b4a0e636d8
new layout doc: add examples of unexpected layout, to explain
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is failing
Details
2023-09-22 09:49:07 +02:00
Alex
1d986bd889
Merge pull request 'Refactor db transactions and add on_commit for table.queue_insert' ( #637 ) from k2v-indices-lmdb into next
...
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
Reviewed-on: #637
2023-09-21 14:03:35 +00:00
Alex
0635250b2b
garage_table/queue_insert: delay worker notification to after transaction commit ( fix #583 )
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-21 15:37:28 +02:00
Alex
f97168f805
garage_db: refactor transactions and add on_commit mechanism
2023-09-21 15:35:31 +02:00
Alex
3ecc17f8c5
new layout: use deterministic randomness for reproducible results
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-09-21 11:21:35 +02:00
Alex
013b026d56
update cargo.nix
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-18 12:18:56 +02:00
Alex
0088599f52
new layout: fix clippy lints
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2023-09-18 12:17:07 +02:00
Alex
749b4865d0
new layout: improve display and fix comments
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-09-18 12:07:45 +02:00
Alex
015ccb39aa
new layout: make zone_redundancy optionnal (if not set, is maximum)
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2023-09-18 11:59:08 +02:00
Alex
2e229d4430
new layout: improve output display
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build was killed
Details
2023-09-12 17:24:51 +02:00
Alex
fd7d8fec59
Merge branch 'main' into next
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/tag Build is passing
Details
continuous-integration/drone Build was killed
Details
2023-09-11 23:09:20 +02:00
Alex
51abbb02d8
Merge branch 'main' into next
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-09-11 20:00:02 +02:00
Alex
ad6b1cc0be
Merge branch 'main' into next
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-09-11 13:14:18 +02:00
Alex
7228fbfd4f
Merge pull request 'multi-hdd support ( fix #218 )' ( #625 ) from multihdd into next
...
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is passing
Details
Reviewed-on: #625
2023-09-11 10:52:01 +00:00
Alex
ba7ac52c19
block repair: simpler/more robust iterator progress calculation
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-11 12:31:34 +02:00
Alex
9526328d38
scrub: clear saved checkpoint when canceling scrub
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-11 12:10:48 +02:00
Alex
7f9ba49c71
block manager: remove data_dir field
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-09-11 11:57:36 +02:00
Alex
de5d792181
block manager: fix indentation (why not detected by cargo fmt?)
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-09-11 11:52:57 +02:00
Alex
be91ef6294
block manager: fix bug where rebalance didn't delete old copies
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-07 16:04:03 +02:00
Alex
2657b5c1b9
block manager: fix bugs
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-07 15:30:56 +02:00
Alex
eb972a8422
doc: update multi-hdd section
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-09-07 14:48:36 +02:00
Alex
2f112ac682
correct free data space accounting for multiple data dirs on same fs
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-07 14:42:20 +02:00
Alex
6a067e30ee
doc: documentation of rebalance repair
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-07 13:49:12 +02:00
Alex
6b008b5bd3
block manager: add rebalance operation to rebalance multi-hdd setups
2023-09-07 13:44:11 +02:00
Alex
6595efd82f
Document multi-hdd support
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-07 13:23:02 +02:00
Alex
bca347a1e8
doc: update page on upgradin clusters
2023-09-07 12:52:44 +02:00
Alex
99ed18350f
block manager: refactor and fix monitoring/statistics
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-07 12:41:36 +02:00
Alex
f38a31b330
block manager: avoid incorrect data_dir configs and avoid losing files
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-09-06 17:49:30 +02:00
Alex
e30865984a
block manager: scrub checkpointing
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-09-06 16:35:28 +02:00
Alex
55c514999e
block manager: fixes in layout
2023-09-06 16:35:28 +02:00
Alex
a44f486931
block manager: refactoring & increase max worker count to 8
2023-09-06 16:35:28 +02:00
Alex
3a74844df0
block manager: fix dir_not_empty
2023-09-06 16:35:28 +02:00
Alex
93114a9747
block manager: refactoring
2023-09-06 16:35:28 +02:00
Alex
fd00a47ddc
table queue: increase batch size
2023-09-06 16:35:28 +02:00
Alex
1b8c265c14
block manager: get rid of check_block_status
2023-09-06 16:35:28 +02:00
Alex
3199cab4c8
update cargo.nix
2023-09-06 16:35:28 +02:00
Alex
a09f86729c
block manager: move blocks in write_block if necessary
2023-09-06 16:35:28 +02:00
Alex
887b3233f4
block manager: use data paths from layout
2023-09-06 16:35:28 +02:00
Alex
6c420c0880
block manager: multi-directory layout computation
2023-09-06 16:35:28 +02:00
Alex
71c0188055
block manager: skeleton for multi-hdd support
2023-09-06 16:35:28 +02:00
Alex
4b4f2000f4
lifecycle: fix SkipBucket bug
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build was killed
Details
2023-09-06 16:34:07 +02:00
Alex
3f461d8891
Merge pull request 'object lifecycles ( fix #309 )' ( #620 ) from bucket-lifecycle into next
...
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
Reviewed-on: #620
2023-09-04 09:45:10 +00:00
Alex
8e0c020bb9
lifecycle worker: correct small clippy lints
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-09-04 11:33:44 +02:00
Alex
1cdc321e28
lifecycle worker: don't get stuck on non-existent bucket
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-08-31 11:36:30 +02:00
Alex
f579d6d9b4
lifecycle worker: fix potential inifinite loop
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-08-31 11:29:54 +02:00
Alex
a00a52633f
lifecycle worker: add log message when starting
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-31 11:25:14 +02:00
Alex
adbf5925de
lifecycle worker: use queue_insert and process objects in batches
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-31 11:19:26 +02:00
Alex
1cfcc61de8
lifecycle worker: mitigate potential bugs + refactoring
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-31 00:28:37 +02:00
Alex
be03a4610f
s3api: remove redundant serde rename attribute
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-31 00:00:26 +02:00
Alex
b2f679675e
lifecycle worker: take into account disabled rules
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-30 23:52:09 +02:00
Alex
5fad4c4658
update cargo.nix
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-08-30 23:47:42 +02:00
Alex
01c327a07a
lifecycle worker: avoid building chrono's serde feature
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-30 23:46:15 +02:00
Alex
f0a395e2e5
s3 bucket apis: remove redundant call
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-30 23:39:28 +02:00
Alex
d94f1c9178
reference manual: remove obsolete caveat about multipart uploads
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-30 23:27:02 +02:00
Alex
5c923d48d7
reference manual: document support for lifecycle configuration
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-30 23:24:28 +02:00
Alex
a1d57283c0
bucket_table: bucketparams::new doesn't need to be pub
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-08-30 20:07:14 +02:00
Alex
d2e94e36d6
lifecycle config: add missing line in merge() and remove tracing
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-30 20:05:53 +02:00
Alex
75ccc5a95c
lifecycle config: store date as given, try to debug
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-30 20:02:07 +02:00
Alex
7200954318
lifecycle worker: add logging
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-08-30 14:54:52 +02:00
Alex
0f1849e1ac
lifecycle worker: launch with the rest of Garage
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-08-30 14:51:08 +02:00
Alex
da8b224e24
lifecycle worker: skip entire bucket when no lifecycle config is set
2023-08-30 14:38:19 +02:00
Alex
2996dc875f
lifecycle worker: implement main functionality
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-30 14:29:03 +02:00
Alex
a2e0e34db5
lifecycle: skeleton for lifecycle worker
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-08-30 12:41:11 +02:00
Alex
f7b409f114
use a NaiveDate in data model, it serializes to string (iso 8601 format)
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-08-30 11:24:01 +02:00
Alex
abf011c290
lifecycle: implement validation into garage's internal data structure
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-29 18:22:03 +02:00
Alex
8041d9a827
s3: add xml structures to serialize/deserialize lifecycle configs
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-08-29 17:44:17 +02:00
Alex
0b83e0558e
bucket_table: data model for lifecycle configuration
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-08-29 17:00:41 +02:00
Alex
2e90e1c124
Merge branch 'main' into next
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/tag Build was killed
Details
continuous-integration/drone Build is passing
Details
2023-08-29 11:32:42 +02:00
Alex
8ef42c9609
admin docs: reformatting, key admin: add check
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-06-14 17:19:25 +02:00
Alex
a83a092c03
admin: uniformize layout api and improve code
2023-06-14 17:12:37 +02:00
Alex
7895f99d3a
admin and cli: hide secret keys unless asked
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-06-14 16:56:15 +02:00
Alex
4a82f6380e
admin api: move all endpoints to v1/ by default (v0/ still supported)
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-06-14 14:15:51 +02:00
Alex
28cc9f178a
admin api: make name optionnal for CreateKey
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-06-14 13:56:37 +02:00
Alex
2c83006608
admin api: fix doc in drafts
2023-06-14 13:54:34 +02:00
Alex
35c108b85d
admin api: switch GetClusterHealth to camelcase ( fix #381 again)
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-06-14 13:53:19 +02:00
Alex
52376d47ca
admin api: change cluster status/layout to use lists and not maps ( fix #377 )
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-06-14 13:45:27 +02:00
Alex
187240e539
Merge branch 'main' into next
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-06-14 13:02:46 +02:00
Alex
5670367126
multipartupload in test: add forgotten timestamp
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-06-13 23:10:46 +02:00
Alex
cda957b4b1
update netapp's rmp-serde dependency to v1.1
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-06-13 17:34:49 +02:00
Alex
90b2d43eb4
Merge branch 'main' into next
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-06-13 17:14:11 +02:00
Alex
bf19a44fd9
admin API: add missing camelCase conversions ( fix #381 )
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-06-13 16:15:50 +02:00
Alex
7126f3e1d1
garage key import: add checks and `--yes` CLI flag ( fix #278 )
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-06-13 15:56:48 +02:00
Alex
942c1f1bfe
multipart uploads: save timestamp
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-06-13 10:48:22 +02:00
Alex
0a06fda0da
Merge pull request 'Fix #204 (full Multipart Uploads semantics)' ( #553 ) from nlnet-task1 into next
...
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is passing
Details
Reviewed-on: #553
2023-06-09 15:34:09 +00:00
Alex
3d477906d4
properly delete multipart uploads after completion
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone/push Build is passing
Details
2023-06-09 17:13:27 +02:00
Alex
e645bbd3ce
smoke test: add multipart upload test with part re-upload
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
continuous-integration/drone Build was killed
Details
2023-06-09 16:23:37 +02:00
Alex
58563ed700
Add multipart upload using aws s3api
2023-06-09 16:23:37 +02:00
Alex
a6cc563bdd
UploadPart: automatic cleanup of version (and reference blocked) when interrupted
2023-06-09 16:23:37 +02:00
Alex
c14d3735e5
Add test for multipart uploads and fix part renumbering
2023-06-09 16:23:37 +02:00
Alex
53bf2f070c
undo sort_key() returning Cow
2023-06-09 16:23:37 +02:00
Alex
412ab77b08
comments and clippy lint fixes
2023-06-09 16:23:37 +02:00
Alex
511e07ecd4
fix mpu counter (add missing workers) and report info at appropriate places
2023-06-09 16:23:37 +02:00
Alex
4ea53dc759
Add multipart upload repair
2023-06-09 16:23:37 +02:00
Alex
058518c22b
refactor repair workers with a trait
2023-06-09 16:23:37 +02:00
Alex
8644376ac2
fix test; simplify code
2023-06-09 16:23:37 +02:00
Alex
7ad7dae5d4
fix s3 list test
2023-06-09 16:23:37 +02:00
Alex
75a0e01372
fix online repair
2023-06-09 16:23:37 +02:00
Alex
bb176ebcb8
cargo fmt
2023-06-09 16:23:37 +02:00
Alex
c1e1764f17
move git-version dependency to main crate to reduce rebuilds
2023-06-09 16:23:37 +02:00
Alex
87be8eeb93
updaet block admin for new multipartupload models
2023-06-09 16:23:37 +02:00
Alex
82e75c0e29
Adapt S3 API code to use new multipart upload models
...
- Create and PutPart
- completemultipartupload
- upload part copy
- list_parts
2023-06-09 16:23:37 +02:00
Alex
38d6ac4295
New multipart upload table layout
2023-06-09 16:23:37 +02:00
Alex
6005491cd8
Use Cow<[u8]> for sort keys
2023-06-09 16:23:37 +02:00
Alex
ea3bfd2ab1
Minio tests for multipart upload behaviour:
...
- upload part renumbering test
- part skipping test
2023-06-09 16:23:37 +02:00
Alex
e7e164a280
Make fsync an option for meta and data
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is passing
Details
2023-06-09 16:23:21 +02:00
Alex
1e466b11eb
Revert integration tests to using Sled as LMDB causes failures
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is passing
Details
2023-06-09 13:23:08 +02:00
Alex
865f0c7d0c
Add LMDB to debug builds
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-06-09 12:04:28 +02:00
Alex
906fe78b24
Integration tests: print logs when fails
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-06-09 12:03:44 +02:00
Alex
8a74e1c2bd
Split garage/admin.rs into smaller files
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-06-06 15:39:15 +02:00
Alex
19639705e6
Mark sled as deprecated, make lmdb default, and improve sqlite and lmdb defaults
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2023-05-17 14:30:53 +02:00
Alex
351d734e6c
Merge branch 'main' into next
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-05-09 12:40:08 +02:00
Alex
a1fcf1b175
Merge branch 'main' into next
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2023-04-25 16:58:57 +02:00
Alex
fa78d806e3
Merge branch 'main' into next
2023-04-25 12:34:26 +02:00
Alex
654999e254
Update Cargo.nix
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is passing
Details
2023-01-26 15:50:54 +01:00
Jonathan Davies
db56d4658f
util/Cargo.toml: Updated rmp-serde from 0.15 to 1.1.
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2023-01-26 11:03:43 +00:00
Alex
12a4e1f303
Merge branch 'optimal-layout' into next
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is passing
Details
2023-01-11 17:50:42 +01:00
Alex
84b4a868e3
Migration of cluster layout from v0.8 to v0.9
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is passing
Details
2023-01-11 17:47:46 +01:00
Alex
4f409f73dc
Merge pull request 'Changed all instances of assignation to assignment' ( #465 ) from jpds/garage:assignments-correction into next
...
continuous-integration/drone/push Build is passing
Details
Reviewed-on: #465
2023-01-11 16:05:27 +00:00
Mendes
597d64b31a
change in gitignore
continuous-integration/drone/push Build is passing
Details
2023-01-09 16:06:47 +01:00
Mendes
e3cc7a89b0
First draft of t a preprint describing the layout computation algorithm
continuous-integration/drone/push Build is passing
Details
2023-01-09 16:05:20 +01:00
Jonathan Davies
cb07e6145c
Changed all instances of assignation to assignment.
continuous-integration/drone/pr Build is passing
Details
2023-01-05 11:09:25 +00:00
Alex
80e4abb98d
Merge pull request 'Changed all instances of 'key new' to 'key create' to make it the same as the bucket commands.' ( #459 ) from jpds/garage:key-create-standardize into next
...
continuous-integration/drone/push Build is passing
Details
Reviewed-on: #459
2023-01-04 10:35:49 +00:00
Alex
570e5e5bbb
Merge branch 'main' into next
continuous-integration/drone/push Build is passing
Details
2023-01-04 11:34:43 +01:00
Jonathan Davies
8be862aa19
Changed all instances of 'key new' to 'key create' to make it consistent as bucket commands issued normally around the same time.
continuous-integration/drone/pr Build is passing
Details
2023-01-03 11:11:12 +00:00
Alex
6e44369cbc
Merge pull request 'Optimal layout assignation algorithm' ( #296 ) from optimal-layout into next
...
continuous-integration/drone/push Build is passing
Details
Reviewed-on: #296
2022-12-11 17:41:53 +00:00
Alex
2c2e65ad8b
Merge commit 'ec12d6c' into next
continuous-integration/drone/push Build is passing
Details
2022-12-11 18:41:15 +01:00
Alex
9d83364ad9
itertools .unique() doesn't require sorted items
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is failing
Details
2022-12-11 18:30:02 +01:00
Alex
ec12d6c8dd
Slightly simplify code at places
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2022-11-08 16:15:45 +01:00
Alex
217abdca18
Fix HTTP return code
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2022-11-08 15:38:53 +01:00
Alex
fc2729cd81
Fix integration test
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/pr Build is passing
Details
2022-11-08 15:19:46 +01:00
Alex
d75b37b018
Return more info when layout's .check() fails, fix compilation, fix test
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2022-11-08 14:58:39 +01:00
Alex
73a4ca8b15
Use bytes as capacity units
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2022-11-07 21:12:11 +01:00
Alex
fd5bc142b5
Ensure .sort() is called before counting unique items
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2022-11-07 20:29:25 +01:00
Alex
ea5afc2511
Style improvements
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2022-11-07 20:11:30 +01:00
Alex
28d7a49f63
Merge branch 'main' into optimal-layout
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2022-11-07 12:20:59 +01:00
Alex
3039bb5d43
rm .gitattributes
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2022-10-13 12:40:42 +02:00
Mendes
bcdd1e0c33
Added some comment
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build encountered an error
Details
2022-10-11 18:29:21 +02:00
Mendes
e5664c9822
Improved the statistics displayed in layout show
...
corrected a few bugs
2022-10-11 17:17:13 +02:00
Mendes
4abab246f1
cargo fmt
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2022-10-10 17:21:13 +02:00
Mendes
fcf9ac674a
Tests written in layout.rs
...
added staged_parameters to ClusterLayout
removed the serde(default) -> will need a migration function
2022-10-10 17:19:25 +02:00
Mendes
911eb17bd9
corrected warnings of cargo clippy
2022-10-06 14:53:57 +02:00
Mendes
9407df60cc
Corrected two bugs:
...
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
- self.node_id_vec was not properly updated when the previous ring was empty
- ClusterLayout::merge was not considering changes in the layout parameters
2022-10-06 12:54:51 +02:00
Mendes
a951b6c452
Added a CLI command to update the parameters for the layout computation (for now, only the zone redundancy)
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2022-10-05 16:04:19 +02:00
Mendes
ceac3713d6
modifications in several files to :
...
- have consistent error return types
- store the zone redundancy in a Lww
- print the error and message in the CLI (TODO: for the server Api, should msg be returned in the body response?)
2022-10-05 15:29:48 +02:00
Mendes
829f815a89
Merge remote-tracking branch 'origin/main' into optimal-layout
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2022-10-04 18:14:49 +02:00
Mendes
99f96b9564
deleted zone_redundancy from System struct
continuous-integration/drone/push Build is pending
Details
continuous-integration/drone/pr Build is pending
Details
2022-10-04 18:09:24 +02:00
Mendes
bd842e1388
Correction of a few bugs in the tests, modification of ClusterLayout::check
continuous-integration/drone/push Build is pending
Details
continuous-integration/drone/pr Build is pending
Details
2022-09-22 19:30:01 +02:00
Mendes
7f3249a237
New version of the algorithm that calculate the layout.
...
It takes as paramters the replication factor and the zone redundancy, computes the
largest partition size reachable with these constraints, and among the possible
assignation with this partition size, it computes the one that moves the least number
of partitions compared to the previous assignation.
This computation uses graph algorithms defined in graph_algo.rs
2022-09-21 14:39:59 +02:00
Mendes
c4adbeed51
Added the section with description proofs of the parametric assignment computation in the optimal layout report
continuous-integration/drone/push Build was killed
Details
continuous-integration/drone/pr Build was killed
Details
2022-09-10 13:51:12 +02:00
Mendes
d38fb6c250
ignore log files in commit
2022-09-08 12:43:33 +02:00
Mendes
81083dd415
Added a first draft version of the algorithm and analysis for the non-strict mode.
continuous-integration/drone/push Build was killed
Details
continuous-integration/drone/pr Build was killed
Details
2022-08-19 21:21:41 +02:00
Mendes
7b2c065c82
Merge branch 'optimal-layout' of https://git.deuxfleurs.fr/Deuxfleurs/garage into optimal-layout
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2022-07-19 13:30:49 +02:00
Mendes
03e3a1bd15
Added the latex report on the optimal layout algorithm
2022-07-18 22:35:29 +02:00
Alex
617f28bfa4
Correct small formatting issue
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2022-05-05 14:21:57 +02:00
Mendes
948ff93cf1
Corrected the warnings and errors issued by cargo clippy
continuous-integration/drone/pr Build is failing
Details
continuous-integration/drone/push Build is failing
Details
2022-05-01 16:05:39 +02:00
Alex
3ba2c5b424
updated cargo.lock
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2022-05-01 10:11:43 +02:00
Alex
2aeaddd5e2
Apply cargo fmt
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2022-05-01 09:57:05 +02:00
Alex
c1d1646c4d
Change the way new layout assignations are computed.
...
continuous-integration/drone/push Build is failing
Details
The function now computes an optimal assignation (with respect to partition size) that minimizes the distance to the former assignation, using flow algorithms.
This commit was written by Mendes Oulamara <mendes.oulamara@pm.me>
2022-05-01 09:54:19 +02:00