Alex
1bcd6fabbd
New buckets for 0.6.0: small changes
...
- Fix bucket delete
- fix merge of bucket creation date
- Replace deletable with option in aliases
Rationale: if two aliases point to conflicting bucket, resolving
by making an arbitrary choice risks making data accessible when it
shouldn't be. We'd rather resolve to deleting the alias until
someone puts it back.
2022-01-04 12:52:47 +01:00
Alex
ba7f268b99
Rename and change query filters
2022-01-04 12:52:46 +01:00
Alex
e59c23a69d
Refactor logic for setting/unsetting aliases
2022-01-04 12:52:46 +01:00
Alex
2140cd7205
Remove website redirects
2022-01-04 12:52:46 +01:00
Alex
beeef4758e
Some movement of helper code and refactoring of error handling
2022-01-04 12:52:46 +01:00
Alex
d8ab5bdc3e
New buckets for 0.6.0: fix model and migration
2022-01-04 12:47:28 +01:00
Alex
c7d5c73244
Add must_use to some CRDT functions
2022-01-04 12:47:28 +01:00
Alex
b76d0580a0
Fix forgotten flag
2022-01-04 12:47:28 +01:00
Alex
87121dce9d
New buckets for 0.6.0: documentation and build files
2022-01-04 12:47:06 +01:00
Alex
b1cfd16913
New buckets for 0.6.0: small fixes, including:
...
- ensure bucket names are correct aws s3 names
- when making aliases, ensure timestamps of links in both ways are the
same
- fix small remarks by trinity
- don't have a separate website_access field
2022-01-04 12:46:41 +01:00
Alex
5db600e231
More complete output to bucket info and key info
2022-01-04 12:46:41 +01:00
Alex
4d30e62db4
New buckets for 0.6.0: migration code and build files
2022-01-04 12:46:13 +01:00
Alex
0bbb6673e7
Model changes
2022-01-04 12:45:52 +01:00
Alex
53f71b3a57
Implement bucket alias and bucket unalias
2022-01-04 12:45:51 +01:00
Alex
5b1117e582
New model for buckets
2022-01-04 12:45:46 +01:00
Alex
8f6026de5e
Make table name a const in trait
2021-12-15 15:39:10 +01:00
trinity-1686a
ca7b438f3f
less strict ListBuckets ( #178 )
...
continuous-integration/drone/push Build is passing
fix #175
Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com>
Reviewed-on: #178
Co-authored-by: trinity-1686a <trinity.pointard@gmail.com>
Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
2021-12-15 15:05:36 +01:00
trinity-1686a
1eb972b1ac
Add compression using zstd ( #173 )
...
continuous-integration/drone/push Build is passing
fix #27
Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com>
Reviewed-on: #173
Co-authored-by: trinity-1686a <trinity.pointard@gmail.com>
Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
2021-12-15 11:26:43 +01:00
trinity-1686a
60d4459926
BucketWebsite ( #174 )
...
continuous-integration/drone/push Build is passing
fix #77
this does not store anything but a on/off switch for website, and does not implement GetBucketWebsite as it would require storing more. GetBucketWebsite should be pretty easy to implement once data is stored though.
Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com>
Reviewed-on: #174
Co-authored-by: trinity-1686a <trinity.pointard@gmail.com>
Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
2021-12-15 10:41:39 +01:00
trinity-1686a
c4ac8835d3
add proper request router for s3 api ( #163 )
...
continuous-integration/drone/push Build is passing
fix #161
Current request router was organically grown, and is getting messier and messier with each addition.
This router cover exaustively existing API endpoints (with exceptions listed in [#161(comment)](#161 (comment) ) either because new and old api endpoint can't feasabily be differentied, or it's more lambda than s3).
Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com>
Reviewed-on: #163
Reviewed-by: Alex <alex@adnab.me>
Co-authored-by: trinity-1686a <trinity.pointard@gmail.com>
Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
2021-12-06 15:17:47 +01:00
trinity-1686a
7f26ed55cd
Improved handling of HTTP ranges
...
continuous-integration/drone/push Build is failing
- correct HTTP code when range syntax is invalid (fix #140 )
- when multiple ranges are given, simply ignore and send whole file
Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com>
Reviewed-on: #157
Reviewed-by: Alex <alex@adnab.me>
Co-authored-by: trinity-1686a <trinity.pointard@gmail.com>
Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
2021-11-29 11:52:42 +01:00
Quentin
8811bb08e6
In ListBuckets, hide entry if no perms
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
2021-11-22 12:10:28 +01:00
Alex
c94406f428
Improve how node roles are assigned in Garage
...
continuous-integration/drone/pr Build is passing
continuous-integration/drone/tag Build is passing
continuous-integration/drone/push Build is passing
continuous-integration/drone Build is passing
- change the terminology: the network configuration becomes the role
table, the configuration of a nodes becomes a node's role
- the modification of the role table takes place in two steps: first,
changes are staged in a CRDT data structure. Then, once the user is
happy with the changes, they can commit them all at once (or revert
them).
- update documentation
- fix tests
- implement smarter partition assignation algorithm
This patch breaks the format of the network configuration: when
migrating, the cluster will be in a state where no roles are assigned.
All roles must be re-assigned and commited at once. This migration
should not pose an issue.
2021-11-16 16:05:53 +01:00
Trinity Pointard
53888995bd
update doc and comments
continuous-integration/drone/push Build is passing
2021-11-16 15:41:41 +01:00
Trinity Pointard
396fe4c702
clippy
2021-11-16 15:41:41 +01:00
Trinity Pointard
02158ee666
fix issue where list on vhost-bucket would list bucket instead of bucket content
2021-11-16 15:41:41 +01:00
Trinity Pointard
9c58ec28d3
add support for vhost-style s3 bucket
2021-11-16 15:41:41 +01:00
Alex
ad7ab31411
Implement GC delay for table data
continuous-integration/drone/push Build is passing
continuous-integration/drone/pr Build is passing
2021-11-08 15:47:47 +01:00
Alex
74a7a550eb
Safety: never voluntarily delete block in 10min interval after RC reaches zero
2021-11-08 15:47:47 +01:00
Alex
cc255d46cd
Refactor and comment table GC logic
2021-11-08 15:47:44 +01:00
Trinity Pointard
9d7535c3f5
allow missing bootstrap_peers in garage.toml
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
2021-11-05 16:36:25 +01:00
Alex
e8811f7c9d
Request strategy: don't launch all 3 requests if not needed
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
continuous-integration/drone Build is passing
2021-11-04 16:19:27 +01:00
Alex
2090a6187f
Add tranquilizer mechanism to improve on token bucket mechanism
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
2021-11-04 13:26:59 +01:00
Alex
6f13d083ab
Add semaphore to limit RAM used by buffered outgoing requests
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
continuous-integration/drone Build is passing
2021-11-03 18:02:57 +01:00
Alex
8c4f418fe8
Fix peer list persistence: do not forget previous peers
continuous-integration/drone/pr Build was killed
continuous-integration/drone Build is passing
continuous-integration/drone/push Build is passing
2021-11-03 17:34:44 +01:00
Jill
bef6d627b0
Add environment variables equivalents for some CLI options.
continuous-integration/drone/push Build is passing
2021-11-03 16:00:57 +01:00
Alex
69b89fb46d
Fix race in block resync
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
2021-10-27 12:01:12 +02:00
Alex
6b47c294f5
Refactoring on repair commands
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
2021-10-27 11:14:55 +02:00
Trinity Pointard
28c015d9ff
add cli parameter to verify local bloc integrity
...
continuous-integration/drone/push Build is passing
reuse code for listing local blocks
add disk i/o speed limit on integrity check
2021-10-27 10:31:03 +02:00
Alex
3e7f766d95
CLI: default rpc_host
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
continuous-integration/drone Build is passing
2021-10-26 11:36:30 +02:00
Alex
43e13a501d
Use published netapp crate instead of git repo
continuous-integration/drone/push Build is passing
2021-10-26 10:36:57 +02:00
Alex
ada7899b24
Fix clippy lints ( fix #121 )
continuous-integration/drone/pr Build is passing
continuous-integration/drone/push Build is passing
2021-10-26 10:20:05 +02:00
Alex
df8a4068d9
Refactor block manager code, and hopefully fix deadlock
continuous-integration/drone/push Build is passing
continuous-integration/drone/pr Build is passing
2021-10-25 14:21:51 +02:00
Alex
de4276202a
Improve CLI, adapt tests, update documentation
2021-10-25 14:21:48 +02:00
Alex
1b450c4b49
Improvements to CLI and various fixes for netapp version
...
Discovery via consul, persist peer list to file
2021-10-22 16:55:24 +02:00
Alex
4067797d01
First port of Garage to Netapp
2021-10-22 15:55:18 +02:00
Quentin
dc017a0cab
Build Garage with Nix
continuous-integration/drone/pr Build is passing
continuous-integration/drone Build is passing
continuous-integration/drone/push Build is passing
2021-10-19 16:56:07 +02:00
Alex
1acf7e4c66
Fix git_version!() when not in git repo ( fix #100 )
continuous-integration/drone/push Build was killed
continuous-integration/drone Build is passing
2021-10-11 14:26:54 +02:00
Alex
f6060b92aa
Fix HTTP return code for DeleteObject ( fix #98 )
2021-10-11 14:24:49 +02:00
Alex
f3a097abdf
WIP: try to fix #93 , and improve S3 ListObjects (v1 and v2) API calls
2021-10-11 11:15:47 +02:00