Withings withings
0 followers · 0 following
Repositories
1
 Projects Packages Public activity Starred repositories
withings commented on pull request Deuxfleurs/garage#906 2024-11-22 15:51:25 +00:00
WIP: Fjall DB engine

First, to sort of eliminate the idea that this is caused by a combination of "this backend" on "this hardware," I re-ran your write-bench tool with --fjall and graphed the insert times again. I…

withings pushed to feat/rocksdb-engine at withings/garage 2024-11-22 09:27:37 +00:00
8b3edd86e4 Implement a RocksDB backend for benchmarking
906c8708fd Merge pull request 'add extraVolumes and extraVolumeMounts to helm chart' (#896) from eugene-davis/garage:main into main
747889a096 Merge pull request 'Update Python SDK documentation' (#887) from cryptolukas/garage:fix-python-sdk-docs into main
feb09a4bc6 Merge pull request 'doc: update mastodon media header pruning section' (#888) from teutat3s/garage:doc-update-mastodon-media into main
aa8bc6aa88 Merge pull request 'doc: add Triplebit's use-case' (#901) from jonah/garage:triplebit into main
Compare 11 commits »
withings created pull request Deuxfleurs/garage#906 2024-11-21 17:37:42 +00:00
WIP: Fjall DB engine
withings pushed to feat/fjall-db-engine at withings/garage 2024-11-21 17:23:55 +00:00
c50cab80fa Upgrade fjall to 2.4, add option to set block cache size
withings pushed to feat/fjall-db-engine at withings/garage 2024-11-20 09:30:06 +00:00
9e576e4f35 Add support for an LSM-tree-based backend with Fjall
906c8708fd Merge pull request 'add extraVolumes and extraVolumeMounts to helm chart' (#896) from eugene-davis/garage:main into main
747889a096 Merge pull request 'Update Python SDK documentation' (#887) from cryptolukas/garage:fix-python-sdk-docs into main
feb09a4bc6 Merge pull request 'doc: update mastodon media header pruning section' (#888) from teutat3s/garage:doc-update-mastodon-media into main
aa8bc6aa88 Merge pull request 'doc: add Triplebit's use-case' (#901) from jonah/garage:triplebit into main
Compare 11 commits »
withings pushed to main at withings/garage 2024-11-20 09:27:39 +00:00
906c8708fd Merge pull request 'add extraVolumes and extraVolumeMounts to helm chart' (#896) from eugene-davis/garage:main into main
747889a096 Merge pull request 'Update Python SDK documentation' (#887) from cryptolukas/garage:fix-python-sdk-docs into main
feb09a4bc6 Merge pull request 'doc: update mastodon media header pruning section' (#888) from teutat3s/garage:doc-update-mastodon-media into main
aa8bc6aa88 Merge pull request 'doc: add Triplebit's use-case' (#901) from jonah/garage:triplebit into main
aba7902995 doc: add Triplebit's use-case
Compare 10 commits »
withings commented on issue Deuxfleurs/garage#851 2024-11-19 15:11:24 +00:00
Performances collapse with 10 millions pictures in a bucket

@marvinj97 @lx whoops sorry, force of habit when I created my profile probably. I've set my profile to public. I'll go through your reviews ASAP!

withings pushed to feat/todo-queues at withings/garage 2024-11-18 15:36:41 +00:00
3b3086d513 Implement a queue crate to replace the todo trees
aa8bc6aa88 Merge pull request 'doc: add Triplebit's use-case' (#901) from jonah/garage:triplebit into main
aba7902995 doc: add Triplebit's use-case
78de7b5bde Merge pull request 'fix bit/byte inversion in rpc secret error message' (#898) from trinity-1686a/garage:rpc-comment into main
9bd9e392ba fix bit/byte inversion in rpc secret error message
Compare 5 commits »
withings created pull request Deuxfleurs/garage#903 2024-11-18 15:22:52 +00:00
WIP: replace some todo trees with disk-backed queues
withings commented on issue Deuxfleurs/garage#851 2024-11-18 14:55:39 +00:00
Performances collapse with 10 millions pictures in a bucket

Our Garage instances run in virtual machines with a number of abstractions between them and the drives (RAID, encryption, ...) so it's a bit difficult to pin it down to the hardware itself. That…

withings created branch feat/fjall-db-engine in withings/garage 2024-11-18 14:45:53 +00:00
withings pushed to feat/fjall-db-engine at withings/garage 2024-11-18 14:45:53 +00:00
7cc7ae9491 Add support for an LSM-tree-based backend with Fjall
withings created branch feat/todo-queues in withings/garage 2024-11-18 14:31:56 +00:00
withings pushed to feat/todo-queues at withings/garage 2024-11-18 14:31:56 +00:00
ab3a409d04 Implement a queue crate to replace the todo trees
withings created branch feat/lmdb-hashed-keys in withings/garage 2024-11-14 13:32:30 +00:00
withings pushed to feat/lmdb-hashed-keys at withings/garage 2024-11-14 13:32:30 +00:00
45425a5637 Re-hash keys before storing in LMDB to improve key distribution and avoid prefixes
withings created branch feat/rocksdb-engine in withings/garage 2024-10-23 09:47:51 +00:00
withings pushed to feat/rocksdb-engine at withings/garage 2024-10-23 09:47:51 +00:00
bede3b5834 Implement a RocksDB backend for benchmarking
withings commented on issue Deuxfleurs/garage#851 2024-10-09 14:11:22 +00:00
Performances collapse with 10 millions pictures in a bucket

Hello! Sorry for the delay, there was some OoO on my end.

Thanks for write-bench, I ran it on one of our nodes with Garage down: we observed roughly the same performance trend as the above…

withings pushed to main at withings/garage 2024-10-02 13:44:43 +00:00
a18b3f0d1f Merge pull request 'Garage v1.0.1' (#881) from rel-v1.0.1 into main
7a143f46fc Bump to version 1.0.1
c731f0291a Merge pull request 'fix logic in garage layout skip-dead-nodes + fix typo (fix #879)' (#880) from fix-skip-dead-nodes into main
34453bc9c2 fix logic in garage layout skip-dead-nodes + fix typo (fix #879)
6da1353541 Merge pull request 'Don't fetch old values in cross-partition transactional inserts' (#877) from withings/garage:perf/kv/insert-no-return-cross-partition into main
Compare 7 commits »