expose bucket usage metrics #420

New issue

Open

opened 2022-11-15 22:58:38 +00:00 by patrickjahns · 1 comment

patrickjahns commented

2022-11-15 22:58:38 +00:00

Contributor

It would be nice to expose per-bucket metrics displaying the current usage (and if a quota is set, the quota of the bucket).

This would allow administrators to have an overview and be able to also see if certain buckets (and their usages) goes astray.

Additionally exposing the usage of multipart uploads would also be useful to identify permanent stuck multipart uploads and act accordingly.

As per the discussion in the chat, with this feature we need to be aware, that the cardinality of the metrics can explode, when there are thousands of buckets create. So it would most likely make sense, to have this hidden behind some sort of "feature flag"

It would be nice to expose per-bucket metrics displaying the current usage (and if a quota is set, the quota of the bucket). This would allow administrators to have an overview and be able to also see if certain buckets (and their usages) goes astray. Additionally exposing the usage of multipart uploads would also be useful to identify permanent stuck multipart uploads and act accordingly. As per the discussion in the chat, with this feature we need to be aware, that the cardinality of the metrics can explode, when there are thousands of buckets create. So it would most likely make sense, to have this hidden behind some sort of "feature flag"

👍 3

lx added the

labels 2022-11-16 10:43:39 +00:00

codingJWilliams commented

2024-03-29 17:51:30 +00:00

Hi,

For anyone else who comes across this problem, I've written an exporter in Python to solve this problem, it can be found here: https://gitlab.com/codingJWilliams/garagehq-stats-exporter

I would have implemented it directly but I'm not familiar with Rust unfortunately, so had to use this as a workaround

Jay

Hi, For anyone else who comes across this problem, I've written an exporter in Python to solve this problem, it can be found here: https://gitlab.com/codingJWilliams/garagehq-stats-exporter I would have implemented it directly but I'm not familiar with Rust unfortunately, so had to use this as a workaround Jay

No milestone

No project

No assignees

2 participants

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Deuxfleurs/garage#420

No description provided.