94d723f27c
Merge pull request 'Implement `rpc_secret_file`' (#466) from felix.scheinost/garage:feature/implement-rpc-secret-file into main
be6b8f419d
Merge pull request 'Implemented system metrics' (#472) from jpds/garage:system-metrics into main
94d723f27c
Merge pull request 'Implement `rpc_secret_file`' (#466) from felix.scheinost/garage:feature/implement-rpc-secret-file into main
be6b8f419d
Merge pull request 'Implemented system metrics' (#472) from jpds/garage:system-metrics into main
This is generally fixed, I created the (probably also now fixed) follow-up issue: Deuxfleurs/garage#469
Ok, I just read your previous message and I guess you figured out the part with PutObject calls.
I will clean unfinished uploads then, confirm that all counters drop to zero and close this…
**Content warning: please, please do not attempt to access to cached file mentionned in the following message. It was posted publicly and is technically legal under french law, yet disturbing…
None of the objects listed in block info for missing blocks actually shows up in a call to ListObjects. Are the object version and key mentioned in block info stored in the blocks table…
The hypothesis currently being tested: maybe the core issue is not on garage side, but upstream in the chain.
What if when caching a media, Mastodon sometimes fails (the remote server fails, or…
A couple days later: the issue is definitely not fixed, missing blocks keep accumulating.
We are making some progress though. It first seemed that this was some case of write-hole, where the…
While writing this down, I started another instrumentation session in order to pinpoint the issue, failing syscall, or whatever. It seems that no new block has been missing for >24h, with no…