Deuxfleurs
/
garage
41
37
Fork 55
Code Issues 70 Pull Requests 6 Releases 29 Wiki Activity

segfault on startup #772

New Issue
Closed
opened 2024-03-13 10:58:24 +00:00 by flokli · 0 comments
flokli commented 2024-03-13 10:58:24 +00:00
Contributor
Copy Link
Mar 13 10:55:02 n4-rk1 garage[1501]: ======== PANIC (internal Garage error) ========
Mar 13 10:55:02 n4-rk1 garage[1501]: panicked at /build/source/src/table/merkle.rs:98:43:
Mar 13 10:55:02 n4-rk1 garage[1501]: called `Option::unwrap()` on a `None` value
Mar 13 10:55:02 n4-rk1 garage[1501]: Panics are internal errors that Garage is unable to handle on its own.
Mar 13 10:55:02 n4-rk1 garage[1501]: They can be caused by bugs in Garage's code, or by corrupted data in
Mar 13 10:55:02 n4-rk1 garage[1501]: the node's storage. If you feel that this error is likely to be a bug
Mar 13 10:55:02 n4-rk1 garage[1501]: in Garage, please report it on our issue tracker a the following address:
Mar 13 10:55:02 n4-rk1 garage[1501]:         https://git.deuxfleurs.fr/Deuxfleurs/garage/issues
Mar 13 10:55:02 n4-rk1 garage[1501]: Please include the last log messages and the the full backtrace below in
Mar 13 10:55:02 n4-rk1 garage[1501]: your bug report, as well as any relevant information on the context in
Mar 13 10:55:02 n4-rk1 garage[1501]: which Garage was running when this error occurred.
Mar 13 10:55:02 n4-rk1 garage[1501]: GARAGE VERSION: cargo:0.9.3 [features: k2v, sled, lmdb, sqlite, consul-discovery, kubernetes-discovery, metrics, telemetry-otlp, bundled-libs]
Mar 13 10:55:02 n4-rk1 garage[1501]: BACKTRACE:
Mar 13 10:55:02 n4-rk1 garage[1501]:    0: garage::main::{{closure}}::{{closure}}
Mar 13 10:55:02 n4-rk1 garage[1501]:    1: std::panicking::rust_panic_with_hook
Mar 13 10:55:02 n4-rk1 garage[1501]:    2: std::panicking::begin_panic_handler::{{closure}}
Mar 13 10:55:02 n4-rk1 garage[1501]:    3: std::sys_common::backtrace::__rust_end_short_backtrace
Mar 13 10:55:02 n4-rk1 garage[1501]:    4: rust_begin_unwind
Mar 13 10:55:02 n4-rk1 garage[1501]:    5: core::panicking::panic_fmt
Mar 13 10:55:02 n4-rk1 garage[1501]:    6: core::panicking::panic
Mar 13 10:55:02 n4-rk1 garage[1501]:    7: tokio::runtime::task::raw::poll
Mar 13 10:55:02 n4-rk1 garage[1501]:    8: tokio::runtime::task::UnownedTask<S>::run
Mar 13 10:55:02 n4-rk1 garage[1501]:    9: std::sys_common::backtrace::__rust_begin_short_backtrace
Mar 13 10:55:02 n4-rk1 garage[1501]:   10: core::ops::function::FnOnce::call_once{{vtable.shim}}
Mar 13 10:55:02 n4-rk1 garage[1501]:   11: std::sys::unix::thread::Thread::new::thread_start
Mar 13 10:55:02 n4-rk1 garage[1501]:   12: start_thread
Mar 13 10:55:02 n4-rk1 garage[1501]:   13: thread_start

           PID: 1501 (garage)
           UID: 64665 (64665)
           GID: 64665 (64665)
        Signal: 6 (ABRT)
     Timestamp: Wed 2024-03-13 10:55:02 UTC (2min 49s ago)
  Command Line: /nix/store/mp6abphcaznbsgnxvjzjh2wyp6jw79di-garage-0.9.3/bin/garage server
    Executable: /nix/store/mp6abphcaznbsgnxvjzjh2wyp6jw79di-garage-0.9.3/bin/garage
 Control Group: /system.slice/garage.service
          Unit: garage.service
         Slice: system.slice
       Boot ID: 1dd4046c71bf48d4a1be3633c9174f9f
    Machine ID: f05c75354c1c4addb47b936a8cc37a55
      Hostname: n4-rk1
       Storage: /var/lib/systemd/coredump/core.garage.64665.1dd4046c71bf48d4a1be3633c9174f9f.1501.1710327302000000.zst (present)
  Size on Disk: 595.1K
       Message: Process 1501 (garage) of user 64665 dumped core.
                
                Module libgcc_s.so.1 without build-id.
                Module garage without build-id.
                Stack trace of thread 1511:
                #0  0x0000ffffbf4359c0 __pthread_kill_implementation (libc.so.6 + 0x859c0)
                #1  0x0000ffffbf3ef0ec raise (libc.so.6 + 0x3f0ec)
                #2  0x0000ffffbf3dadbc abort (libc.so.6 + 0x2adbc)
                #3  0x0000aaaae17cf764 _ZN3std3sys4unix14abort_internal17h8843a3630b0e3fcdE (garage + 0xbff764)
                #4  0x0000aaaae0d0904c _ZN3std7process5abort17h7179a24dcc66ad35E (garage + 0x13904c)
                #5  0x0000aaaae0e7f56c _ZN6garage4main28_$u7b$$u7b$closure$u7d$$u7d$28_$u7b$$u7b$closure$u7d$$u7d$17h317f025d938fe3ceE (garage + 0x2af56c)
                #6  0x0000aaaae17eee58 _ZN3std9panicking20rust_panic_with_hook17hc474b468a8118958E (garage + 0xc1ee58)
                #7  0x0000aaaae17eebb0 _ZN3std9panicking19begin_panic_handler28_$u7b$$u7b$closure$u7d$$u7d$17hf357bf09ed76c036E (garage + 0xc1ebb0)
                #8  0x0000aaaae17eeb44 _ZN3std10sys_common9backtrace26__rust_end_short_backtrace17h904e6ea50bec8caeE (garage + 0xc1eb44)
                #9  0x0000aaaae17eeb3c rust_begin_unwind (garage + 0xc1eb3c)
                #10 0x0000aaaae0cd55a4 _ZN4core9panicking9panic_fmt17h278e3cddb1b6e4acE (garage + 0x1055a4)
                #11 0x0000aaaae0cd56bc _ZN4core9panicking5panic17he25ada1114be0586E (garage + 0x1056bc)
                #12 0x0000aaaae13439f8 _ZN5tokio7runtime4task3raw4poll17h6de8d5f2b346a679E (garage + 0x7739f8)
                #13 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110)
                #14 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4)
                #15 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #16 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #17 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #18 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                
                Stack trace of thread 1503:
                #0  0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4)
                #1  0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438)
                #2  0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac)
                #3  0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c)
                #4  0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110)
                #5  0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4)
                #6  0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #7  0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #8  0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #9  0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                
                Stack trace of thread 1508:
                #0  0x0000aaaae142f408 _ZN10garage_rpc6layout56_$LT$impl$u20$garage_rpc..layout..v09..ClusterLayout$GT$19generate_flow_graph17h8863f3f771bce13cE (garage + 0x85f408)
                #1  0x0000aaaae142f0e8 _ZN10garage_rpc6layout56_$LT$impl$u20$garage_rpc..layout..v09..ClusterLayout$GT$30compute_optimal_partition_size17h0caba3e21614e170E (garage + 0x85f0e8)
                #2  0x0000aaaae1424fbc _ZN10garage_rpc6layout56_$LT$impl$u20$garage_rpc..layout..v09..ClusterLayout$GT$5check17hd7759d3916f61b0bE (garage + 0x854fbc)
                #3  0x0000aaaae0d847f4 _ZN10garage_rpc6system6System14discovery_loop28_$u7b$$u7b$closure$u7d$$u7d$17ha310f27a21f74a44E (garage + 0x1b47f4)
                #4  0x0000aaaae0d94734 _ZN10garage_rpc6system6System3run28_$u7b$$u7b$closure$u7d$$u7d$28_$u7b$$u7b$closure$u7d$$u7d$17hd5df97a291f95f63E (garage + 0x1c4734)
                #5  0x0000aaaae0d9168c _ZN10garage_rpc6system6System3run28_$u7b$$u7b$closure$u7d$$u7d$17hc0790f5f85cb1a89E (garage + 0x1c168c)
                #6  0x0000aaaae0e0cbd0 _ZN5tokio7runtime4task3raw4poll17he2b257ff20b81981E (garage + 0x23cbd0)
                #7  0x0000aaaae17ff73c _ZN5tokio7runtime9scheduler12multi_thread6worker7Context8run_task17h989bb896a3a0df1fE (garage + 0xc2f73c)
                #8  0x0000aaaae180bbb0 _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3bbb0)
                #9  0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110)
                #10 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4)
                #11 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #12 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #13 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #14 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                
                Stack trace of thread 1501:
                #0  0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4)
                #1  0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438)
                #2  0x0000aaaae1801aac _ZN5tokio7runtime4park5Inner4park17h43a514970bbcef16E (garage + 0xc31aac)
                #3  0x0000aaaae0e750b0 _ZN6garage4main17h8971edc797a14ce7E (garage + 0x2a50b0)
                #4  0x0000aaaae0dcc518 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17h5456ef2225e694b9E (garage + 0x1fc518)
                #5  0x0000aaaae0e7f994 main (garage + 0x2af994)
                #6  0x0000ffffbf3db480 __libc_start_call_main (libc.so.6 + 0x2b480)
                #7  0x0000ffffbf3db558 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b558)
                #8  0x0000aaaae0d0f1f0 _start (garage + 0x13f1f0)
                
                Stack trace of thread 1505:
                #0  0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4)
                #1  0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438)
                #2  0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac)
                #3  0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c)
                #4  0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110)
                #5  0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4)
                #6  0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #7  0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #8  0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #9  0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                
                Stack trace of thread 1504:
                #0  0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4)
                #1  0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438)
                #2  0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac)
                #3  0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c)
                #4  0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110)
                #5  0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4)
                #6  0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #7  0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #8  0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #9  0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                
                Stack trace of thread 1507:
                #0  0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4)
                #1  0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438)
                #2  0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac)
                #3  0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c)
                #4  0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110)
                #5  0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4)
                #6  0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #7  0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #8  0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #9  0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                
                Stack trace of thread 1506:
                #0  0x0000ffffbf49e224 epoll_pwait (libc.so.6 + 0xee224)
                #1  0x0000aaaae18013d0 _ZN5tokio7runtime2io6driver6Driver4turn17h415f0d5c055b83dbE (garage + 0xc313d0)
                #2  0x0000aaaae1802350 _ZN5tokio7runtime6driver7IoStack12park_timeout17ha040fad1286d1fd7E (garage + 0xc32350)
                #3  0x0000aaaae18010d0 _ZN5tokio7runtime4time6Driver13park_internal17ha7f25f7fbeebb0bfE (garage + 0xc310d0)
                #4  0x0000aaaae17fefd0 _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2efd0)
                #5  0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c)
                #6  0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110)
                #7  0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4)
                #8  0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #9  0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #10 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #11 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                
                Stack trace of thread 1512:
                #0  0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4)
                #1  0x0000aaaae15ed4c8 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d4c8)
                #2  0x0000aaaae17fcb64 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cb64)
                #3  0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #4  0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #5  0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #6  0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                
                Stack trace of thread 1509:
                #0  0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4)
                #1  0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438)
                #2  0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac)
                #3  0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c)
                #4  0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110)
                #5  0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4)
                #6  0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #7  0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #8  0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #9  0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                
                Stack trace of thread 1510:
                #0  0x0000aaaae19db35c mdb_page_search_root (garage + 0xe0b35c)
                #1  0x0000aaaae19db9c4 mdb_cursor_first (garage + 0xe0b9c4)
                #2  0x0000aaaae19d97e0 mdb_cursor_get (garage + 0xe097e0)
                #3  0x0000aaaae19d9a90 mdb_page_alloc.isra.0 (garage + 0xe09a90)
                #4  0x0000aaaae19d9c90 mdb_page_new (garage + 0xe09c90)
                #5  0x0000aaaae19ddd84 mdb_cursor_put (garage + 0xe0dd84)
                #6  0x0000aaaae19e0218 mdb_put (garage + 0xe10218)
                #7  0x0000aaaae10c4e98 _ZN4heed8database23Database$LT$KC$C$DC$GT$3put17h5d6b09898eef8e99E (garage + 0x4f4e98)
                #8  0x0000aaaae10c9884 _ZN66_$LT$garage_db..lmdb_adapter..LmdbTx$u20$as$u20$garage_db..ITx$GT$6insert17h09c3ff92c98aacc7E (garage + 0x4f9884)
                #9  0x0000aaaae11e2848 _ZN69_$LT$garage_db..TxFn$LT$F$C$R$C$E$GT$$u20$as$u20$garage_db..ITxFn$GT$6try_on17h24196e5f973b5120E (garage + 0x612848)
                #10 0x0000aaaae10c9348 _ZN66_$LT$garage_db..lmdb_adapter..LmdbDb$u20$as$u20$garage_db..IDb$GT$11transaction17h18bddf63c076f478E (garage + 0x4f9348)
                #11 0x0000aaaae11e1b80 _ZN12garage_table4data22TableData$LT$F$C$R$GT$12update_entry17h9c6567a259df05ccE (garage + 0x611b80)
                #12 0x0000aaaae11e1a10 _ZN12garage_table4data22TableData$LT$F$C$R$GT$11update_many17haf1639b95a2556beE (garage + 0x611a10)
                #13 0x0000aaaae1337d38 _ZN143_$LT$garage_table..table..Table$LT$F$C$R$GT$$u20$as$u20$garage_net..endpoint..EndpointHandler$LT$garage_table..table..TableRpc$LT$F$GT$$GT$$GT$6handle28_$u7b$$u7b$closure$u7d$$u7d$17h2aff0fbf58710727E (garage + 0x767d38)
                #14 0x0000aaaae1337b84 _ZN77_$LT$T$u20$as$u20$garage_net..endpoint..StreamingEndpointHandler$LT$M$GT$$GT$6handle28_$u7b$$u7b$closure$u7d$$u7d$17h75ef7e45c965870bE (garage + 0x767b84)
                #15 0x0000aaaae1379e5c _ZN58_$LT$T$u20$as$u20$garage_util..metrics..RecordDuration$GT$15record_duration28_$u7b$$u7b$closure$u7d$$u7d$17h160ce2a34e32e834E (garage + 0x7a9e5c)
                #16 0x0000aaaae1378e2c _ZN58_$LT$T$u20$as$u20$garage_util..metrics..RecordDuration$GT$21bound_record_duration28_$u7b$$u7b$closure$u7d$$u7d$17h3218d8e1c77e1b92E (garage + 0x7a8e2c)
                #17 0x0000aaaae0efe0d0 _ZN100_$LT$opentelemetry..trace..context..WithContext$LT$T$GT$$u20$as$u20$core..future..future..Future$GT$4poll17h09efdbba0c468e1eE (garage + 0x32e0d0)
                #18 0x0000aaaae1377894 _ZN111_$LT$garage_table..queue..InsertQueueWorker$LT$F$C$R$GT$$u20$as$u20$garage_util..background..worker..Worker$GT$4work28_$u7b$$u7b$closure$u7d$$u7d$17h752dee60bf320a2fE (garage + 0x7a7894)
                #19 0x0000aaaae147ad18 _ZN11garage_util10background6worker13WorkerHandler4step28_$u7b$$u7b$closure$u7d$$u7d$17h63700f5ca8b405c5E (garage + 0x8aad18)
                #20 0x0000aaaae147ab5c _ZN11garage_util10background6worker15WorkerProcessor3run28_$u7b$$u7b$closure$u7d$$u7d$28_$u7b$$u7b$closure$u7d$$u7d$17hb5a1730f318a57dfE (garage + 0x8aab5c)
                #21 0x0000aaaae147a570 _ZN117_$LT$futures_util..stream..futures_unordered..FuturesUnordered$LT$Fut$GT$$u20$as$u20$futures_core..stream..Stream$GT$9poll_next17h715299ceb69181d2E (garage + 0x8aa570)
                #22 0x0000aaaae147e230 _ZN11garage_util10background16BackgroundRunner3new28_$u7b$$u7b$closure$u7d$$u7d$17h8ad289d32f545e69E (garage + 0x8ae230)
                #23 0x0000aaaae1495d4c _ZN5tokio7runtime4task3raw4poll17h190f646a2010b3dcE (garage + 0x8c5d4c)
                #24 0x0000aaaae17ff73c _ZN5tokio7runtime9scheduler12multi_thread6worker7Context8run_task17h989bb896a3a0df1fE (garage + 0xc2f73c)
                #25 0x0000aaaae180bbb0 _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3bbb0)
                #26 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110)
                #27 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4)
                #28 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14)
                #29 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788)
                #30 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4)
                #31 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c)
                ELF object binary architecture: AARCH64
``` Mar 13 10:55:02 n4-rk1 garage[1501]: ======== PANIC (internal Garage error) ======== Mar 13 10:55:02 n4-rk1 garage[1501]: panicked at /build/source/src/table/merkle.rs:98:43: Mar 13 10:55:02 n4-rk1 garage[1501]: called `Option::unwrap()` on a `None` value Mar 13 10:55:02 n4-rk1 garage[1501]: Panics are internal errors that Garage is unable to handle on its own. Mar 13 10:55:02 n4-rk1 garage[1501]: They can be caused by bugs in Garage's code, or by corrupted data in Mar 13 10:55:02 n4-rk1 garage[1501]: the node's storage. If you feel that this error is likely to be a bug Mar 13 10:55:02 n4-rk1 garage[1501]: in Garage, please report it on our issue tracker a the following address: Mar 13 10:55:02 n4-rk1 garage[1501]: https://git.deuxfleurs.fr/Deuxfleurs/garage/issues Mar 13 10:55:02 n4-rk1 garage[1501]: Please include the last log messages and the the full backtrace below in Mar 13 10:55:02 n4-rk1 garage[1501]: your bug report, as well as any relevant information on the context in Mar 13 10:55:02 n4-rk1 garage[1501]: which Garage was running when this error occurred. Mar 13 10:55:02 n4-rk1 garage[1501]: GARAGE VERSION: cargo:0.9.3 [features: k2v, sled, lmdb, sqlite, consul-discovery, kubernetes-discovery, metrics, telemetry-otlp, bundled-libs] Mar 13 10:55:02 n4-rk1 garage[1501]: BACKTRACE: Mar 13 10:55:02 n4-rk1 garage[1501]: 0: garage::main::{{closure}}::{{closure}} Mar 13 10:55:02 n4-rk1 garage[1501]: 1: std::panicking::rust_panic_with_hook Mar 13 10:55:02 n4-rk1 garage[1501]: 2: std::panicking::begin_panic_handler::{{closure}} Mar 13 10:55:02 n4-rk1 garage[1501]: 3: std::sys_common::backtrace::__rust_end_short_backtrace Mar 13 10:55:02 n4-rk1 garage[1501]: 4: rust_begin_unwind Mar 13 10:55:02 n4-rk1 garage[1501]: 5: core::panicking::panic_fmt Mar 13 10:55:02 n4-rk1 garage[1501]: 6: core::panicking::panic Mar 13 10:55:02 n4-rk1 garage[1501]: 7: tokio::runtime::task::raw::poll Mar 13 10:55:02 n4-rk1 garage[1501]: 8: tokio::runtime::task::UnownedTask<S>::run Mar 13 10:55:02 n4-rk1 garage[1501]: 9: std::sys_common::backtrace::__rust_begin_short_backtrace Mar 13 10:55:02 n4-rk1 garage[1501]: 10: core::ops::function::FnOnce::call_once{{vtable.shim}} Mar 13 10:55:02 n4-rk1 garage[1501]: 11: std::sys::unix::thread::Thread::new::thread_start Mar 13 10:55:02 n4-rk1 garage[1501]: 12: start_thread Mar 13 10:55:02 n4-rk1 garage[1501]: 13: thread_start ``` ``` PID: 1501 (garage) UID: 64665 (64665) GID: 64665 (64665) Signal: 6 (ABRT) Timestamp: Wed 2024-03-13 10:55:02 UTC (2min 49s ago) Command Line: /nix/store/mp6abphcaznbsgnxvjzjh2wyp6jw79di-garage-0.9.3/bin/garage server Executable: /nix/store/mp6abphcaznbsgnxvjzjh2wyp6jw79di-garage-0.9.3/bin/garage Control Group: /system.slice/garage.service Unit: garage.service Slice: system.slice Boot ID: 1dd4046c71bf48d4a1be3633c9174f9f Machine ID: f05c75354c1c4addb47b936a8cc37a55 Hostname: n4-rk1 Storage: /var/lib/systemd/coredump/core.garage.64665.1dd4046c71bf48d4a1be3633c9174f9f.1501.1710327302000000.zst (present) Size on Disk: 595.1K Message: Process 1501 (garage) of user 64665 dumped core. Module libgcc_s.so.1 without build-id. Module garage without build-id. Stack trace of thread 1511: #0 0x0000ffffbf4359c0 __pthread_kill_implementation (libc.so.6 + 0x859c0) #1 0x0000ffffbf3ef0ec raise (libc.so.6 + 0x3f0ec) #2 0x0000ffffbf3dadbc abort (libc.so.6 + 0x2adbc) #3 0x0000aaaae17cf764 _ZN3std3sys4unix14abort_internal17h8843a3630b0e3fcdE (garage + 0xbff764) #4 0x0000aaaae0d0904c _ZN3std7process5abort17h7179a24dcc66ad35E (garage + 0x13904c) #5 0x0000aaaae0e7f56c _ZN6garage4main28_$u7b$$u7b$closure$u7d$$u7d$28_$u7b$$u7b$closure$u7d$$u7d$17h317f025d938fe3ceE (garage + 0x2af56c) #6 0x0000aaaae17eee58 _ZN3std9panicking20rust_panic_with_hook17hc474b468a8118958E (garage + 0xc1ee58) #7 0x0000aaaae17eebb0 _ZN3std9panicking19begin_panic_handler28_$u7b$$u7b$closure$u7d$$u7d$17hf357bf09ed76c036E (garage + 0xc1ebb0) #8 0x0000aaaae17eeb44 _ZN3std10sys_common9backtrace26__rust_end_short_backtrace17h904e6ea50bec8caeE (garage + 0xc1eb44) #9 0x0000aaaae17eeb3c rust_begin_unwind (garage + 0xc1eb3c) #10 0x0000aaaae0cd55a4 _ZN4core9panicking9panic_fmt17h278e3cddb1b6e4acE (garage + 0x1055a4) #11 0x0000aaaae0cd56bc _ZN4core9panicking5panic17he25ada1114be0586E (garage + 0x1056bc) #12 0x0000aaaae13439f8 _ZN5tokio7runtime4task3raw4poll17h6de8d5f2b346a679E (garage + 0x7739f8) #13 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110) #14 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4) #15 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #16 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #17 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #18 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) Stack trace of thread 1503: #0 0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4) #1 0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438) #2 0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac) #3 0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c) #4 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110) #5 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4) #6 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #7 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #8 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #9 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) Stack trace of thread 1508: #0 0x0000aaaae142f408 _ZN10garage_rpc6layout56_$LT$impl$u20$garage_rpc..layout..v09..ClusterLayout$GT$19generate_flow_graph17h8863f3f771bce13cE (garage + 0x85f408) #1 0x0000aaaae142f0e8 _ZN10garage_rpc6layout56_$LT$impl$u20$garage_rpc..layout..v09..ClusterLayout$GT$30compute_optimal_partition_size17h0caba3e21614e170E (garage + 0x85f0e8) #2 0x0000aaaae1424fbc _ZN10garage_rpc6layout56_$LT$impl$u20$garage_rpc..layout..v09..ClusterLayout$GT$5check17hd7759d3916f61b0bE (garage + 0x854fbc) #3 0x0000aaaae0d847f4 _ZN10garage_rpc6system6System14discovery_loop28_$u7b$$u7b$closure$u7d$$u7d$17ha310f27a21f74a44E (garage + 0x1b47f4) #4 0x0000aaaae0d94734 _ZN10garage_rpc6system6System3run28_$u7b$$u7b$closure$u7d$$u7d$28_$u7b$$u7b$closure$u7d$$u7d$17hd5df97a291f95f63E (garage + 0x1c4734) #5 0x0000aaaae0d9168c _ZN10garage_rpc6system6System3run28_$u7b$$u7b$closure$u7d$$u7d$17hc0790f5f85cb1a89E (garage + 0x1c168c) #6 0x0000aaaae0e0cbd0 _ZN5tokio7runtime4task3raw4poll17he2b257ff20b81981E (garage + 0x23cbd0) #7 0x0000aaaae17ff73c _ZN5tokio7runtime9scheduler12multi_thread6worker7Context8run_task17h989bb896a3a0df1fE (garage + 0xc2f73c) #8 0x0000aaaae180bbb0 _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3bbb0) #9 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110) #10 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4) #11 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #12 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #13 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #14 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) Stack trace of thread 1501: #0 0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4) #1 0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438) #2 0x0000aaaae1801aac _ZN5tokio7runtime4park5Inner4park17h43a514970bbcef16E (garage + 0xc31aac) #3 0x0000aaaae0e750b0 _ZN6garage4main17h8971edc797a14ce7E (garage + 0x2a50b0) #4 0x0000aaaae0dcc518 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17h5456ef2225e694b9E (garage + 0x1fc518) #5 0x0000aaaae0e7f994 main (garage + 0x2af994) #6 0x0000ffffbf3db480 __libc_start_call_main (libc.so.6 + 0x2b480) #7 0x0000ffffbf3db558 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b558) #8 0x0000aaaae0d0f1f0 _start (garage + 0x13f1f0) Stack trace of thread 1505: #0 0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4) #1 0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438) #2 0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac) #3 0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c) #4 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110) #5 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4) #6 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #7 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #8 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #9 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) Stack trace of thread 1504: #0 0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4) #1 0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438) #2 0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac) #3 0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c) #4 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110) #5 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4) #6 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #7 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #8 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #9 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) Stack trace of thread 1507: #0 0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4) #1 0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438) #2 0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac) #3 0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c) #4 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110) #5 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4) #6 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #7 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #8 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #9 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) Stack trace of thread 1506: #0 0x0000ffffbf49e224 epoll_pwait (libc.so.6 + 0xee224) #1 0x0000aaaae18013d0 _ZN5tokio7runtime2io6driver6Driver4turn17h415f0d5c055b83dbE (garage + 0xc313d0) #2 0x0000aaaae1802350 _ZN5tokio7runtime6driver7IoStack12park_timeout17ha040fad1286d1fd7E (garage + 0xc32350) #3 0x0000aaaae18010d0 _ZN5tokio7runtime4time6Driver13park_internal17ha7f25f7fbeebb0bfE (garage + 0xc310d0) #4 0x0000aaaae17fefd0 _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2efd0) #5 0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c) #6 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110) #7 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4) #8 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #9 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #10 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #11 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) Stack trace of thread 1512: #0 0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4) #1 0x0000aaaae15ed4c8 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d4c8) #2 0x0000aaaae17fcb64 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cb64) #3 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #4 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #5 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #6 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) Stack trace of thread 1509: #0 0x0000ffffbf49bce4 syscall (libc.so.6 + 0xebce4) #1 0x0000aaaae15ed438 _ZN11parking_lot7condvar7Condvar19wait_until_internal17h4b7262ba33f0aa59E (garage + 0xa1d438) #2 0x0000aaaae17ff0ac _ZN5tokio7runtime9scheduler12multi_thread6worker7Context12park_timeout17ha1541cea80099bcbE (garage + 0xc2f0ac) #3 0x0000aaaae180c06c _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3c06c) #4 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110) #5 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4) #6 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #7 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #8 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #9 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) Stack trace of thread 1510: #0 0x0000aaaae19db35c mdb_page_search_root (garage + 0xe0b35c) #1 0x0000aaaae19db9c4 mdb_cursor_first (garage + 0xe0b9c4) #2 0x0000aaaae19d97e0 mdb_cursor_get (garage + 0xe097e0) #3 0x0000aaaae19d9a90 mdb_page_alloc.isra.0 (garage + 0xe09a90) #4 0x0000aaaae19d9c90 mdb_page_new (garage + 0xe09c90) #5 0x0000aaaae19ddd84 mdb_cursor_put (garage + 0xe0dd84) #6 0x0000aaaae19e0218 mdb_put (garage + 0xe10218) #7 0x0000aaaae10c4e98 _ZN4heed8database23Database$LT$KC$C$DC$GT$3put17h5d6b09898eef8e99E (garage + 0x4f4e98) #8 0x0000aaaae10c9884 _ZN66_$LT$garage_db..lmdb_adapter..LmdbTx$u20$as$u20$garage_db..ITx$GT$6insert17h09c3ff92c98aacc7E (garage + 0x4f9884) #9 0x0000aaaae11e2848 _ZN69_$LT$garage_db..TxFn$LT$F$C$R$C$E$GT$$u20$as$u20$garage_db..ITxFn$GT$6try_on17h24196e5f973b5120E (garage + 0x612848) #10 0x0000aaaae10c9348 _ZN66_$LT$garage_db..lmdb_adapter..LmdbDb$u20$as$u20$garage_db..IDb$GT$11transaction17h18bddf63c076f478E (garage + 0x4f9348) #11 0x0000aaaae11e1b80 _ZN12garage_table4data22TableData$LT$F$C$R$GT$12update_entry17h9c6567a259df05ccE (garage + 0x611b80) #12 0x0000aaaae11e1a10 _ZN12garage_table4data22TableData$LT$F$C$R$GT$11update_many17haf1639b95a2556beE (garage + 0x611a10) #13 0x0000aaaae1337d38 _ZN143_$LT$garage_table..table..Table$LT$F$C$R$GT$$u20$as$u20$garage_net..endpoint..EndpointHandler$LT$garage_table..table..TableRpc$LT$F$GT$$GT$$GT$6handle28_$u7b$$u7b$closure$u7d$$u7d$17h2aff0fbf58710727E (garage + 0x767d38) #14 0x0000aaaae1337b84 _ZN77_$LT$T$u20$as$u20$garage_net..endpoint..StreamingEndpointHandler$LT$M$GT$$GT$6handle28_$u7b$$u7b$closure$u7d$$u7d$17h75ef7e45c965870bE (garage + 0x767b84) #15 0x0000aaaae1379e5c _ZN58_$LT$T$u20$as$u20$garage_util..metrics..RecordDuration$GT$15record_duration28_$u7b$$u7b$closure$u7d$$u7d$17h160ce2a34e32e834E (garage + 0x7a9e5c) #16 0x0000aaaae1378e2c _ZN58_$LT$T$u20$as$u20$garage_util..metrics..RecordDuration$GT$21bound_record_duration28_$u7b$$u7b$closure$u7d$$u7d$17h3218d8e1c77e1b92E (garage + 0x7a8e2c) #17 0x0000aaaae0efe0d0 _ZN100_$LT$opentelemetry..trace..context..WithContext$LT$T$GT$$u20$as$u20$core..future..future..Future$GT$4poll17h09efdbba0c468e1eE (garage + 0x32e0d0) #18 0x0000aaaae1377894 _ZN111_$LT$garage_table..queue..InsertQueueWorker$LT$F$C$R$GT$$u20$as$u20$garage_util..background..worker..Worker$GT$4work28_$u7b$$u7b$closure$u7d$$u7d$17h752dee60bf320a2fE (garage + 0x7a7894) #19 0x0000aaaae147ad18 _ZN11garage_util10background6worker13WorkerHandler4step28_$u7b$$u7b$closure$u7d$$u7d$17h63700f5ca8b405c5E (garage + 0x8aad18) #20 0x0000aaaae147ab5c _ZN11garage_util10background6worker15WorkerProcessor3run28_$u7b$$u7b$closure$u7d$$u7d$28_$u7b$$u7b$closure$u7d$$u7d$17hb5a1730f318a57dfE (garage + 0x8aab5c) #21 0x0000aaaae147a570 _ZN117_$LT$futures_util..stream..futures_unordered..FuturesUnordered$LT$Fut$GT$$u20$as$u20$futures_core..stream..Stream$GT$9poll_next17h715299ceb69181d2E (garage + 0x8aa570) #22 0x0000aaaae147e230 _ZN11garage_util10background16BackgroundRunner3new28_$u7b$$u7b$closure$u7d$$u7d$17h8ad289d32f545e69E (garage + 0x8ae230) #23 0x0000aaaae1495d4c _ZN5tokio7runtime4task3raw4poll17h190f646a2010b3dcE (garage + 0x8c5d4c) #24 0x0000aaaae17ff73c _ZN5tokio7runtime9scheduler12multi_thread6worker7Context8run_task17h989bb896a3a0df1fE (garage + 0xc2f73c) #25 0x0000aaaae180bbb0 _ZN5tokio7runtime4task3raw4poll17h57aadcddf4c408e2E (garage + 0xc3bbb0) #26 0x0000aaaae17fd110 _ZN5tokio7runtime4task20UnownedTask$LT$S$GT$3run17hbab549dad9f5fd0dE (garage + 0xc2d110) #27 0x0000aaaae17fcbc4 _ZN3std10sys_common9backtrace28__rust_begin_short_backtrace17hada73053d2be71d0E (garage + 0xc2cbc4) #28 0x0000aaaae1802c14 _ZN4core3ops8function6FnOnce40call_once$u7b$$u7b$vtable.shim$u7d$$u7d$17h74588b1a47019e36E (garage + 0xc32c14) #29 0x0000aaaae17d0788 _ZN3std3sys4unix6thread6Thread3new12thread_start17hc1da649d184276bcE (garage + 0xc00788) #30 0x0000ffffbf433df4 start_thread (libc.so.6 + 0x83df4) #31 0x0000ffffbf49df0c thread_start (libc.so.6 + 0xedf0c) ELF object binary architecture: AARCH64 ```
lx closed this issue 2024-03-18 19:14:59 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
main
main-0.9.x
db-no-unsafe
main-0.8.x
k2v/shared_http_client
feat/website-redir
smithy2
test/compilation
poc/nomad-ci
test-ci-wait
pnet_datalink-0.33.0
optimal-layout
k2v-watch-range
db-debug-log
build-convert-db
demonstrate-cargo2nix-bug
dangerous/no-fsync
dev0.7.3
doc/benchmarks
bug/check_static
bucket-cors-more
storage-optimizations
old-main
v1.0.0
v0.9.4
v1.0.0-rc1
v0.8.7
v0.9.3
v0.9.2
v0.8.6
v0.9.2-rc1
v0.9.1
v0.8.5
v0.10.0-beta1
v0.9.0
v0.9.0-rc2
v0.9.0-rc1
v0.9.0-beta4
v0.9.0-beta3
v0.9.0-beta2
v0.8.4
v0.9.0-beta1
v0.8.3
v0.8.3-rc1
format_table-v0.1.1
format_table-v0.1.0
v0.8.2
v0.8.1
v0.8.0
v0.8.0-rc2
v0.8.0-rc1
v0.8.0-dangerous-no-fsync
v0.8.0-beta2-k2v
v0.8.0-beta2
v0.8.0-beta1-k2v
v0.8.0-beta1
v0.7.99.3-k2v
v0.7.3
v0.7.3-beta2
v0.7.3-beta1
v0.7.2.1
v0.7.2
v0.7.2_ci-test-2
v0.7.2+ci-test-version
v0.7.99.2-k2v
v0.7.99.1-k2v
v0.7.99-k2v
v0.7.2-k2v
v0.7.1-admin-k2v-2
v0.7.1-admin-k2v
v0.7.1-k2v
v0.7.1
v0.7.0
v0.7.0-rc1
v0.6.1
v0.6.0
v0.6.0-rc1
v0.5.1
v0.5.0.1
v0.5.0
v0.5-beta1
v0.4.0
v0.4-rc2
v0.4-rc1
0.4-beta
0.4-alpha
v0.3.0.2
v0.3.0.1
v0.3.0
v0.2.1.5
v0.2.1
v0.2.0
0.1.1b
0.1.1
0.1.0b
0.1.0
Labels
Clear labels   
AdminAPI

Issues concerning the administration API

  
Bug

   
Check AWS

The behaviour should be checked against AWS S3

  
CI

Issues with Nix, Drone, Rust Compiler, etc.

  
Correctness

Issues of theoretical correctness that may impact edge-case scenarios

  
Critical

   
Documentation

   
Ideas

For abstract ideas/proposal to make Garage better, to better communicate our not yet achieved aims

  
Improvement

   
Low priority

For issues that we don't want to spend time on until made absolutely necessary

  
Newcomer

A bug that should be newcomer friendly.

  
Performance

   
S3 Compatibility

   
Testing

   
Usability

Propositions to make Garage easier to operate, by improving error reporting, CLI, etc.

No Label
AdminAPI
Bug
Check AWS
CI
Correctness
Critical
Documentation
Ideas
Improvement
Low priority
Newcomer
Performance
S3 Compatibility
Testing
Usability
Milestone
Clear milestone
No items
No Milestone
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: Deuxfleurs/garage#772
No description provided.
Delete Branch "%!s(<nil>)"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?