Abstract database behind generic interface and implement alternative drivers #322

Merged

lx merged 64 commits from db-abstraction into main 2022-06-08 08:01:56 +00:00

Conversation 0 Commits 64 Files changed 42 +3086 -641

64 commits

Author	SHA1	Message	Date
Alex Auvolat	e682478d75	Create meta directory in server (or else sqlite fails)	2022-06-07 19:11:11 +02:00
Alex Auvolat	1e4814568b	remove useless clippy allow	2022-06-07 18:48:32 +02:00
Alex Auvolat	0c0a02ad03	Remove useless function	2022-06-07 18:36:13 +02:00
Alex Auvolat	48928d2d70	Simplify sqlite	2022-06-07 18:26:28 +02:00
Alex Auvolat	cc4f1aca97	sqlite can actually tell us its version	2022-06-07 18:22:27 +02:00
Alex Auvolat	845c344231	Inform user of what DB engine Garage is running on	2022-06-07 18:20:51 +02:00
Alex Auvolat	d41a67c4ee	simplify & fix db tests	2022-06-07 18:06:30 +02:00
Alex Auvolat	daec7995c3	cargo fmt	2022-06-07 17:56:29 +02:00
Alex Auvolat	c103ca8bf2	Correct error type for (unimplemented) iterators in transactions	2022-06-07 17:56:11 +02:00
Alex Auvolat	0543cb3453	Cleaner error management (less error-prone api)	2022-06-07 17:50:10 +02:00
Alex Auvolat	1bbe0794f3	less pub(crate)	2022-06-07 17:23:17 +02:00
Alex Auvolat	6f3d43b75b	prettier code	2022-06-07 17:21:01 +02:00
Alex Auvolat	8c6f690fa5	less verbose code	2022-06-07 17:14:16 +02:00
Alex Auvolat	cdc03da0b8	make things more like before	2022-06-07 17:11:55 +02:00
Alex Auvolat	1d408d52b9	Simplify	2022-06-07 17:10:22 +02:00
Alex Auvolat	a3a01141ec	db abstraction: make .insert() and .remove() return the old value	2022-06-07 17:05:17 +02:00
Alex Auvolat	a9e79f848b	Bring back the counted tree hack for Sled (with caveat) ... caveat: it's not only for sled	2022-06-07 16:52:57 +02:00
Alex Auvolat	5dbc79b77e	Try once again to fix sqlite bundling in nix	2022-06-06 23:00:10 +02:00
Alex Auvolat	3de9320a0e	bundled sqlite	2022-06-06 22:35:46 +02:00
Alex Auvolat	35544cac39	Add nix overrides to include lmdb and sqlite3 libraries	2022-06-06 22:02:09 +02:00
Alex Auvolat	e42c7bed38	Remove useless clones in sqlite	2022-06-06 17:06:22 +02:00
Alex Auvolat	1f9a371b9a	Fix clippy lint	2022-06-06 17:01:49 +02:00
Alex Auvolat	72a87c8686	Add inline marker on a bunch of db functions	2022-06-06 16:51:00 +02:00
Alex Auvolat	fd2fe18de3	in db convert: map size up to 1TB on 64-bit systems	2022-06-06 16:44:47 +02:00
Alex Auvolat	c3c8d59c99	Fix more .unwrap()'s	2022-06-06 16:37:44 +02:00
Alex Auvolat	bbf68aa039	fix	2022-06-06 16:32:06 +02:00
Alex Auvolat	72e6419b1b	add comment	2022-06-06 16:31:43 +02:00
Alex Auvolat	1dabd98330	Improve things in block manager & correctly propagate .len() errors	2022-06-06 16:29:02 +02:00
Alex Auvolat	9238fda9b2	Update Cargo.nix	2022-06-06 16:13:13 +02:00
Alex Auvolat	1897815358	Table updated trigger now happens in transaction, this is waaaay better!	2022-06-06 15:46:00 +02:00
Alex Auvolat	c56d858834	Fix clippy	2022-06-06 15:10:33 +02:00
Alex Auvolat	a65049db8f	Simplify lmdb adapter (one less indirection)	2022-06-06 15:07:37 +02:00
Alex Auvolat	17918e2ef5	Whoops	2022-06-06 14:09:17 +02:00
Alex Auvolat	0ab21e780e	Small syntax changes	2022-06-06 14:08:19 +02:00
Alex Auvolat	a77efd7ca6	Safe choice: revert "Update rmp-serde" ... This reverts commit 16e0a655d0.	2022-06-06 14:02:02 +02:00
Alex Auvolat	7f2cf0b809	Safe choice: return Vec<u8> and not some fancy zero-copy type	2022-06-06 14:01:44 +02:00
Alex Auvolat	4539a6c229	Fix more sqlite deadlocks	2022-06-06 12:02:42 +02:00
Alex Auvolat	4f5d17d464	fixes	2022-06-06 11:30:10 +02:00
Alex Auvolat	2d5541b0e7	Integrate LMDB with rest	2022-06-03 16:40:38 +02:00
Alex Auvolat	f7a1c70089	Implement iterator for LMDB	2022-06-03 16:18:56 +02:00
Alex Auvolat	bd2997a453	LMDB: use Heed wrapper (much more complete)	2022-06-03 15:53:20 +02:00
Alex Auvolat	4e72c713f1	Start LMDB adapter, with fixed semantics	2022-06-03 15:31:07 +02:00
Alex Auvolat	16e0a655d0	Update rmp-serde	2022-06-03 14:16:30 +02:00
Alex Auvolat	d3d7df098b	small fixes	2022-06-03 14:00:13 +02:00
Alex Auvolat	3d18c9e183	whoops	2022-06-03 13:35:02 +02:00
Alex Auvolat	9bb58638f0	Fix block repair to not deadlock with sqlite	2022-06-03 12:56:35 +02:00
Alex Auvolat	295bc2741f	fix clipy lint	2022-06-03 12:52:41 +02:00
Alex Auvolat	4bf706b170	Slightly prettier code	2022-06-03 12:35:12 +02:00
Alex Auvolat	bd9ff432d7	Garage works on sqlite, but it's a hack	2022-06-03 12:12:25 +02:00
Alex Auvolat	df0877bbba	Conversion utility	2022-06-03 11:44:41 +02:00
Alex Auvolat	cc0d984118	Fix most clippy lints	2022-06-03 11:14:24 +02:00
Alex Auvolat	f25309e58f	Change value type to be a dyn thing	2022-06-03 10:44:54 +02:00
Alex Auvolat	7b79906350	Drop later	2022-06-03 04:44:40 +02:00
Alex Auvolat	6ebb54cddb	Just refactor a bit	2022-06-02 23:46:28 +02:00
Alex Auvolat	0e4f336887	Horrible implementation of range for sqlite	2022-06-02 23:43:32 +02:00
Alex Auvolat	c439cb11a9	Sqlite iter with unsafe code	2022-06-02 23:14:10 +02:00
Alex Auvolat	364061453c	Add back Send	2022-06-02 22:05:57 +02:00
Alex Auvolat	43704afb29	Begin sqlite adapter	2022-06-02 19:58:47 +02:00
Alex Auvolat	f29b91232f	Use Cell instead of ArcSwap	2022-06-02 18:11:32 +02:00
Alex Auvolat	fbd5b64ff3	Complete sled abstraction	2022-06-02 17:38:30 +02:00
Alex Auvolat	6805e184e9	Do not put sled in garage's cargo.toml	2022-06-02 17:01:04 +02:00
Alex Auvolat	9f0f5b2e37	Adapt Garage to use new DB abstraction	2022-06-02 16:58:00 +02:00
Alex Auvolat	04901093e7	Implement iter() and range() on db	2022-06-02 15:25:24 +02:00
Alex Auvolat	fd8d5c37f7	First iteration of a generic DB layer	2022-06-02 14:59:26 +02:00