Deuxfleurs/garage

Fork 82

Can Garage work with NFS-backed storage? #986

New issue

Open

opened 2025-03-14 19:16:49 +00:00 by kimse · 5 comments

kimse commented

2025-03-14 19:16:49 +00:00

I’m interested in deploying Garage with an NFS-backed storage setup. I’d like to know if Garage supports running on top of NFS-mounted directories or if there are any known issues or limitations with this configuration.

maximilien commented

2025-03-18 01:40:17 +00:00

Owner

Fundamentally it should be possible, as garage doesn't really do anything fancy with the underlying file system. At least for the data folder. For the metadata, things could be more tricky depending on the backend used. In any cases this would likely not be something we would spend time supporting. What's your use-case?

maximilien added the

labels 2025-03-18 01:40:45 +00:00

kimse commented

2025-03-18 08:31:48 +00:00

Author

We have a few use cases and challenges, both technical and organizational.

Our IT department already operates a NAS storage system, which we aim to leverage.
We need to bridge the gap between traditional NAS-based storage and modern data engineering tools, which increasingly expect S3 compatibility.
Build a self-service portal for end users to manage storage and storage accounts.
Legacy filesystem protocols like NFS and SMB do not perform well over the internet or VPN, making remote access challenging.

We have a few use cases and challenges, both technical and organizational. - Our IT department already operates a NAS storage system, which we aim to leverage. - We need to bridge the gap between traditional NAS-based storage and modern data engineering tools, which increasingly expect S3 compatibility. - Build a self-service portal for end users to manage storage and storage accounts. - Legacy filesystem protocols like NFS and SMB do not perform well over the internet or VPN, making remote access challenging.

maximilien commented

2025-03-18 08:36:31 +00:00

Owner

As a storage backend, what prevents you from hosting garage on the NAS itself or though something like iSCSI?

kimse commented

2025-03-18 08:58:52 +00:00

Author

The main challenges preventing us from hosting Garage directly on the NAS or using iSCSI are:

As far as I know, it's not possible to install additional software on the storage system. Even if it were, the IT department wouldn’t allow it (I’m not part of the IT team, so I have no control over this).
The existing NAS only supports NFS and SMB, not iSCSI or other block-level storage options.
Currently, every storage request must go through the IT department, and they only provide manually provisioned SMB or NFS storage, with no self-service option available.

My goal is to:

Build a self-service storage portal using Garage’s API.
Bridge the gap between legacy storage and modern data tools, which increasingly expect S3.
Reduce reliance on IT's manual workflows and streamline storage provisioning.

The main challenges preventing us from hosting Garage directly on the NAS or using iSCSI are: - As far as I know, it's not possible to install additional software on the storage system. Even if it were, the IT department wouldn’t allow it (I’m not part of the IT team, so I have no control over this). - The existing NAS only supports NFS and SMB, not iSCSI or other block-level storage options. - Currently, every storage request must go through the IT department, and they only provide manually provisioned SMB or NFS storage, with no self-service option available. My goal is to: 1. Build a self-service storage portal using Garage’s API. 2. Bridge the gap between legacy storage and modern data tools, which increasingly expect S3. 3. Reduce reliance on IT's manual workflows and streamline storage provisioning.

Poppypop commented

2025-03-25 11:03:50 +00:00

In my prior setup, I was running META locally (because you need something FAST you have no other solution) and /data into a NFS Share.

I worked like a charm. (On home setup).

In my prior setup, I was running META locally (because you need something FAST you have no other solution) and /data into a NFS Share. I worked like a charm. (On home setup).

No milestone

No project

No assignees

3 participants

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Deuxfleurs/garage#986

No description provided.

Rows
Columns