need help to use with quickwit #431

New issue

Closed

opened 2022-11-24 13:52:14 +00:00 by calvin01 · 1 comment

calvin01 commented

2022-11-24 13:52:14 +00:00

I try use garage as https://github.com/quickwit-oss/quickwit storage.

here is the .env

AWS_DEFAULT_REGION=garage
AWS_REGION=garage
QW_S3_ENDPOINT=http://127.0.0.1:3900

error:

2022-11-24T13:45:33.246Z  INFO sniff_aws_region:region_from_env_variables: quickwit_aws::region: Setting AWS Region from environment variable. env_var_key="AWS_REGION" env_var="garage"
2022-11-24T13:45:33.247Z ERROR sniff_aws_region:region_from_env_variables: quickwit_aws::region: Failed to parse region set from environment variable. err=Invalid AWS region. Quickwit expects an AWS region code like `us-east-1` or a http:// endpoint
Command failed: Failed to connect to metastore: `Internal error: `Failed to open metastore file `s3://gw0:3900/qkmeta`.` Cause: `StorageError Service: Invalid AWS region. Quickwit expects an AWS region code like `us-east-1` or a http:// endpoint.`.`

any sugestion how can I setup a http:// endpoint. style region?

I try use garage as https://github.com/quickwit-oss/quickwit storage. here is the .env ```env AWS_DEFAULT_REGION=garage AWS_REGION=garage QW_S3_ENDPOINT=http://127.0.0.1:3900 ``` error: ```sh 2022-11-24T13:45:33.246Z INFO sniff_aws_region:region_from_env_variables: quickwit_aws::region: Setting AWS Region from environment variable. env_var_key="AWS_REGION" env_var="garage" 2022-11-24T13:45:33.247Z ERROR sniff_aws_region:region_from_env_variables: quickwit_aws::region: Failed to parse region set from environment variable. err=Invalid AWS region. Quickwit expects an AWS region code like `us-east-1` or a http:// endpoint Command failed: Failed to connect to metastore: `Internal error: `Failed to open metastore file `s3://gw0:3900/qkmeta`.` Cause: `StorageError Service: Invalid AWS region. Quickwit expects an AWS region code like `us-east-1` or a http:// endpoint.`.` ``` any sugestion how can I setup a `http:// endpoint.` style region?

lx commented

2022-11-24 14:32:25 +00:00

Owner

I think the best solution for you would be to just put your Garage region to us-east-1 instead of garage.

In garage.toml:

[s3_api]
s3_region = "us-east-1"

Then in your .env file:

AWS_DEFAULT_REGION=us-east-1
AWS_REGION=us-east-1

Since Quickwit expects a region code in the same format as those used by AWS, I think this is pretty much theh only solution.

I think the best solution for you would be to just put your Garage region to `us-east-1` instead of `garage`. In `garage.toml`: ```toml [s3_api] s3_region = "us-east-1" ``` Then in your `.env` file: ```sh AWS_DEFAULT_REGION=us-east-1 AWS_REGION=us-east-1 ``` Since Quickwit expects a region code in the same format as those used by AWS, I think this is pretty much theh only solution.