Skip to content

Allow config to specify the bucket exists - #23932

Merged
MorrisJobke merged 1 commit into
masterfrom
enh/s3/do_not_check_bucket_exists_on_every_request
Nov 6, 2020
Merged

Allow config to specify the bucket exists#23932
MorrisJobke merged 1 commit into
masterfrom
enh/s3/do_not_check_bucket_exists_on_every_request

Conversation

@rullzer

Copy link
Copy Markdown
Member

In the 99% case the bucket is just always there. And if it is not the
read/write will fail hard anyways. Esp on big instances the Objectstore
is not always fast and this can save a few hundered ms of each request
that acess the objectstore.

In short it is adding

'verify_bucket_exists' => false

To the S3 config part

Signed-off-by: Roeland Jago Douma roeland@famdouma.nl

In the 99% case the bucket is just always there. And if it is not the
read/write will fail hard anyways. Esp on big instances the Objectstore
is not always fast and this can save a few hundered ms of each request
that acess the objectstore.
In short it is adding
'verify_bucket_exists' => false
To the S3 config part
Signed-off-by: Roeland Jago Douma <roeland@famdouma.nl>

@juliusknorrjuliusknorr left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense 👍

@kesselb

Copy link
Copy Markdown
Contributor

I think that should be the default without a configuration option.

@MorrisJobke

Copy link
Copy Markdown
Member

I think that should be the default without a configuration option.

Get's tricky for multibucket setups, where the needed buckets are created on the fly.

@MorrisJobke
MorrisJobke merged commit 9e2ced6 into masterNov 6, 2020
@MorrisJobke
MorrisJobke deleted the enh/s3/do_not_check_bucket_exists_on_every_request branch November 6, 2020 15:13
@MorrisJobkeMorrisJobke added the pending documentation This pull request needs an associated documentation update label Nov 6, 2020
@MorrisJobke

Copy link
Copy Markdown
Member

Documentation needed. Especially in sample config as well as the implications on multibucket (and preview multibucket setups).

joshtrichards added a commit to joshtrichards/nc-documentation that referenced this pull request Sep 3, 2023
As developed in nextcloud/server#23932
Also includes caveat language re: multibucket scenarios
Signed-off-by: Josh Richards <josh.t.richards@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

3. to reviewWaiting for reviewsenhancementpending documentationThis pull request needs an associated documentation updateperformance 🚀

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@rullzer@kesselb@MorrisJobke@icewind1991@juliusknorr