Skip to content

always use multipart uploader for s3 uploads - #13866

Merged
rullzer merged 1 commit into
masterfrom
s3-multipart-uploader
Jan 29, 2019
Merged

always use multipart uploader for s3 uploads#13866
rullzer merged 1 commit into
masterfrom
s3-multipart-uploader

Conversation

@icewind1991

@icewind1991icewind1991 commented Jan 28, 2019

Copy link
Copy Markdown
Member

the multipart uploader handles non seekable streams while upload does not

Fixes#13062

the multipart uploader handles non seekable streams while `upload` does not
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991icewind1991 added the 3. to review Waiting for reviews label Jan 28, 2019
@icewind1991icewind1991 added this to the Nextcloud 16 milestone Jan 28, 2019
@icewind1991

Copy link
Copy Markdown
MemberAuthor

did some quick "real life" testing, chunked uploads work as expected with this patch while they break on master

@icewind1991

Copy link
Copy Markdown
MemberAuthor

it might still be useful to look into making the assembly stream seekable, as I expect that that would lead to faster uploading than having the multipart uploader work around it

@MorrisJobkeMorrisJobke left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code makes sense 👍

@MorrisJobke

MorrisJobke commented Jan 28, 2019

Copy link
Copy Markdown
Member

@icewind1991 Does this fix #13062?

@icewind1991

Copy link
Copy Markdown
MemberAuthor

yes

@rullzerrullzer left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested and works! 🚀

@rullzer
rullzer merged commit 0fd208a into masterJan 29, 2019
@rullzer
rullzer deleted the s3-multipart-uploader branch January 29, 2019 10:14
@rullzer

Copy link
Copy Markdown
Member

/backport to stable15

@backportbot-nextcloud

Copy link
Copy Markdown

backport to stable15 in #13882

@HLFH

HLFH commented Feb 11, 2019

Copy link
Copy Markdown
Contributor

@MorrisJobke@icewind1991 Hi. Does this PR fix #8275?

@MorrisJobke

Copy link
Copy Markdown
Member

@MorrisJobke@icewind1991 Hi. Does this PR fix #8275?

Does not look like, because this PR fixes uploads while the linked issue is most likely about downloads of images.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@icewind1991@MorrisJobke@rullzer@HLFH