HADOOP-17851. Support user specified content encoding for S3A - #3498

Merged

steveloughran merged 12 commits into

apache:trunkfrom

steveloughran:s3/HADOOP-17851-content-encoding

Sep 29, 2021

Commits on Sep 28, 2021

Add the ability for users to specify the content encoding of the objects they are putting. This is useful for people loading the data into other tools in the AWS ecosystem which don't use file exte…

holdenk
authored and
Steve Loughran
committed
0ae488b
Add an integration test

holdenk
authored and
Steve Loughran
committed
0f82f22
Update the ITestS3a*Enc* skip logic to handle nulls, make my ITestS3A test fail.

holdenk
authored and
Steve Loughran
committed
d519c9d
Fix setting the content encoding and change the test to a real one

holdenk
authored and
Steve Loughran
committed
8292662
Fix content encoding config var name to match

holdenk
authored and
Steve Loughran
committed
dcab243
Fix some linter errors and add a rename op

holdenk
authored and
Steve Loughran
committed
442cc2f
Switch from using the full s3 client to just using getXattrs

holdenk
authored and
Steve Loughran
committed
7cb781a
getXattr fix

holdenk
authored and
Steve Loughran
committed
5a7a69f
Code review feedback

holdenk
authored and
Steve Loughran
committed
0d736ff
Unused import cleanup in test

holdenk
authored and
Steve Loughran
committed
b3d1b18
HADOOP-17851 roll back the changes to the encryption tests, as test setup/skip is now different
Steve Loughran
committed
f4fddcb
HADOOP-17851. tuning content encoding
Steve Loughran
committed
f457367