Skip to content

HADOOP-14630 Contract Tests to verify create, mkdirs and rename under a file is forbidden - #533

Closed
steveloughran wants to merge 6 commits into
apache:trunkfrom
steveloughran:filesystem/HADOOP-14630-create-under-file
Closed

HADOOP-14630 Contract Tests to verify create, mkdirs and rename under a file is forbidden#533
steveloughran wants to merge 6 commits into
apache:trunkfrom
steveloughran:filesystem/HADOOP-14630-create-under-file

Conversation

@steveloughran

Copy link
Copy Markdown
Contributor

HADOOP-14630. Contract Tests to verify create, mkdirs and rename under a file is forbidden

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec41Docker mode activated.
_ Prechecks _
+1@author1The patch does not contain any @author tags.
+1test4tests0The patch appears to include 5 new or modified test files.
_ trunk Compile Tests _
0mvndep61Maven dependency ordering for branch
+1mvninstall1090trunk passed
+1compile948trunk passed
+1checkstyle216trunk passed
+1mvnsite232trunk passed
+1shadedclient1238branch has no errors when building and testing our client artifacts.
+1findbugs357trunk passed
+1javadoc179trunk passed
_ Patch Compile Tests _
0mvndep23Maven dependency ordering for patch
+1mvninstall150the patch passed
+1compile907the patch passed
-1javac907root generated 1 new + 1492 unchanged - 0 fixed = 1493 total (was 1492)
-0checkstyle215root: The patch generated 4 new + 147 unchanged - 3 fixed = 151 total (was 150)
+1mvnsite229the patch passed
-1whitespace0The patch has 5 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1shadedclient743patch has no errors when building and testing our client artifacts.
+1findbugs421the patch passed
+1javadoc178the patch passed
_ Other Tests _
-1unit514hadoop-common in the patch failed.
+1unit115hadoop-hdfs-client in the patch passed.
+1unit29hadoop-openstack in the patch passed.
+1unit82hadoop-azure in the patch passed.
+1unit59hadoop-azure-datalake in the patch passed.
+1asflicense42The patch does not generate ASF License warnings.
7896
ReasonTests
Failed junit testshadoop.fs.contract.localfs.TestLocalFSContractRename
hadoop.fs.contract.rawlocal.TestRawlocalContractRename
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-533/1/artifact/out/Dockerfile
GITHUB PR#533
Optional Testsdupname asflicense mvnsite compile javac javadoc mvninstall unit shadedclient findbugs checkstyle
unameLinux 1692ad49d3cc 4.4.0-138-generic #164~14.04.1-Ubuntu SMP Fri Oct 5 08:56:16 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 3a8118b
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
findbugsv3.1.0-RC1
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/1/artifact/out/diff-compile-javac-root.txt
checkstylehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/1/artifact/out/diff-checkstyle-root.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/1/artifact/out/whitespace-eol.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/1/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/1/testReport/
Max. process+thread count1714 (vs. ulimit of 5500)
modulesC: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-tools/hadoop-openstack hadoop-tools/hadoop-azure hadoop-tools/hadoop-azure-datalake U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/1/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@steveloughransteveloughran changed the title HADOOP-14630 HADOOP-14630 Contract Tests to verify create, mkdirs and rename under a file is forbiddenFeb 28, 2019
@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec29Docker mode activated.
_ Prechecks _
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 5 new or modified test files.
_ trunk Compile Tests _
0mvndep62Maven dependency ordering for branch
+1mvninstall1041trunk passed
-1compile103root in trunk failed.
+1checkstyle193trunk passed
+1mvnsite208trunk passed
+1shadedclient1081branch has no errors when building and testing our client artifacts.
+1findbugs303trunk passed
+1javadoc153trunk passed
_ Patch Compile Tests _
0mvndep21Maven dependency ordering for patch
+1mvninstall153the patch passed
+1compile984the patch passed
-1javac984root generated 1180 new + 309 unchanged - 0 fixed = 1489 total (was 309)
-0checkstyle191root: The patch generated 4 new + 147 unchanged - 3 fixed = 151 total (was 150)
+1mvnsite223the patch passed
-1whitespace0The patch has 36 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-1whitespace1The patch 600 line(s) with tabs.
+1shadedclient661patch has no errors when building and testing our client artifacts.
+1findbugs392the patch passed
+1javadoc204the patch passed
_ Other Tests _
-1unit496hadoop-common in the patch failed.
+1unit123hadoop-hdfs-client in the patch passed.
+1unit35hadoop-openstack in the patch passed.
+1unit94hadoop-azure in the patch passed.
+1unit65hadoop-azure-datalake in the patch passed.
-1asflicense48The patch generated 1 ASF License warnings.
6737
ReasonTests
Failed junit testshadoop.fs.contract.rawlocal.TestRawlocalContractRename
hadoop.fs.contract.localfs.TestLocalFSContractRename
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/artifact/out/Dockerfile
GITHUB PR#533
Optional Testsdupname asflicense mvnsite compile javac javadoc mvninstall unit shadedclient findbugs checkstyle
unameLinux c873d3245fa9 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 15098df
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/artifact/out/branch-compile-root.txt
findbugsv3.1.0-RC1
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/artifact/out/diff-compile-javac-root.txt
checkstylehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/artifact/out/diff-checkstyle-root.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/artifact/out/whitespace-eol.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/artifact/out/whitespace-tabs.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/testReport/
asflicensehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/artifact/out/patch-asflicense-problems.txt
Max. process+thread count1397 (vs. ulimit of 5500)
modulesC: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-tools/hadoop-openstack hadoop-tools/hadoop-azure hadoop-tools/hadoop-azure-datalake U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/2/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@steveloughran

Copy link
Copy Markdown
ContributorAuthor

Whitespace is from an error file. I deny (direct) responsibility

./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:79:680000000-680580000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:80:680580000-755580000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:81:755580000-755800000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:82:755800000-7c0000000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:83:7f5d7ff54000-7f5d7ff57000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:84:7f5d7ff57000-7f5d805ff000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:85:7f5d805ff000-7f5d80602000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:86:7f5d80602000-7f5d80ca9000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:87:7f5d80ca9000-7f5d80cab000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:88:7f5d80cab000-7f5d80fff000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:89:7f5d80fff000-7f5d81000000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:90:7f5d81000000-7f5d81270000 rwxp 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:91:7f5d81270000-7f5d90000000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:92:7f5d90000000-7f5d9003b000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:93:7f5d9003b000-7f5d94000000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:94:7f5d94350000-7f5d94351000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:95:7f5d94351000-7f5d94451000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:96:7f5d94451000-7f5d94452000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:97:7f5d94452000-7f5d94552000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:98:7f5d94552000-7f5d94553000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:99:7f5d94553000-7f5d9465d000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:100:7f5d9465d000-7f5d94a13000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:109:7f5d94e28000-7f5d94e2e000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:118:7f5d95251000-7f5d95253000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:146:7f5d96341000-7f5d96345000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:151:7f5d97263000-7f5d97293000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:156:7f5d974ac000-7f5d974b0000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:169:7f5d97c94000-7f5d97c98000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:176:7f5d97fbd000-7f5d97fc0000 ---p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:177:7f5d97fc0000-7f5d980c2000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:178:7f5d980c9000-7f5d980ca000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:179:7f5d980ca000-7f5d980cb000 r--p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:180:7f5d980cb000-7f5d980cc000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:183:7f5d980ce000-7f5d980cf000 rw-p 00000000 00:00 0 ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:190:jvm_args: -Dapplication.home=/usr/lib/jvm/java-8-openjdk-amd64 -Xms8m ./hadoop-hdfs-project/hadoop-hdfs-client/hs_err_pid24650.log:222:libc:glibc 2.23 NPTL 2.23 

@steveloughran
steveloughranforce-pushed the filesystem/HADOOP-14630-create-under-file branch from 10fd31d to 2615fb3CompareMarch 9, 2019 16:15

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec30Docker mode activated.
_ Prechecks _
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 5 new or modified test files.
_ trunk Compile Tests _
0mvndep21Maven dependency ordering for branch
+1mvninstall1088trunk passed
+1compile1026trunk passed
+1checkstyle199trunk passed
+1mvnsite222trunk passed
+1shadedclient1108branch has no errors when building and testing our client artifacts.
+1findbugs323trunk passed
+1javadoc161trunk passed
_ Patch Compile Tests _
0mvndep23Maven dependency ordering for patch
+1mvninstall154the patch passed
-1compile288root in the patch failed.
-1javac288root in the patch failed.
-0checkstyle195root: The patch generated 4 new + 148 unchanged - 3 fixed = 152 total (was 151)
-1mvnsite23hadoop-common in the patch failed.
-1whitespace0The patch has 5 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1shadedclient657patch has no errors when building and testing our client artifacts.
+1findbugs331the patch passed
+1javadoc139the patch passed
_ Other Tests _
+1unit505hadoop-common in the patch passed.
+1unit109hadoop-hdfs-client in the patch passed.
+1unit19hadoop-openstack in the patch passed.
+1unit79hadoop-azure in the patch passed.
+1unit51hadoop-azure-datalake in the patch passed.
+1asflicense25The patch does not generate ASF License warnings.
6688
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-533/3/artifact/out/Dockerfile
GITHUB PR#533
Optional Testsdupname asflicense mvnsite compile javac javadoc mvninstall unit shadedclient findbugs checkstyle
unameLinux f30449e11c5c 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 0cbe9ad
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
findbugsv3.1.0-RC1
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/3/artifact/out/patch-compile-root.txt
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/3/artifact/out/patch-compile-root.txt
checkstylehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/3/artifact/out/diff-checkstyle-root.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/3/artifact/out/patch-mvnsite-hadoop-common-project_hadoop-common.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/3/artifact/out/whitespace-eol.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/3/testReport/
Max. process+thread count1471 (vs. ulimit of 5500)
modulesC: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-tools/hadoop-openstack hadoop-tools/hadoop-azure hadoop-tools/hadoop-azure-datalake U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/3/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@steveloughransteveloughran added the failed yetus rejected, some other test failure. Means: not ready for use label Apr 5, 2019

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec82Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 5 new or modified test files.
_ trunk Compile Tests _
0mvndep25Maven dependency ordering for branch
+1mvninstall1208trunk passed
+1compile1182trunk passed
+1checkstyle166trunk passed
+1mvnsite256trunk passed
+1shadedclient1213branch has no errors when building and testing our client artifacts.
+1javadoc187trunk passed
0spotbugs47Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs426trunk passed
_ Patch Compile Tests _
0mvndep27Maven dependency ordering for patch
+1mvninstall171the patch passed
+1compile1046the patch passed
-1javac1046root generated 1 new + 1479 unchanged - 0 fixed = 1480 total (was 1479)
-0checkstyle159root: The patch generated 4 new + 146 unchanged - 3 fixed = 150 total (was 149)
+1mvnsite254the patch passed
-1whitespace1The patch has 5 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1shadedclient782patch has no errors when building and testing our client artifacts.
+1javadoc193the patch passed
+1findbugs468the patch passed
_ Other Tests _
+1unit553hadoop-common in the patch passed.
+1unit128hadoop-hdfs-client in the patch passed.
+1unit32hadoop-openstack in the patch passed.
+1unit88hadoop-azure in the patch passed.
+1unit63hadoop-azure-datalake in the patch passed.
+1asflicense48The patch does not generate ASF License warnings.
8632
SubsystemReport/Notes
DockerClient=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-533/4/artifact/out/Dockerfile
GITHUB PR#533
Optional Testsdupname asflicense mvnsite compile javac javadoc mvninstall unit shadedclient findbugs checkstyle
unameLinux 1f9e98f5b6e4 4.15.0-52-generic #56-Ubuntu SMP Tue Jun 4 22:49:08 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / cd967c7
Default Java1.8.0_212
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/4/artifact/out/diff-compile-javac-root.txt
checkstylehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/4/artifact/out/diff-checkstyle-root.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/4/artifact/out/whitespace-eol.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/4/testReport/
Max. process+thread count1535 (vs. ulimit of 5500)
modulesC: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-tools/hadoop-openstack hadoop-tools/hadoop-azure hadoop-tools/hadoop-azure-datalake U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/4/console
versionsgit=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec0Docker mode activated.
-1patch9#533 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.
SubsystemReport/Notes
GITHUB PR#533
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/5/console
versionsgit=2.17.1
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec0Docker mode activated.
-1patch12#533 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.
SubsystemReport/Notes
GITHUB PR#533
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/6/console
versionsgit=2.17.1
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@apacheapache deleted a comment from hadoop-yetusAug 23, 2019
…nting createNonRecursive
Change-Id: If826ad1d893c8c9733d6259cb5d7e4d986df49e4
…leSystemMetricsSystem; intermittent failure during testing
Change-Id: I884de58f555908fbd867f82a078e04bf86849413
…ion if the direct parent is a file
Change-Id: Id53f1245068a078d682c37391b618b9de64db52a
steveloughranand others added 2 commits August 23, 2019 19:17
this has happened in 2 places now; I'm going to make it something which stores can declare they do
Change-Id: I60aa2d68cd2f9f2e511972b6c799d10348d82578
…d a new switch to allow filesystems to delcare they permit this.
S3A contact XML adds the flag; Swift does not -it does check, at a cost in performance.
Change-Id: Ifd40c6a58f6ac8cc9eeb83168e0449de59313dfd
tested: s3a, abfs, swift. my ADL login is no longer valid.
@steveloughran
steveloughranforce-pushed the filesystem/HADOOP-14630-create-under-file branch from 2615fb3 to fac64e5CompareAugust 23, 2019 18:56


The path must either be a directory or not exist

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line


No ancestor may be a file

forall d = ancestors(FS, p) :

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line


No ancestor may be a file

forall d = ancestors(FS, p) :

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec80Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 7 new or modified test files.
_ trunk Compile Tests _
0mvndep75Maven dependency ordering for branch
+1mvninstall1461trunk passed
+1compile1426trunk passed
+1checkstyle190trunk passed
+1mvnsite374trunk passed
+1shadedclient1508branch has no errors when building and testing our client artifacts.
+1javadoc315trunk passed
0spotbugs56Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs602trunk passed
_ Patch Compile Tests _
0mvndep27Maven dependency ordering for patch
+1mvninstall247the patch passed
+1compile1377the patch passed
-1javac1377root generated 1 new + 1471 unchanged - 1 fixed = 1472 total (was 1472)
-0checkstyle201root: The patch generated 2 new + 162 unchanged - 3 fixed = 164 total (was 165)
+1mvnsite379the patch passed
-1whitespace0The patch has 3 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1xml2The patch has no ill-formed XML file.
+1shadedclient884patch has no errors when building and testing our client artifacts.
+1javadoc297the patch passed
+1findbugs643the patch passed
_ Other Tests _
+1unit661hadoop-common in the patch passed.
+1unit144hadoop-hdfs-client in the patch passed.
+1unit41hadoop-openstack in the patch passed.
+1unit105hadoop-aws in the patch passed.
+1unit105hadoop-azure in the patch passed.
+1unit81hadoop-azure-datalake in the patch passed.
+1asflicense66The patch does not generate ASF License warnings.
11090
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-533/11/artifact/out/Dockerfile
GITHUB PR#533
Optional Testsdupname asflicense mvnsite compile javac javadoc mvninstall unit shadedclient findbugs checkstyle xml
unameLinux 15bf9e7d9871 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / ebef99d
Default Java1.8.0_222
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/11/artifact/out/diff-compile-javac-root.txt
checkstylehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/11/artifact/out/diff-checkstyle-root.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/11/artifact/out/whitespace-eol.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/11/testReport/
Max. process+thread count1346 (vs. ulimit of 5500)
modulesC: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-tools/hadoop-openstack hadoop-tools/hadoop-aws hadoop-tools/hadoop-azure hadoop-tools/hadoop-azure-datalake U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/11/console
versionsgit=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@apacheapache deleted a comment from hadoop-yetusAug 26, 2019
@apacheapache deleted a comment from hadoop-yetusAug 26, 2019
@apacheapache deleted a comment from hadoop-yetusAug 26, 2019


The path must either be a directory or not exist

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line


No ancestor may be a file

forall d = ancestors(FS, p) :

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line


No ancestor may be a file

forall d = ancestors(FS, p) :

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec66Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 7 new or modified test files.
_ trunk Compile Tests _
0mvndep27Maven dependency ordering for branch
+1mvninstall1263trunk passed
+1compile1229trunk passed
+1checkstyle169trunk passed
+1mvnsite313trunk passed
+1shadedclient1279branch has no errors when building and testing our client artifacts.
+1javadoc234trunk passed
0spotbugs46Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs474trunk passed
_ Patch Compile Tests _
0mvndep24Maven dependency ordering for patch
+1mvninstall193the patch passed
+1compile1036the patch passed
-1javac1036root generated 1 new + 1471 unchanged - 1 fixed = 1472 total (was 1472)
-0checkstyle151root: The patch generated 2 new + 162 unchanged - 3 fixed = 164 total (was 165)
+1mvnsite310the patch passed
-1whitespace0The patch has 3 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1xml2The patch has no ill-formed XML file.
+1shadedclient670patch has no errors when building and testing our client artifacts.
+1javadoc240the patch passed
-1findbugs34hadoop-azure-datalake in the patch failed.
_ Other Tests _
+1unit557hadoop-common in the patch passed.
+1unit131hadoop-hdfs-client in the patch passed.
+1unit33hadoop-openstack in the patch passed.
+1unit94hadoop-aws in the patch passed.
+1unit96hadoop-azure in the patch passed.
-1unit35hadoop-azure-datalake in the patch failed.
+1asflicense50The patch does not generate ASF License warnings.
9016
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-533/12/artifact/out/Dockerfile
GITHUB PR#533
Optional Testsdupname asflicense mvnsite compile javac javadoc mvninstall unit shadedclient findbugs checkstyle xml
unameLinux ef17c45ef432 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 3329257
Default Java1.8.0_222
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/12/artifact/out/diff-compile-javac-root.txt
checkstylehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/12/artifact/out/diff-checkstyle-root.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/12/artifact/out/whitespace-eol.txt
findbugshttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/12/artifact/out/patch-findbugs-hadoop-tools_hadoop-azure-datalake.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/12/artifact/out/patch-unit-hadoop-tools_hadoop-azure-datalake.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/12/testReport/
Max. process+thread count1426 (vs. ulimit of 5500)
modulesC: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-tools/hadoop-openstack hadoop-tools/hadoop-aws hadoop-tools/hadoop-azure hadoop-tools/hadoop-azure-datalake U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/12/console
versionsgit=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.



The path must either be a directory or not exist

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line


No ancestor may be a file

forall d = ancestors(FS, p) :

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line


No ancestor may be a file

forall d = ancestors(FS, p) :

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec89Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 7 new or modified test files.
_ trunk Compile Tests _
0mvndep34Maven dependency ordering for branch
+1mvninstall1230trunk passed
+1compile1174trunk passed
+1checkstyle164trunk passed
+1mvnsite297trunk passed
+1shadedclient1262branch has no errors when building and testing our client artifacts.
+1javadoc229trunk passed
0spotbugs46Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs532trunk passed
_ Patch Compile Tests _
0mvndep23Maven dependency ordering for patch
+1mvninstall214the patch passed
+1compile1039the patch passed
-1javac1039root generated 1 new + 1471 unchanged - 1 fixed = 1472 total (was 1472)
-0checkstyle147root: The patch generated 2 new + 162 unchanged - 3 fixed = 164 total (was 165)
+1mvnsite275the patch passed
-1whitespace0The patch has 3 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1xml2The patch has no ill-formed XML file.
+1shadedclient746patch has no errors when building and testing our client artifacts.
+1javadoc217the patch passed
+1findbugs538the patch passed
_ Other Tests _
+1unit608hadoop-common in the patch passed.
+1unit129hadoop-hdfs-client in the patch passed.
+1unit26hadoop-openstack in the patch passed.
+1unit78hadoop-aws in the patch passed.
+1unit85hadoop-azure in the patch passed.
+1unit56hadoop-azure-datalake in the patch passed.
+1asflicense43The patch does not generate ASF License warnings.
9087
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-533/13/artifact/out/Dockerfile
GITHUB PR#533
Optional Testsdupname asflicense mvnsite compile javac javadoc mvninstall unit shadedclient findbugs checkstyle xml
unameLinux 14965c760f79 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 915cbc9
Default Java1.8.0_222
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/13/artifact/out/diff-compile-javac-root.txt
checkstylehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/13/artifact/out/diff-checkstyle-root.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/13/artifact/out/whitespace-eol.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/13/testReport/
Max. process+thread count1379 (vs. ulimit of 5500)
modulesC: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-tools/hadoop-openstack hadoop-tools/hadoop-aws hadoop-tools/hadoop-azure hadoop-tools/hadoop-azure-datalake U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-533/13/console
versionsgit=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
…g partition while choosing.
Author: Aditya Toomula <atoomula@linkedin.com>
Reviewers: Jagadish<jagadish@apache.org>
Closesapache#533 from atoomula/chooser

@liuml07liuml07 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 once rebased again and a QA. Do you think we can backport this to all 2.10+ branches?

expectMkdirsUnderFileFails("mkdirs() file/dir",
grandparent, child);

try {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need another mkdirs(child) test here? I thought it's already tested in above expectMkdirsUnderFileFails().

Is this for verbose logging output? I mean,

 handleRelaxedException(action,
"ParentNotDirectoryException",
e);

v.s.

 handleRelaxedException("creating a file under a subdirectory of a file ",
"FileAlreadyExistsException",
e);

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just being curious about deeper creation .. those object stores are so troublesome here

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes I think this test testMkdirUnderFileSubdir makes perfect sense. In this test, I was assuming the whole try-catch clause is having the same logic (except exception handling) as the call to expectMkdirsUnderFileFails() in LoC 376 in this method.

@steveloughran

Copy link
Copy Markdown
ContributorAuthor

thx for the merge -no obvious issues with a backport

@steveloughran

Copy link
Copy Markdown
ContributorAuthor

merged; closing. Thanks for looking @ this

@liuml07liuml07 removed the failed yetus rejected, some other test failure. Means: not ready for use label Mar 9, 2020
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@steveloughran@hadoop-yetus@liuml07