Skip to content

HBASE-22877 WebHDFS based export snapshot will fail if hfile is in archive directory - #509

Closed
VicoWu wants to merge 2 commits into
apache:masterfrom
VicoWu:fix_export_snapshot_for_webhdfs
Closed

HBASE-22877 WebHDFS based export snapshot will fail if hfile is in archive directory#509
VicoWu wants to merge 2 commits into
apache:masterfrom
VicoWu:fix_export_snapshot_for_webhdfs

Conversation

@VicoWu

@VicoWuVicoWu commented Aug 19, 2019

Copy link
Copy Markdown
Contributor

The corresponding issue: HBASE-22877
The problem happened in the method tryOpen :

 /**
* Try to open the file from one of the available locations.
*
* @return FSDataInputStream stream of the opened file link
* @throws IOException on unexpected error, or file not found.
*/
private FSDataInputStream tryOpen() throws IOException {
IOException exception = null;
for (Path path: fileLink.getLocations()) {
if (path.equals(currentPath)) continue;
try {
if(fs instanceof WebHdfsFileSystem && !fs.exists(path))
throw new FileNotFoundException("File not exists for path " + path.toString());
in = fs.open(path, bufferSize);
if (pos != 0) in.seek(pos);
assert(in.getPos() == pos) : "Link unable to seek to the right position=" + pos;
if (LOG.isTraceEnabled()) {
if (currentPath == null) {
LOG.debug("link open path=" + path);
} else {
LOG.trace("link switch from path=" + currentPath + " to path=" + path);
}
}
currentPath = path;
return(in);
} catch (FileNotFoundException | AccessControlException | RemoteException e) {
exception = FileLink.handleAccessLocationException(fileLink, e, exception);
}
}
throw exception;
}

FileLink.tryOpen() depends on fs.open(path, bufferSize) to throw FileNotFoundException
to try the next file location; When we are using traditional HDFS, the fs is implements of DistributedFileSystem OR ViewFileSystem, but when we are use webhdfs, the fs is implement of WebHdfsFileSystem, in this case, no exception will be thrown even when
the file didn't exist when we are calling fs.open(path, bufferSize); so, ExportMapper will think that hfile exists in the tmp directory, the FileLink will use this directory as the hfile directory by fault; Then finally, when mapper task trying to read this hfile, it found that this file doesn't exist in fact and mapper will fail:

Error: java.io.FileNotFoundException: File does not exist: /hbase/light-hbase/.tmp/data/subill/babylon_event_history/e24ce0b56feb626b4dfe4a0e1d4f3229/info/8bef474844ec42338e7481a1933cecbd
at sun.reflect.GeneratedConstructorAccessor14.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.toIOException(WebHdfsFileSystem.java:451)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.access$600(WebHdfsFileSystem.java:108)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.shouldRetry(WebHdfsFileSystem.java:738)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.runWithRetry(WebHdfsFileSystem.java:704)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.access$100(WebHdfsFileSystem.java:524)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner$1.run(WebHdfsFileSystem.java:554)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.run(WebHdfsFileSystem.java:550)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$ReadRunner.read(WebHdfsFileSystem.java:1824)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream.read(WebHdfsFileSystem.java:1682)
at java.io.DataInputStream.read(DataInputStream.java:149)
at org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.read(FileLink.java:152)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:284)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at java.io.FilterInputStream.read(FilterInputStream.java:107)
at org.apache.hadoop.hbase.io.hadoopbackport.ThrottledInputStream.read(ThrottledInputStream.java:79)
at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.copyData(ExportSnapshot.java:387)
at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.copyFile(ExportSnapshot.java:284)
at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:212)
at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:130)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): File does not exist: /hbase/light-hbase/.tmp/data/subill/babylon_event_history/e24ce0b56feb626b4dfe4a0e1d4f3229/info/8bef474844ec42338e7481a1933cecbd
at org.apache.hadoop.hdfs.web.JsonUtil.toRemoteException(JsonUtil.java:124)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:420)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.access$200(WebHdfsFileSystem.java:108)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.connect(WebHdfsFileSystem.java:596)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$ReadRunner.connect(WebHdfsFileSystem.java:1875)
at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.runWithRetry(WebHdfsFileSystem.java:674)
... 27 more

We should add an addition code to handle the WebHDFS case;

…chive directory
FileLink.tryOpen() depends on fs.open(path, bufferSize) to throw FileNotFoundException
to try the next file location; But when we use WebHDFS, no exception was thrown even when
the file didn't exist; We should add an addition code to handle the WebHDFS case;
@jojochuang

Copy link
Copy Markdown
Contributor

Does the patch try to fail early? Or does it try to support webhdfs based snapshot export?
it is entirely possible that webhdfs fails to encode certain file names properly.

@VicoWu

VicoWu commented Aug 19, 2019

Copy link
Copy Markdown
ContributorAuthor

@jojochuang
Thanks for you focus;
I have update the problem description and make it more detailed; Very appreciated if you could read it in detail;

  1. Does the patch try to fail early?
    What do you mean by fail early? Your question is , does HBase export snapshot fail early without this patch?

  2. Or does it try to support webhdfs based snapshot export?
    According to my test, WebHDFS based snapshot export is actually supported; The error happened when some data is in the archive directory; After the patch applied, the WebHDFS Based snapshot export works fine;

  3. it is entirely possible that webhdfs fails to encode certain file names properly.
    At least in this case I didn't find its relationship with file name encoding;

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec69Docker mode activated.
_ Prechecks _
+1dupname1No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall355master passed
+1compile58master passed
+1checkstyle90master passed
+1shadedjars301branch has no errors when building our shaded downstream artifacts.
+1javadoc38master passed
0spotbugs265Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs263master passed
_ Patch Compile Tests _
+1mvninstall349the patch passed
+1compile79the patch passed
+1javac79the patch passed
-1checkstyle99hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1whitespace0The patch has no whitespace issues.
+1shadedjars408patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1696Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc100the patch passed
+1findbugs569the patch passed
_ Other Tests _
-1unit15512hbase-server in the patch failed.
+1asflicense39The patch does not generate ASF License warnings.
20652
SubsystemReport/Notes
DockerClient=19.03.0 Server=19.03.0 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 5d915ecfcae8 4.15.0-52-generic #56-Ubuntu SMP Tue Jun 4 22:49:08 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 46abaef
Default Java1.8.0_181
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/artifact/out/diff-checkstyle-hbase-server.txt
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/testReport/
Max. process+thread count4723 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec33Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall364master passed
+1compile62master passed
+1checkstyle93master passed
+1shadedjars277branch has no errors when building our shaded downstream artifacts.
+1javadoc40master passed
0spotbugs282Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs280master passed
_ Patch Compile Tests _
+1mvninstall343the patch passed
+1compile66the patch passed
+1javac66the patch passed
-1checkstyle95hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1whitespace0The patch has no whitespace issues.
+1shadedjars323patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1085Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc36the patch passed
+1findbugs324the patch passed
_ Other Tests _
-1unit9610hbase-server in the patch failed.
+1asflicense28The patch does not generate ASF License warnings.
13493
ReasonTests
Failed junit testshadoop.hbase.regionserver.TestHRegion
hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 0126ab4d2185 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 8e488ce
Default Java1.8.0_181
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/artifact/out/diff-checkstyle-hbase-server.txt
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/testReport/
Max. process+thread count4375 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec116Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall360master passed
+1compile59master passed
+1checkstyle81master passed
+1shadedjars288branch has no errors when building our shaded downstream artifacts.
+1javadoc36master passed
0spotbugs246Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs245master passed
_ Patch Compile Tests _
+1mvninstall326the patch passed
+1compile55the patch passed
+1javac55the patch passed
-1checkstyle75hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1whitespace0The patch has no whitespace issues.
+1shadedjars286patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck997Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc33the patch passed
+1findbugs258the patch passed
_ Other Tests _
-1unit16166hbase-server in the patch failed.
+1asflicense28The patch does not generate ASF License warnings.
19814
ReasonTests
Failed junit testshadoop.hbase.client.TestFromClientSide3
hadoop.hbase.regionserver.TestHRegion
hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 2179151ab6e8 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 6738280
Default Java1.8.0_181
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/artifact/out/diff-checkstyle-hbase-server.txt
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/testReport/
Max. process+thread count5110 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec71Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall413master passed
+1compile68master passed
+1checkstyle95master passed
+1shadedjars346branch has no errors when building our shaded downstream artifacts.
+1javadoc40master passed
0spotbugs284Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs281master passed
_ Patch Compile Tests _
+1mvninstall333the patch passed
+1compile59the patch passed
+1javac59the patch passed
-1checkstyle81hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1whitespace0The patch has no whitespace issues.
+1shadedjars301patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1215Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc39the patch passed
+1findbugs326the patch passed
_ Other Tests _
-1unit20941hbase-server in the patch failed.
+1asflicense88The patch does not generate ASF License warnings.
25224
ReasonTests
Failed junit testshadoop.hbase.tool.TestBulkLoadHFiles
hadoop.hbase.master.procedure.TestTruncateTableProcedure
hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL
hadoop.hbase.replication.TestReplicationKillSlaveRS
hadoop.hbase.replication.TestReplicationSmallTests
hadoop.hbase.master.procedure.TestProcedurePriority
hadoop.hbase.regionserver.TestHRegion
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.replication.TestReplicationKillSlaveRSWithSeparateOldWALs
hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
hadoop.hbase.replication.TestReplicationSmallTestsSync
hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush
hadoop.hbase.client.TestSnapshotTemporaryDirectoryWithRegionReplicas
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.tool.TestSecureBulkLoadHFiles
hadoop.hbase.security.access.TestSnapshotScannerHDFSAclController
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux d5ac272a1ad6 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / a59f7d4
Default Java1.8.0_181
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/artifact/out/diff-checkstyle-hbase-server.txt
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/testReport/
Max. process+thread count4940 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@shahrs87

shahrs87 commented Aug 20, 2019

Copy link
Copy Markdown
Contributor

in this case, no exception will be thrown even when the file didn't exist when we are calling

@VicoWu Could you elaborate why you think it doesn't throw FileNotfound exception. In the stack trace you pasted, it did throw FileNotFound Exception but it is wrapped in RemoteException. You just need to unwrap RemoteException to see underlying exception. Maybe I am missing something. Please correct me if I am wrong.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec98Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall361master passed
+1compile66master passed
+1checkstyle80master passed
+1shadedjars317branch has no errors when building our shaded downstream artifacts.
+1javadoc35master passed
0spotbugs277Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs273master passed
_ Patch Compile Tests _
+1mvninstall320the patch passed
+1compile59the patch passed
+1javac59the patch passed
-1checkstyle76hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1whitespace1The patch has no whitespace issues.
+1shadedjars313patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck999Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc33the patch passed
+1findbugs268the patch passed
_ Other Tests _
-1unit19512hbase-server in the patch failed.
+1asflicense79The patch does not generate ASF License warnings.
23331
ReasonTests
Failed junit testshadoop.hbase.util.TestFromClientSide3WoUnsafe
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.client.TestAsyncTableAdminApi
hadoop.hbase.replication.TestReplicationSmallTests
hadoop.hbase.tool.TestBulkLoadHFiles
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.replication.TestReplicationSmallTestsSync
hadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.master.procedure.TestSCPWithReplicas
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.tool.TestSecureBulkLoadHFiles
hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux afd35db0fd7b 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / ab28f9d
Default Java1.8.0_181
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/artifact/out/diff-checkstyle-hbase-server.txt
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/testReport/
Max. process+thread count5380 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@jojochuang

Copy link
Copy Markdown
Contributor

Interesting to know this webhdfs behavior.
I wonder if the behavior had changed recently, because on Hadoop 3, it does throw FileNotFoundException upon opening an non-existent file:


curl http://nn1:20101/webhdfs/v1/abc?op=OPEN
{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File /abc not found."}}

@VicoWu

VicoWu commented Aug 21, 2019

Copy link
Copy Markdown
ContributorAuthor

@jojochuang
Thanks for your experiments;
From my understanding, when you use curl with op=OPEN, this rest request definitely will send to the httpfs server and get a FileNotFound exception;This is just as expect;
But when it comes to the httpfs java client WebHdfsFileSystem, things is different; I have debug and dive into to implements of WebHdfsFileSystem and I found: when we call WebHdfsFileSystem.open(), in fact, it does nothing except for preparing an InputStream to the remote httpfs server, but it didn't establish any connection to the httpfs. That's why we cannot get an FileNotFound exception when calling WebHdfsFileSystem.open() on a non-exist files;
So I think it has nothing to do with hadoop version; But you could still check the code of hadoop 3.0;

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec38Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall316master passed
+1compile50master passed
+1checkstyle72master passed
+1shadedjars268branch has no errors when building our shaded downstream artifacts.
+1javadoc38master passed
0spotbugs253Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs252master passed
_ Patch Compile Tests _
+1mvninstall286the patch passed
+1compile52the patch passed
+1javac52the patch passed
+1checkstyle70the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars259patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck905Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc33the patch passed
+1findbugs265the patch passed
_ Other Tests _
+1unit8923hbase-server in the patch passed.
+1asflicense25The patch does not generate ASF License warnings.
12210
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/7/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 91edf9cc5787 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 66ad42c
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/7/testReport/
Max. process+thread count4897 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/7/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec72Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall414master passed
+1compile70master passed
+1checkstyle94master passed
+1shadedjars407branch has no errors when building our shaded downstream artifacts.
+1javadoc43master passed
0spotbugs298Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs295master passed
_ Patch Compile Tests _
+1mvninstall362the patch passed
+1compile69the patch passed
+1javac69the patch passed
+1checkstyle87the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars348patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1341Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc39the patch passed
+1findbugs312the patch passed
_ Other Tests _
-1unit18222hbase-server in the patch failed.
+1asflicense56The patch does not generate ASF License warnings.
22809
ReasonTests
Failed junit testshadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.client.TestFromClientSide3
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/8/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux d6cc95b1fc0e 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 7af5b30
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/8/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/8/testReport/
Max. process+thread count4908 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/8/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@shahrs87

shahrs87 commented Aug 21, 2019

Copy link
Copy Markdown
Contributor

But when it comes to the httpfs java client WebHdfsFileSystem

I am confused whether you are talking about WebHdfsFileSystem or HttpFSFileSystem. These two are different. Refer to class org.apache.hadoop.fs.http.client.HttpFSFileSystem for latter. The further comment is assuming that you are talking about WebHdfsFileSystem since you mentioned that multiple times.

I have debug and dive into to implements of WebHdfsFileSystem and I found: when we call WebHdfsFileSystem.open(), in fact, it does nothing except for preparing an InputStream to the remote httpfs server, but it didn't establish any connection to the httpfs.

This is not correct. When you call WebHdfsFileSystem#open(), it does create an http connection to namenode and gets the list of datanodes where the blocks for that file resides. When you call read on the input stream, it directly goes to datanode.
Follow the code path below.
WebHdfsFileSystem#open --> WebHdfsInputStream(f, bufferSize) --> ReadRunner(path, buffersize) --> ReadRunner#getRedirectedUrl --> AbstractRunner#run() --> WebHdfsFileSystem#runWithRetry --> ReadRunner#connect --> AbstractRunner#connect(URL url) --> AbstractRunner#connect(final HttpOpParam.Op op, final URL url) which makes actual connection to namenode and if the file doesn't exist, WebHdfsFileSystem (client) will receive FileNotFoundException wrapped in RemoteException.
My checked out branch in hadoop is branch-2.8.
Hope this helps.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec98Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall348master passed
+1compile66master passed
+1checkstyle82master passed
+1shadedjars354branch has no errors when building our shaded downstream artifacts.
+1javadoc60master passed
0spotbugs296Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs294master passed
_ Patch Compile Tests _
+1mvninstall601the patch passed
+1compile89the patch passed
+1javac89the patch passed
+1checkstyle93the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars327patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1207Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc45the patch passed
+1findbugs299the patch passed
_ Other Tests _
-1unit20280hbase-server in the patch failed.
+1asflicense40The patch does not generate ASF License warnings.
24785
ReasonTests
Failed junit testshadoop.hbase.util.TestFromClientSide3WoUnsafe
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.security.access.TestSnapshotScannerHDFSAclController
hadoop.hbase.client.TestAsyncTableAdminApi
hadoop.hbase.tool.TestBulkLoadHFiles
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.tool.TestSecureBulkLoadHFiles
hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/9/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 2cfebf1799f4 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 1b50404
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/9/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/9/testReport/
Max. process+thread count5162 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/9/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec38Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall327master passed
+1compile54master passed
+1checkstyle74master passed
+1shadedjars281branch has no errors when building our shaded downstream artifacts.
+1javadoc35master passed
0spotbugs239Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs237master passed
_ Patch Compile Tests _
+1mvninstall299the patch passed
+1compile51the patch passed
+1javac51the patch passed
+1checkstyle73the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars278patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck915Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc33the patch passed
+1findbugs254the patch passed
_ Other Tests _
+1unit8620hbase-server in the patch passed.
+1asflicense24The patch does not generate ASF License warnings.
11963
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/10/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux abfabbf92f20 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / b8857ec
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/10/testReport/
Max. process+thread count4756 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/10/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec75Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall366master passed
+1compile64master passed
+1checkstyle90master passed
+1shadedjars309branch has no errors when building our shaded downstream artifacts.
+1javadoc41master passed
0spotbugs276Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs273master passed
_ Patch Compile Tests _
+1mvninstall336the patch passed
+1compile63the patch passed
+1javac63the patch passed
+1checkstyle87the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars323patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1110Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc38the patch passed
+1findbugs291the patch passed
_ Other Tests _
-1unit16913hbase-server in the patch failed.
+1asflicense39The patch does not generate ASF License warnings.
20834
ReasonTests
Failed junit testshadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.security.access.TestSnapshotScannerHDFSAclController
hadoop.hbase.client.TestAsyncSnapshotAdminApi
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
SubsystemReport/Notes
DockerClient=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/11/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux d6e5ce7c9106 4.15.0-52-generic #56-Ubuntu SMP Tue Jun 4 22:49:08 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / b8857ec
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/11/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/11/testReport/
Max. process+thread count4938 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/11/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec35Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall436master passed
+1compile60master passed
+1checkstyle90master passed
+1shadedjars312branch has no errors when building our shaded downstream artifacts.
+1javadoc42master passed
0spotbugs265Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs261master passed
_ Patch Compile Tests _
+1mvninstall339the patch passed
+1compile61the patch passed
+1javac61the patch passed
+1checkstyle95the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars342patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1107Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc39the patch passed
+1findbugs325the patch passed
_ Other Tests _
+1unit9359hbase-server in the patch passed.
+1asflicense26The patch does not generate ASF License warnings.
13368
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/12/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 33d6cddae471 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 84ee378
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/12/testReport/
Max. process+thread count4430 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/12/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec66Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall352master passed
+1compile56master passed
+1checkstyle80master passed
+1shadedjars307branch has no errors when building our shaded downstream artifacts.
+1javadoc35master passed
0spotbugs245Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs243master passed
_ Patch Compile Tests _
+1mvninstall300the patch passed
+1compile56the patch passed
+1javac56the patch passed
+1checkstyle75the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars306patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1074Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc34the patch passed
+1findbugs266the patch passed
_ Other Tests _
-1unit17667hbase-server in the patch failed.
+1asflicense30The patch does not generate ASF License warnings.
21354
ReasonTests
Failed junit testshadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.util.TestFromClientSide3WoUnsafe
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/13/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 115c45a64ca5 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / b329bf0
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/13/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/13/testReport/
Max. process+thread count5042 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/13/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec94Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall341master passed
+1compile51master passed
+1checkstyle74master passed
+1shadedjars267branch has no errors when building our shaded downstream artifacts.
+1javadoc38master passed
0spotbugs257Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs254master passed
_ Patch Compile Tests _
+1mvninstall318the patch passed
+1compile59the patch passed
+1javac59the patch passed
+1checkstyle73the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars281patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck974Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc46the patch passed
+1findbugs264the patch passed
_ Other Tests _
-1unit18334hbase-server in the patch failed.
+1asflicense73The patch does not generate ASF License warnings.
22091
ReasonTests
Failed junit testshadoop.hbase.client.TestFromClientSide
hadoop.hbase.client.TestIncrementsFromClientSide
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.security.access.TestSnapshotScannerHDFSAclController
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.client.TestAsyncTableAdminApi
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/14/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 3785e7e1858d 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 4268774
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/14/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/14/testReport/
Max. process+thread count5413 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/14/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec63Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall337master passed
+1compile56master passed
+1checkstyle77master passed
+1shadedjars273branch has no errors when building our shaded downstream artifacts.
+1javadoc45master passed
0spotbugs273Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs271master passed
_ Patch Compile Tests _
+1mvninstall310the patch passed
+1compile52the patch passed
+1javac52the patch passed
+1checkstyle72the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars270patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck972Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc34the patch passed
+1findbugs248the patch passed
_ Other Tests _
-1unit20321hbase-server in the patch failed.
+1asflicense85The patch does not generate ASF License warnings.
23882
ReasonTests
Failed junit testshadoop.hbase.tool.TestSecureBulkLoadHFiles
hadoop.hbase.master.procedure.TestRestoreSnapshotProcedure
hadoop.hbase.master.procedure.TestSCPWithReplicas
hadoop.hbase.master.procedure.TestProcedurePriority
hadoop.hbase.client.TestFromClientSide
hadoop.hbase.tool.TestBulkLoadHFiles
hadoop.hbase.client.TestAdmin2
hadoop.hbase.namespace.TestNamespaceAuditor
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.master.procedure.TestTruncateTableProcedure
hadoop.hbase.util.TestFromClientSide3WoUnsafe
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.client.TestAsyncTableAdminApi
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/15/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 26258c33d8dd 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 288d1f2
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/15/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/15/testReport/
Max. process+thread count4958 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/15/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec38Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall323master passed
+1compile53master passed
+1checkstyle73master passed
+1shadedjars268branch has no errors when building our shaded downstream artifacts.
+1javadoc33master passed
0spotbugs242Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs239master passed
_ Patch Compile Tests _
+1mvninstall294the patch passed
+1compile54the patch passed
+1javac54the patch passed
+1checkstyle70the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars266patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck984Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc34the patch passed
+1findbugs270the patch passed
_ Other Tests _
+1unit8627hbase-server in the patch passed.
+1asflicense21The patch does not generate ASF License warnings.
12024
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/16/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ac7a3357d2d3 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 767bb15
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/16/testReport/
Max. process+thread count4738 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/16/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec39Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall414master passed
+1compile60master passed
+1checkstyle96master passed
+1shadedjars311branch has no errors when building our shaded downstream artifacts.
+1javadoc41master passed
0spotbugs288Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs286master passed
_ Patch Compile Tests _
+1mvninstall333the patch passed
+1compile65the patch passed
+1javac65the patch passed
+1checkstyle88the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars318patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1065Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc44the patch passed
+1findbugs336the patch passed
_ Other Tests _
+1unit9889hbase-server in the patch passed.
+1asflicense23The patch does not generate ASF License warnings.
13828
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/17/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 4211565af9ca 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 74fb204
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/17/testReport/
Max. process+thread count4839 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/17/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec101Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall371master passed
+1compile58master passed
+1checkstyle83master passed
+1shadedjars289branch has no errors when building our shaded downstream artifacts.
+1javadoc37master passed
0spotbugs268Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs264master passed
_ Patch Compile Tests _
+1mvninstall330the patch passed
+1compile54the patch passed
+1javac54the patch passed
+1checkstyle84the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars291patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1007Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc39the patch passed
+1findbugs318the patch passed
_ Other Tests _
-1unit17536hbase-server in the patch failed.
+1asflicense36The patch does not generate ASF License warnings.
21300
ReasonTests
Failed junit testshadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
hadoop.hbase.client.TestSnapshotTemporaryDirectoryWithRegionReplicas
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.master.TestAssignmentManagerMetrics
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/18/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux b5d0bb956ab9 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 2d45801
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/18/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/18/testReport/
Max. process+thread count4549 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/18/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec55Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall434master passed
+1compile72master passed
+1checkstyle100master passed
+1shadedjars380branch has no errors when building our shaded downstream artifacts.
+1javadoc48master passed
0spotbugs324Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs320master passed
_ Patch Compile Tests _
+1mvninstall431the patch passed
+1compile76the patch passed
+1javac76the patch passed
+1checkstyle104the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars370patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1291Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc46the patch passed
+1findbugs332the patch passed
_ Other Tests _
+1unit16175hbase-server in the patch passed.
+1asflicense32The patch does not generate ASF License warnings.
20737
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/19/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 46b9dfa4924c 4.4.0-154-generic #181-Ubuntu SMP Tue Jun 25 05:29:03 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 43f53c1
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/19/testReport/
Max. process+thread count4496 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/19/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec40Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall331master passed
+1compile53master passed
+1checkstyle76master passed
+1shadedjars278branch has no errors when building our shaded downstream artifacts.
+1javadoc34master passed
0spotbugs242Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs240master passed
_ Patch Compile Tests _
+1mvninstall305the patch passed
+1compile53the patch passed
+1javac53the patch passed
+1checkstyle70the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars263patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck915Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc33the patch passed
+1findbugs248the patch passed
_ Other Tests _
-1unit8657hbase-server in the patch failed.
+1asflicense24The patch does not generate ASF License warnings.
11980
ReasonTests
Failed junit testshadoop.hbase.security.token.TestZKSecretWatcher
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/20/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 4ab83ca2d982 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 504fc52
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/20/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/20/testReport/
Max. process+thread count4710 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/20/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec42Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall327master passed
+1compile54master passed
+1checkstyle76master passed
+1shadedjars280branch has no errors when building our shaded downstream artifacts.
+1javadoc34master passed
0spotbugs243Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs242master passed
_ Patch Compile Tests _
+1mvninstall298the patch passed
+1compile54the patch passed
+1javac54the patch passed
+1checkstyle77the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars277patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck946Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc33the patch passed
+1findbugs259the patch passed
_ Other Tests _
+1unit8436hbase-server in the patch passed.
+1asflicense32The patch does not generate ASF License warnings.
11842
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/21/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 5e16e514e967 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / ee9d986
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/21/testReport/
Max. process+thread count4615 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/21/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec36Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall470master passed
+1compile76master passed
+1checkstyle112master passed
+1shadedjars377branch has no errors when building our shaded downstream artifacts.
+1javadoc54master passed
0spotbugs281Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs280master passed
_ Patch Compile Tests _
+1mvninstall353the patch passed
+1compile58the patch passed
+1javac58the patch passed
+1checkstyle89the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars302patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1049Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc38the patch passed
+1findbugs320the patch passed
_ Other Tests _
+1unit9495hbase-server in the patch passed.
+1asflicense24The patch does not generate ASF License warnings.
13547
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/22/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 33723f727fc6 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / ee9d986
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/22/testReport/
Max. process+thread count4518 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/22/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec131Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall388master passed
+1compile59master passed
+1checkstyle88master passed
+1shadedjars305branch has no errors when building our shaded downstream artifacts.
+1javadoc40master passed
0spotbugs277Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs275master passed
_ Patch Compile Tests _
+1mvninstall357the patch passed
+1compile61the patch passed
+1javac61the patch passed
+1checkstyle88the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars310patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1056Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc37the patch passed
+1findbugs296the patch passed
_ Other Tests _
+1unit13752hbase-server in the patch passed.
+1asflicense29The patch does not generate ASF License warnings.
17690
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/26/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 92e9db80f663 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 94155fe
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/26/testReport/
Max. process+thread count4650 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/26/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec109Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall432master passed
+1compile71master passed
+1checkstyle100master passed
+1shadedjars362branch has no errors when building our shaded downstream artifacts.
+1javadoc47master passed
0spotbugs333Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs331master passed
_ Patch Compile Tests _
+1mvninstall407the patch passed
+1compile71the patch passed
+1javac71the patch passed
+1checkstyle103the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars365patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1098Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc40the patch passed
+1findbugs292the patch passed
_ Other Tests _
-1unit15458hbase-server in the patch failed.
+1asflicense36The patch does not generate ASF License warnings.
19765
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/27/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ba1ed521584d 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 554b253
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/27/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/27/testReport/
Max. process+thread count4824 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/27/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@VicoWu

VicoWu commented Aug 25, 2019

Copy link
Copy Markdown
ContributorAuthor

@shahrs87
Great thanks for you code insight for my problem;

  • For the mistake I made between the difference between WebHDFSFileSystem and HttpFSFileSystem:

Yes, I previous make mistakes for the differences between WebHDFSFileSystem and HttpFSFileSystem because the schema for both them are webhdfs; I find that when I am using WebHDFSFileSystem, the target could be both the HttpFS server (default port is 14000) or the NameNode webserver(default port is 57000), both connections could work fine except that they didn't throw FileNotFoundException timely when I am calling fs.open();

  • Why the error happened in my side and I find that no connection is established in fs.open?

To be simple, in my code base hadoop2.6.0-cdh5.16.1, the client indeed didn't connect to the remote server. Your code base seems like hadoop3.x, and I find the commit which make the fs.open() try to connect to remote server and thus throws a FileNotFoundException timely is this commit
in which is adds the getRedirectedUrl() call in the ReadRunner construction method:

 ReadRunner(Path p, int bs) throws IOException {
super(GetOpParam.Op.OPEN, p, new BufferSizeParam(bs)); super(GetOpParam.Op.OPEN, p, new BufferSizeParam(bs));
this.path = p; this.path = p;
this.bufferSize = bs; this.bufferSize = bs;
getRedirectedUrl();
}

And this patch has been applied to only 3.x hadoop:

release-3.2.0-RC1 release-3.2.0-RC0 release-3.1.2-RC1 release-3.1.2-RC0 release-3.1.1-RC0 release-3.1.0-RC1 release-3.1.0-RC0 rel/submarine-0.2.0 rel/release-3.2.0 rel/release-3.1.2 rel/release-3.1.1 rel/release-3.1.0 ozone-0.4.0-alpha-RC2 ozone-0.4.0-alpha-RC1 ozone-0.4.0-alpha-RC0 ozone-0.3.0-alpha ozone-0.3.0-alpha-RC1 ozone-0.3.0-alpha-RC0 ozone-0.2.1-alpha-RC0

So that's why your experiment cannot reproduce this problem and that you think the fs.open() do make a connection to the remote server; But in hadoop 2.x, this problem do exists;

So that's my investigation for this problem; I think everything is much more clear now;
Do you think it is necessary to add this patch?

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec86Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall345master passed
+1compile59master passed
+1checkstyle87master passed
+1shadedjars289branch has no errors when building our shaded downstream artifacts.
+1javadoc42master passed
0spotbugs306Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs304master passed
_ Patch Compile Tests _
+1mvninstall312the patch passed
+1compile60the patch passed
+1javac60the patch passed
+1checkstyle83the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars287patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck981Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc37the patch passed
+1findbugs323the patch passed
_ Other Tests _
-1unit17684hbase-server in the patch failed.
+1asflicense42The patch does not generate ASF License warnings.
21411
ReasonTests
Failed junit testshadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/28/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ef9c55875787 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 1ea5d8b
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/28/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/28/testReport/
Max. process+thread count4502 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/28/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec110Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall344master passed
+1compile60master passed
+1checkstyle77master passed
+1shadedjars265branch has no errors when building our shaded downstream artifacts.
+1javadoc38master passed
0spotbugs258Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs257master passed
_ Patch Compile Tests _
+1mvninstall301the patch passed
+1compile56the patch passed
+1javac56the patch passed
+1checkstyle77the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars271patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck954Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc41the patch passed
+1findbugs289the patch passed
_ Other Tests _
+1unit9692hbase-server in the patch passed.
+1asflicense29The patch does not generate ASF License warnings.
13247
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/29/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux c03b9d51a2d4 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 1ea5d8b
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/29/testReport/
Max. process+thread count4653 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/29/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@shahrs87

shahrs87 commented Aug 26, 2019

Copy link
Copy Markdown
Contributor

But in hadoop 2.x, this problem do exists;

This bug does not exist in branch-2.6.0 also.
Here is the git repo for branch-2.6.0 https://github.com/apache/hadoop/tree/branch-2.6.0
Refer to WebHdfsFileSystem#open --> OffsetUrlInputStream(UnresolvedUrlOpener o, OffsetUrlOpener r) --> ByteRangeInputStream(URLOpener o, URLOpener r) --> ByteRangeInputStream#getInputStream() --> ByteRangeInputStream#openInputStream() --> UnresolvedUrlOpener#connect() --> AbstractRunner#run() --> AbstractRunner#runWithRetry() method which in turn calls NameNodeWebHdfsMethods on server side and it will throw FileNotFoundException wrapped in RemoteException.
One suggestion: Please enable trace logging on client side if possible. It will show you many debug and trace level logs about communication between client and server to understand WebHdfsFileSystem better.
@VicoWu Hope this helps.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec32Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall415master passed
+1compile65master passed
+1checkstyle95master passed
+1shadedjars305branch has no errors when building our shaded downstream artifacts.
+1javadoc38master passed
0spotbugs302Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs299master passed
_ Patch Compile Tests _
+1mvninstall352the patch passed
+1compile60the patch passed
+1javac60the patch passed
+1checkstyle87the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars314patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1037Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc36the patch passed
+1findbugs294the patch passed
_ Other Tests _
+1unit10164hbase-server in the patch passed.
+1asflicense38The patch does not generate ASF License warnings.
14036
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/30/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 17404b9d9846 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 0438fdc
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/30/testReport/
Max. process+thread count4841 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/30/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec89Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall444master passed
+1compile67master passed
+1checkstyle100master passed
+1shadedjars315branch has no errors when building our shaded downstream artifacts.
+1javadoc41master passed
0spotbugs297Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs294master passed
_ Patch Compile Tests _
+1mvninstall345the patch passed
+1compile61the patch passed
+1javac61the patch passed
+1checkstyle88the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars303patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1117Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc42the patch passed
+1findbugs316the patch passed
_ Other Tests _
-1unit14667hbase-server in the patch failed.
+1asflicense34The patch does not generate ASF License warnings.
18750
ReasonTests
Failed junit testshadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.client.TestSnapshotTemporaryDirectory
SubsystemReport/Notes
DockerClient=19.03.0 Server=19.03.0 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/31/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ddc00cc86af7 4.15.0-52-generic #56-Ubuntu SMP Tue Jun 4 22:49:08 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / ec68bf3
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/31/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/31/testReport/
Max. process+thread count4608 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/31/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec34Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall361master passed
+1compile59master passed
+1checkstyle92master passed
+1shadedjars351branch has no errors when building our shaded downstream artifacts.
+1javadoc43master passed
0spotbugs341Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs338master passed
_ Patch Compile Tests _
+1mvninstall385the patch passed
+1compile70the patch passed
+1javac70the patch passed
+1checkstyle100the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars351patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1200Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc41the patch passed
+1findbugs342the patch passed
_ Other Tests _
-1unit10062hbase-server in the patch failed.
+1asflicense26The patch does not generate ASF License warnings.
14298
ReasonTests
Failed junit testshadoop.hbase.client.TestAsyncTableGetMultiThreaded
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/32/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux a52ba673406e 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / f2425c7
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/32/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/32/testReport/
Max. process+thread count4369 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/32/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec73Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall352master passed
+1compile59master passed
+1checkstyle89master passed
+1shadedjars298branch has no errors when building our shaded downstream artifacts.
+1javadoc37master passed
0spotbugs258Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs256master passed
_ Patch Compile Tests _
+1mvninstall329the patch passed
+1compile56the patch passed
+1javac56the patch passed
+1checkstyle87the patch passed
+1whitespace1The patch has no whitespace issues.
+1shadedjars300patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1036Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc36the patch passed
+1findbugs270the patch passed
_ Other Tests _
-1unit12288hbase-server in the patch failed.
+1asflicense25The patch does not generate ASF License warnings.
15992
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/33/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 4ad01f9819f6 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 56980fb
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/33/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/33/testReport/
Max. process+thread count5017 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/33/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@VicoWu

VicoWu commented Aug 29, 2019

Copy link
Copy Markdown
ContributorAuthor

@shahrs87
Thanks for you comments;
My current branch is a CDH version hadoop2.6.0-CDH5.16.1;
I previously thought that the hadoop2.6.0-CDH5.16.1; is totallly based on the apache hadoop 2..6.0, but from this case it seems not;
This is my code of the HDFSFileSystem.open() for hadoop2.6.0-CDH5.16.1`:

 @Override
public FSDataInputStream open(final Path f, final int bufferSize
) throws IOException {
statistics.incrementReadOps(1);
return new FSDataInputStream(new WebHdfsInputStream(f, bufferSize));
}

And I find the first occurrence for the WebHdfsInputSteam.open() method occurs in Apache hadoop apache/hadoop@eda4dbb
It seems that they are already different from scratch;
Maybe I should communicate with Cloudera ;
Thanks again;

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec56Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author1The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall413master passed
+1compile72master passed
+1checkstyle103master passed
+1shadedjars349branch has no errors when building our shaded downstream artifacts.
+1javadoc46master passed
0spotbugs279Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs276master passed
_ Patch Compile Tests _
+1mvninstall305the patch passed
+1compile58the patch passed
+1javac58the patch passed
+1checkstyle78the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars285patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1005Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc38the patch passed
+1findbugs256the patch passed
_ Other Tests _
+1unit9539hbase-server in the patch passed.
+1asflicense33The patch does not generate ASF License warnings.
13302
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/34/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 3558ac521f02 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 83e7794
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/34/testReport/
Max. process+thread count4477 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/34/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec36Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall323master passed
+1compile54master passed
+1checkstyle77master passed
+1shadedjars269branch has no errors when building our shaded downstream artifacts.
+1javadoc38master passed
0spotbugs238Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs236master passed
_ Patch Compile Tests _
+1mvninstall294the patch passed
+1compile53the patch passed
+1javac53the patch passed
+1checkstyle77the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars270patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck931Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc35the patch passed
+1findbugs247the patch passed
_ Other Tests _
+1unit9350hbase-server in the patch passed.
+1asflicense28The patch does not generate ASF License warnings.
12688
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/35/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 6c03171ad208 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 090c55f
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/35/testReport/
Max. process+thread count5015 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/35/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec73Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall343master passed
+1compile61master passed
+1checkstyle81master passed
+1shadedjars286branch has no errors when building our shaded downstream artifacts.
+1javadoc40master passed
0spotbugs268Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs264master passed
_ Patch Compile Tests _
+1mvninstall314the patch passed
+1compile61the patch passed
+1javac61the patch passed
+1checkstyle82the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars289patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck976Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc39the patch passed
+1findbugs275the patch passed
_ Other Tests _
-1unit16008hbase-server in the patch failed.
+1asflicense29The patch does not generate ASF License warnings.
19608
ReasonTests
Failed junit testshadoop.hbase.master.TestSplitWALManager
hadoop.hbase.client.TestAsyncRegionAdminApi
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/36/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 2cdee7bb8752 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 090c55f
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/36/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/36/testReport/
Max. process+thread count4842 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/36/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec39Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall331master passed
+1compile59master passed
+1checkstyle80master passed
+1shadedjars282branch has no errors when building our shaded downstream artifacts.
+1javadoc39master passed
0spotbugs243Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs241master passed
_ Patch Compile Tests _
+1mvninstall325the patch passed
+1compile59the patch passed
+1javac59the patch passed
+1checkstyle77the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars298patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck971Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc34the patch passed
+1findbugs263the patch passed
_ Other Tests _
+1unit9364hbase-server in the patch passed.
+1asflicense35The patch does not generate ASF License warnings.
12895
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/37/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux e617a5f18a53 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / ee5cf0d
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/37/testReport/
Max. process+thread count4822 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/37/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec41Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall399master passed
+1compile58master passed
+1checkstyle81master passed
+1shadedjars288branch has no errors when building our shaded downstream artifacts.
+1javadoc40master passed
0spotbugs256Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs254master passed
_ Patch Compile Tests _
+1mvninstall382the patch passed
+1compile65the patch passed
+1javac65the patch passed
+1checkstyle89the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars349patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1188Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc41the patch passed
+1findbugs300the patch passed
_ Other Tests _
+1unit9800hbase-server in the patch passed.
+1asflicense34The patch does not generate ASF License warnings.
13878
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/38/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux e2118191fd6a 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / b642ee0
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/38/testReport/
Max. process+thread count4412 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/38/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec36Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall330master passed
+1compile56master passed
+1checkstyle79master passed
+1shadedjars277branch has no errors when building our shaded downstream artifacts.
+1javadoc38master passed
0spotbugs234Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs232master passed
_ Patch Compile Tests _
+1mvninstall295the patch passed
+1compile56the patch passed
+1javac56the patch passed
+1checkstyle75the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars273patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck970Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc36the patch passed
+1findbugs261the patch passed
_ Other Tests _
+1unit10158hbase-server in the patch passed.
+1asflicense31The patch does not generate ASF License warnings.
13584
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/39/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 26ea8def96e6 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 97fbaa6
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/39/testReport/
Max. process+thread count4489 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/39/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec94Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall371master passed
+1compile64master passed
+1checkstyle100master passed
+1shadedjars307branch has no errors when building our shaded downstream artifacts.
+1javadoc39master passed
0spotbugs285Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs282master passed
_ Patch Compile Tests _
+1mvninstall349the patch passed
+1compile67the patch passed
+1javac67the patch passed
+1checkstyle90the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars306patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1053Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc39the patch passed
+1findbugs283the patch passed
_ Other Tests _
-1unit16467hbase-server in the patch failed.
+1asflicense61The patch does not generate ASF License warnings.
20396
ReasonTests
Failed junit testshadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.client.TestSnapshotTemporaryDirectoryWithRegionReplicas
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.master.TestSplitWALManager
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/40/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux fa6143fc712a 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / a5ef6b2
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/40/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/40/testReport/
Max. process+thread count4937 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/40/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec115Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall327master passed
+1compile55master passed
+1checkstyle79master passed
+1shadedjars273branch has no errors when building our shaded downstream artifacts.
+1javadoc37master passed
0spotbugs208Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs205master passed
_ Patch Compile Tests _
+1mvninstall299the patch passed
+1compile55the patch passed
+1javac55the patch passed
+1checkstyle76the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars273patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck937Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc35the patch passed
+1findbugs245the patch passed
_ Other Tests _
+1unit9524hbase-server in the patch passed.
+1asflicense36The patch does not generate ASF License warnings.
12941
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/41/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ec56fb5dcf38 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / a5ef6b2
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/41/testReport/
Max. process+thread count4961 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/41/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec40Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall326master passed
+1compile56master passed
+1checkstyle75master passed
+1shadedjars283branch has no errors when building our shaded downstream artifacts.
+1javadoc39master passed
0spotbugs262Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs260master passed
_ Patch Compile Tests _
+1mvninstall313the patch passed
+1compile58the patch passed
+1javac58the patch passed
+1checkstyle82the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars294patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck970Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc42the patch passed
+1findbugs306the patch passed
_ Other Tests _
-1unit10459hbase-server in the patch failed.
+1asflicense32The patch does not generate ASF License warnings.
14071
ReasonTests
Failed junit testshadoop.hbase.regionserver.TestHRegionWithInMemoryFlush
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/42/artifact/out/Dockerfile
GITHUB PR#509
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux d6b55f893f6d 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revisionmaster / 8e8bd8b
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/42/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/42/testReport/
Max. process+thread count4629 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/42/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@saintstack

Copy link
Copy Markdown
Contributor

Ok. Really good back and forth here. Good info in the above dialog. Seems like a CDH5 issue. Closing. Shout if I have it wrong.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@VicoWu@jojochuang@Apache-HBase@shahrs87@saintstack