Skip to content

HDDS-1175. Serve read requests directly from RocksDB. - #557

Merged
hanishakoneru merged 5 commits into
apache:trunkfrom
hanishakoneru:HDDS-1175
Mar 7, 2019
Merged

HDDS-1175. Serve read requests directly from RocksDB.#557
hanishakoneru merged 5 commits into
apache:trunkfrom
hanishakoneru:HDDS-1175

Conversation

@hanishakoneru

Copy link
Copy Markdown
Contributor

No description provided.

@elekelek added the ozone label Mar 5, 2019
@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec47Docker mode activated.
_ Prechecks _
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
0mvndep47Maven dependency ordering for branch
+1mvninstall1097trunk passed
-1compile592root in trunk failed.
+1checkstyle203trunk passed
-1mvnsite40common in trunk failed.
-1mvnsite43integration-test in trunk failed.
-1mvnsite28ozone-manager in trunk failed.
+1shadedclient1084branch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/integration-test
-1findbugs24common in trunk failed.
-1findbugs25ozone-manager in trunk failed.
+1javadoc119trunk passed
_ Patch Compile Tests _
0mvndep22Maven dependency ordering for patch
-1mvninstall27common in the patch failed.
-1mvninstall25integration-test in the patch failed.
-1mvninstall20ozone-manager in the patch failed.
-1compile571root in the patch failed.
-1javac571root in the patch failed.
+1checkstyle196the patch passed
-1mvnsite35common in the patch failed.
-1mvnsite28integration-test in the patch failed.
-1mvnsite25ozone-manager in the patch failed.
-1whitespace0The patch has 75 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-1whitespace1The patch 19849 line(s) with tabs.
+1xml2The patch has no ill-formed XML file.
+1shadedclient729patch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/integration-test
-1findbugs31common in the patch failed.
-1findbugs29ozone-manager in the patch failed.
-1javadoc31hadoop-ozone_ozone-manager generated 3 new + 2 unchanged - 0 fixed = 5 total (was 2)
_ Other Tests _
-1unit121common in the patch failed.
-1unit43common in the patch failed.
-1unit34integration-test in the patch failed.
-1unit32ozone-manager in the patch failed.
+1asflicense41The patch does not generate ASF License warnings.
5946
ReasonTests
Failed junit testshadoop.hdds.security.x509.certificate.client.TestDefaultCertificateClient
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/Dockerfile
GITHUB PR#557
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle
unameLinux 96f0f7240798 3.13.0-153-generic #203-Ubuntu SMP Thu Jun 14 08:52:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 313e8b9
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/branch-compile-root.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/branch-mvnsite-hadoop-ozone_common.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/branch-mvnsite-hadoop-ozone_integration-test.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/branch-mvnsite-hadoop-ozone_ozone-manager.txt
findbugsv3.1.0-RC1
findbugshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/branch-findbugs-hadoop-ozone_common.txt
findbugshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-mvninstall-hadoop-ozone_common.txt
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-mvninstall-hadoop-ozone_integration-test.txt
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-mvninstall-hadoop-ozone_ozone-manager.txt
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-compile-root.txt
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-compile-root.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-mvnsite-hadoop-ozone_common.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-mvnsite-hadoop-ozone_integration-test.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-mvnsite-hadoop-ozone_ozone-manager.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/whitespace-eol.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/whitespace-tabs.txt
findbugshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-findbugs-hadoop-ozone_common.txt
findbugshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-findbugs-hadoop-ozone_ozone-manager.txt
javadochttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/diff-javadoc-javadoc-hadoop-ozone_ozone-manager.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-unit-hadoop-hdds_common.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-unit-hadoop-ozone_common.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-unit-hadoop-ozone_integration-test.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/artifact/out/patch-unit-hadoop-ozone_ozone-manager.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/testReport/
Max. process+thread count333 (vs. ulimit of 5500)
modulesC: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/1/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec66Docker mode activated.
_ Prechecks _
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
0mvndep84Maven dependency ordering for branch
+1mvninstall1257trunk passed
-1compile568root in trunk failed.
+1checkstyle198trunk passed
-1mvnsite41common in trunk failed.
-1mvnsite45integration-test in trunk failed.
-1mvnsite26ozone-manager in trunk failed.
+1shadedclient1103branch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/integration-test
-1findbugs41common in trunk failed.
-1findbugs29ozone-manager in trunk failed.
+1javadoc128trunk passed
_ Patch Compile Tests _
0mvndep65Maven dependency ordering for patch
-1mvninstall29integration-test in the patch failed.
-1compile605root in the patch failed.
-1javac605root in the patch failed.
+1checkstyle192the patch passed
-1mvnsite32integration-test in the patch failed.
-1whitespace1The patch has 75 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-1whitespace1The patch 19849 line(s) with tabs.
+1xml2The patch has no ill-formed XML file.
+1shadedclient691patch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/integration-test
+1findbugs233the patch passed
+1javadoc45common in the patch passed.
+1javadoc39common in the patch passed.
+1javadoc18integration-test in the patch passed.
+1javadoc24hadoop-ozone_ozone-manager generated 0 new + 0 unchanged - 2 fixed = 0 total (was 2)
_ Other Tests _
-1unit87common in the patch failed.
-1unit43common in the patch failed.
-1unit36integration-test in the patch failed.
+1unit49ozone-manager in the patch passed.
+1asflicense33The patch does not generate ASF License warnings.
6313
ReasonTests
Failed junit testshadoop.hdds.security.x509.certificate.client.TestDefaultCertificateClient
hadoop.ozone.security.TestOzoneDelegationTokenSecretManager
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/Dockerfile
GITHUB PR#557
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle
unameLinux 298573dbba86 3.13.0-153-generic #203-Ubuntu SMP Thu Jun 14 08:52:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 7f636b4
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/branch-compile-root.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/branch-mvnsite-hadoop-ozone_common.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/branch-mvnsite-hadoop-ozone_integration-test.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/branch-mvnsite-hadoop-ozone_ozone-manager.txt
findbugsv3.1.0-RC1
findbugshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/branch-findbugs-hadoop-ozone_common.txt
findbugshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/patch-mvninstall-hadoop-ozone_integration-test.txt
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/patch-compile-root.txt
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/patch-compile-root.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/patch-mvnsite-hadoop-ozone_integration-test.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/whitespace-eol.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/whitespace-tabs.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/patch-unit-hadoop-hdds_common.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/patch-unit-hadoop-ozone_common.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/artifact/out/patch-unit-hadoop-ozone_integration-test.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/testReport/
Max. process+thread count342 (vs. ulimit of 5500)
modulesC: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/2/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@arp7
arp7 self-requested a review March 6, 2019 04:31
@arp7arp7 self-assigned this Mar 6, 2019
arp7
arp7 approved these changes Mar 6, 2019

@arp7arp7 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 pending Jenkins.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec143Docker mode activated.
_ Prechecks _
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
0mvndep66Maven dependency ordering for branch
+1mvninstall1060trunk passed
-1compile556root in trunk failed.
+1checkstyle184trunk passed
-1mvnsite40common in trunk failed.
-1mvnsite37integration-test in trunk failed.
-1mvnsite32ozone-manager in trunk failed.
+1shadedclient1056branch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/integration-test
-1findbugs29common in trunk failed.
-1findbugs26ozone-manager in trunk failed.
+1javadoc127trunk passed
_ Patch Compile Tests _
0mvndep25Maven dependency ordering for patch
-1mvninstall26integration-test in the patch failed.
-1compile515root in the patch failed.
-1javac515root in the patch failed.
+1checkstyle176the patch passed
-1mvnsite32integration-test in the patch failed.
-1whitespace0The patch has 75 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-1whitespace1The patch 19849 line(s) with tabs.
+1xml2The patch has no ill-formed XML file.
+1shadedclient664patch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/integration-test
+1findbugs194the patch passed
+1javadoc42common in the patch passed.
+1javadoc38common in the patch passed.
+1javadoc22integration-test in the patch passed.
+1javadoc22hadoop-ozone_ozone-manager generated 0 new + 0 unchanged - 2 fixed = 0 total (was 2)
_ Other Tests _
-1unit62common in the patch failed.
+1unit42common in the patch passed.
-1unit31integration-test in the patch failed.
+1unit40ozone-manager in the patch passed.
+1asflicense36The patch does not generate ASF License warnings.
5904
ReasonTests
Failed junit testshadoop.hdds.security.x509.certificate.client.TestDefaultCertificateClient
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/Dockerfile
GITHUB PR#557
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle
unameLinux b47069714bda 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 62e89dc
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/branch-compile-root.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/branch-mvnsite-hadoop-ozone_common.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/branch-mvnsite-hadoop-ozone_integration-test.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/branch-mvnsite-hadoop-ozone_ozone-manager.txt
findbugsv3.1.0-RC1
findbugshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/branch-findbugs-hadoop-ozone_common.txt
findbugshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/patch-mvninstall-hadoop-ozone_integration-test.txt
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/patch-compile-root.txt
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/patch-compile-root.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/patch-mvnsite-hadoop-ozone_integration-test.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/whitespace-eol.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/whitespace-tabs.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/patch-unit-hadoop-hdds_common.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/artifact/out/patch-unit-hadoop-ozone_integration-test.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/testReport/
Max. process+thread count443 (vs. ulimit of 5500)
modulesC: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/3/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec28Docker mode activated.
_ Prechecks _
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
0mvndep112Maven dependency ordering for branch
+1mvninstall1085trunk passed
-1compile608root in trunk failed.
+1checkstyle177trunk passed
-1mvnsite44integration-test in trunk failed.
+1shadedclient997branch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/integration-test
+1findbugs174trunk passed
+1javadoc131trunk passed
_ Patch Compile Tests _
0mvndep24Maven dependency ordering for patch
-1mvninstall27integration-test in the patch failed.
-1compile524root in the patch failed.
-1javac524root in the patch failed.
+1checkstyle172the patch passed
-1mvnsite34integration-test in the patch failed.
-1whitespace0The patch has 75 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-1whitespace1The patch 19849 line(s) with tabs.
+1xml2The patch has no ill-formed XML file.
+1shadedclient630patch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/integration-test
+1findbugs179the patch passed
+1javadoc97the patch passed
_ Other Tests _
-1unit74common in the patch failed.
+1unit36common in the patch passed.
-1unit28integration-test in the patch failed.
+1unit34ozone-manager in the patch passed.
+1asflicense27The patch does not generate ASF License warnings.
5763
ReasonTests
Failed junit testshadoop.hdds.security.x509.certificate.client.TestDefaultCertificateClient
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/Dockerfile
GITHUB PR#557
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle
unameLinux a0e5bebbec85 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 2c3ec37
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/branch-compile-root.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/branch-mvnsite-hadoop-ozone_integration-test.txt
findbugsv3.1.0-RC1
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/patch-mvninstall-hadoop-ozone_integration-test.txt
compilehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/patch-compile-root.txt
javachttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/patch-compile-root.txt
mvnsitehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/patch-mvnsite-hadoop-ozone_integration-test.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/whitespace-eol.txt
whitespacehttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/whitespace-tabs.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/patch-unit-hadoop-hdds_common.txt
unithttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/artifact/out/patch-unit-hadoop-ozone_integration-test.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/testReport/
Max. process+thread count445 (vs. ulimit of 5500)
modulesC: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-557/4/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@hanishakoneru

Copy link
Copy Markdown
ContributorAuthor

The test failures are unrelated and pass locally. I will merge the PR shortly.

@hanishakoneru
hanishakoneru merged commit bb12e81 into apache:trunkMar 7, 2019
shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
SQL IO Resolver needs full configs so that it can filter out the configs specific to the source that the SQL application is interested in. This change provides the IO resolver with the full config.
Author: Srinivasulu Punuru <spunuru@linkedin.com>
Reviewers: Aditya Toomula <atoomula@linkedin.com>
Closesapache#557 from srinipunuru/fullconfig.1
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@hanishakoneru@hadoop-yetus@arp7@elek