Skip to content

HDDS-999. Make the DNS resolution in OzoneManager more resilient. (swagle) - #758

Closed
swagle wants to merge 3 commits into
apache:trunkfrom
swagle:HDDS-999
Closed

HDDS-999. Make the DNS resolution in OzoneManager more resilient. (swagle)#758
swagle wants to merge 3 commits into
apache:trunkfrom
swagle:HDDS-999

Conversation

@swagle

Copy link
Copy Markdown
Contributor

Brought back change from HDDS-776 with the retriable task, OM will now wait for at least 50 seconds before giving up.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec26Docker mode activated.
_ Prechecks _
0yamllint0yamllint was not available.
+1@author0The patch does not contain any @author tags.
-1test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0mvndep42Maven dependency ordering for branch
+1mvninstall1084trunk passed
+1compile130trunk passed
+1checkstyle53trunk passed
+1mvnsite66trunk passed
+1shadedclient787branch has no errors when building and testing our client artifacts.
0findbugs1Skipped patched modules with no Java source: hadoop-ozone/dist
+1findbugs44trunk passed
+1javadoc38trunk passed
_ Patch Compile Tests _
0mvndep13Maven dependency ordering for patch
-1mvninstall18dist in the patch failed.
+1compile114the patch passed
+1javac114the patch passed
+1checkstyle24the patch passed
+1mvnsite45the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedclient726patch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/dist
+1findbugs47the patch passed
+1javadoc40the patch passed
_ Other Tests _
+1unit43ozone-manager in the patch passed.
+1unit24dist in the patch passed.
+1asflicense30The patch does not generate ASF License warnings.
3482
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-758/1/artifact/out/Dockerfile
GITHUB PR#758
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient yamllint findbugs checkstyle
unameLinux d3c23ad8d320 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / f4ab937
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
findbugsv3.1.0-RC1
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-758/1/artifact/out/patch-mvninstall-hadoop-ozone_dist.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-758/1/testReport/
Max. process+thread count411 (vs. ulimit of 5500)
modulesC: hadoop-ozone/ozone-manager hadoop-ozone/dist U: hadoop-ozone
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-758/1/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504bharatviswa504 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have a few comments, rest LGTM.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We removed WAITFOR env usage, there are few other files where this is used, om-statefulset.yaml. Do we need to remove from there also?

And also we are removing usage of WAITFOR, then do we need to remove the logic for this in docker image code?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Making the changes to remove the wait for, @elek it makes sense to remove the wait for from everywhere, right?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, it should be fine AFAIK.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec25Docker mode activated.
_ Prechecks _
0yamllint0yamllint was not available.
+1@author0The patch does not contain any @author tags.
-1test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0mvndep13Maven dependency ordering for branch
+1mvninstall1022trunk passed
+1compile107trunk passed
+1checkstyle25trunk passed
+1mvnsite52trunk passed
+1shadedclient687branch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/dist
+1findbugs37trunk passed
+1javadoc34trunk passed
_ Patch Compile Tests _
0mvndep12Maven dependency ordering for patch
-1mvninstall18dist in the patch failed.
+1compile101the patch passed
+1javac101the patch passed
+1checkstyle23the patch passed
+1mvnsite42the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedclient683patch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/dist
+1findbugs43the patch passed
+1javadoc31the patch passed
_ Other Tests _
+1unit38ozone-manager in the patch passed.
+1unit21dist in the patch passed.
+1asflicense25The patch does not generate ASF License warnings.
3139
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-758/2/artifact/out/Dockerfile
GITHUB PR#758
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient yamllint findbugs checkstyle
unameLinux 33f2157700e6 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / 59ded76
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
findbugsv3.1.0-RC1
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-758/2/artifact/out/patch-mvninstall-hadoop-ozone_dist.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-758/2/testReport/
Max. process+thread count446 (vs. ulimit of 5500)
modulesC: hadoop-ozone/ozone-manager hadoop-ozone/dist U: hadoop-ozone
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-758/2/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ENSURE_OM_INITIALIZED is not required here. For kubernetes we follow a different (more generic) approach. We can define an 'initContainer' to execute the 'om --init' first. (as you can see this is the initContainer here). As the 'om --init' can be executed multiple times it works well without the environment variable (which is handled by the starter script of the container.

@swagleswagleApr 25, 2019

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the review @elek. Removed in the latest commit.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, it should be fine AFAIK.

@hadoop-yetus

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec38Docker mode activated.
_ Prechecks _
0yamllint0yamllint was not available.
+1@author0The patch does not contain any @author tags.
-1test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0mvndep52Maven dependency ordering for branch
+1mvninstall1066trunk passed
+1compile115trunk passed
+1checkstyle48trunk passed
+1mvnsite67trunk passed
+1shadedclient862branch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/dist
+1findbugs58trunk passed
+1javadoc54trunk passed
_ Patch Compile Tests _
0mvndep15Maven dependency ordering for patch
-1mvninstall23dist in the patch failed.
+1compile114the patch passed
+1javac114the patch passed
+1checkstyle27the patch passed
+1mvnsite51the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedclient873patch has no errors when building and testing our client artifacts.
0findbugs0Skipped patched modules with no Java source: hadoop-ozone/dist
+1findbugs52the patch passed
+1javadoc44the patch passed
_ Other Tests _
+1unit71ozone-manager in the patch passed.
+1unit24dist in the patch passed.
+1asflicense31The patch does not generate ASF License warnings.
3777
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-758/3/artifact/out/Dockerfile
GITHUB PR#758
Optional Testsdupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient yamllint findbugs checkstyle
unameLinux 87b06ff22d90 3.13.0-153-generic #203-Ubuntu SMP Thu Jun 14 08:52:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitypersonality/hadoop.sh
git revisiontrunk / b5dcf64
mavenversion: Apache Maven 3.3.9
Default Java1.8.0_191
findbugsv3.1.0-RC1
mvninstallhttps://builds.apache.org/job/hadoop-multibranch/job/PR-758/3/artifact/out/patch-mvninstall-hadoop-ozone_dist.txt
Test Resultshttps://builds.apache.org/job/hadoop-multibranch/job/PR-758/3/testReport/
Max. process+thread count389 (vs. ulimit of 5500)
modulesC: hadoop-ozone/ozone-manager hadoop-ozone/dist U: hadoop-ozone
Console outputhttps://builds.apache.org/job/hadoop-multibranch/job/PR-758/3/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@elekelek left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1. Thanks the update. Will merge it soon...

@elekelek closed this in c35abcdApr 26, 2019
shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
Author: rmatharu@linkedin.com <rmatharu@linkedin.com>
Reviewers: Prateek Maheshwari <pmaheshwari@apache.org>
Closesapache#758 from rmatharu/doc
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@swagle@hadoop-yetus@elek@bharatviswa504